About UpDoc

At UpDoc, we’re truly not just building another chatbot—we’ve created the world’s first clinically validated AI agent that directly manages medications. With partners and funders including Stanford, Mayo Clinic, Eli Lilly, UCSF Health, and Microsoft, UpDoc is building the first step towards a true "AI doctor".

In this role, you will be joining the forefront of healthcare innovation. We’re building the first platform that safely, reliably, and intelligently delivers clinical care through AI. As a senior engineer embedded deeply within our proprietary AI system, you’ll be innovating across the full stack—developing novel solutions to some of healthcare’s hardest problems. This is a rare opportunity to shape an entirely new paradigm of clinical delivery and establish yourself as a public technical leader in one of the most exciting frontiers of medicine.

While this is a fully remote position, there is preference given to applicants in the San Francisco Bay Area.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, delve into new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

• Lead the development of our patient-facing conversational agent
• Implement a scalable, low-latency system for voice/multimodal conversations
• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation
• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation
• Work with other backend engineers to deploy AI models and chat/voice APIs
• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks
• Collaborate with clinical experts to validate performance and medical accuracy
• Work on developing backend services using FastAPI and Pydantic

What You’ll Need

• 5+ years of professional software development experience, including 2+ years of experience with backend web development
• Experienced and comfortable working with type-hinted, modern Python
• 2+ years of experience building end-to-end LLM applications, personally or professionally
• Experience integrating/optimizing LLMs in production environments
• Knowledge of evaluation frameworks
• Knowledge and experience with MLOps/LLMOps best practices
• Experience building AI infrastructure from 0 -> 1
• Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

• Professional experience building end-to-end LLM-powered applications
• Experience with model fine-tuning/alignment
• Experience in an early stage startup environment
• Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Why You Should Join Us

• Join a growing, high-impact team building the future of healthcare
• Gain visibility as a leader in an emerging, high-impact field
• Work with cutting-edge LLM tools that support world-class medical institutions
• Shape core technical architecture in an emerging field
• Competitive compensation and equity in an early-stage startup

Interview Process

1. Application form: https://jobs.ashbyhq.com/pear/42f894ef-90b4-4948-910f-74524bcbc304
2. Conversation with our CTO
3. Technical interviews: 1.) Coding interview focused on a real-world application relevant to the role (e.g., LLMs, backend engineering) 2.) Architecture/whiteboarding interview focused on discussing general application-design relevant to the role
4. Conversation with our CEO