Member of Technical Staff – Applied AI Engineer, Health AI
At Microsoft AI, our health team is on a mission to help millions of users better understand and proactively manage their health and wellbeing. We’re responsible for ensuring that Microsoft AI’s models and services are useful, trusted and safe across diverse customer health journeys.
We’re assembling a world‑class team of builders with backgrounds in healthcare, big tech, and frontier AI research labs. Our goal is to translate cutting‑edge research—like MAI‑DxO—into transformative products for millions of users across copilot.com and Microsoft’s consumer ecosystem.
We are looking for software engineers with experience designing and building LLM‑based products, and taking them through to production. You will be a key bridge between research and product, and play a pivotal role in establishing Copilot as the leader in safe, informative, trustworthy and useful health information. You will be expected to build eval pipelines, curate and synthesize datasets, design automated analyses and explain results to internal stakeholders.
Microsoft’s mission is to empower every person and every organisation on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realise our shared goals.
Responsibilities
* Be a key cross‑functional team member and close collaborator to product teams; contribute to translating research into benchmarks and co‑authoring the product roadmap.
* Design and build evaluation systems that test LLM capabilities in the healthcare domain, and interpret and communicate results.
* Run experiments to determine how different prompting techniques affect results on internal and industry benchmarks.
* Improve the tooling internally used to implement, run and analyse evaluations.
* Design internal benchmarking and regression testing capabilities that capture model accuracy, safety and utility.
Required Qualifications
* Bachelor’s or higher degree in Computer Science or related technical discipline and significant Python programming experience / machine learning research.
* Deep experience building with and around LLMs and building tools for analysing and understanding their performance, including prompt/context engineering.
* Experience collaborating in cross‑functional teams, working through ambiguity to deliver high‑quality results.
* Zero to one year of experience with a bias toward shipping and learning while balancing a high‑quality bar.
* Proven ability to collaborate and contribute to a positive, inclusive work environment.
Preferred Qualifications
* Experience in healthcare technology or the health domain.
* Experience with data engineering—handling text dataset sourcing, curation, and processing tasks at scale.
* Passionate about conversational AI and its deployment.
* Demonstrated written and verbal communication skills for working closely with cross‑functional teams.
* Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies and patterns in AI.
Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles in the U.S. or 25 miles in other countries, per local law.
#J-18808-Ljbffr