Clinical Development Lead, AI/LLM
At a glance
Senior AI Engineering role at Neko Health. New York · full-time · $259,000–$297,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Set clinical standards for Neko’s generative AI features and stay accountable for safety from initial scoping through release
- Create and run tests for generated clinical responses, including the acceptance bar behind the stated evaluation score
- Assess member chat for fabricated claims, harmful or inaccurate guidance, and failures to escalate
- Check Doctor Scribe against debrief and referral accuracy goals, then review each product release with product and engineering
- Coordinate clinical work across product, quality, education, operations and clinic teams while maintaining a small clinic commitment
What you bring
- You are a practising or recently practising physician, or bring equivalent clinical-scientific expertise and deep clinical fluency
- You have directly built, assessed or clinically checked generative AI outputs in healthcare or clinical content
- You can produce and validate specialist clinical material, and judge model risks such as false claims or missed escalation
- You understand medical-device and clinical-software safety and quality duties, including how they apply to AI
Who this fits
This senior clinical lead role suits someone who can make independent clinical calls while working closely with product and engineering. You will maintain a limited clinical practice commitment and need to work across Swedish, UK and US clinical settings. The role is hybrid in New York.
From the employer
Mission
Neko is redefining what prevention means, from treating illness when it arrives, to sustaining health before it's ever at risk. Our mission: make data-driven, preventative care accessible to more people, before symptoms appear.
In a single, non-invasive visit under an hour, proprietary technology and direct clinical care combine to deliver personalised, actionable insights. It's a team that thinks in 10x, not 10%. Every role here plays a part in building a world where prevention is the norm, and where your work genuinely helps people live longer, healthier lives.
Role Purpose
We're looking for an exceptional Clinical Development Lead to own the clinical accuracy and safety of every generative AI surface Neko Health builds: the member-facing LLM chat, the Gen AI UX, Doctor Scribe, and Pre-brief. This is a high-impact role for a clinician who knows how to set the quality bar for generative output in a clinical context and then hold it.
You'll lead the LLM and AI pillar within Clinical product and development, partnering directly with the LLM and AI Product Manager and Engineering lead: one clinical lead to one pillar, alongside them rather than shared across them. Their goal is engagement, with members returning, using the chat, and trusting it to help them understand and navigate their health. You own the thing that makes engagement safe to want: clinical quality. A generative surface someone uses ten times a year is only good if it is right every time. You set that bar, and you are the DRI for clinical safety of what these surfaces say.
We're post-Series B and moving quickly, and this area of work is about clinical judgement, evaluation rigour, and strong advisory capabilities.
What You'll Deliver in the First 6–12 Months
Set clinical requirements and the quality bar for all generative AI surfaces, acting as clinical DRI from scoping through rollout.
Build and run the clinical evaluation framework for generative outputs, and define the acceptance threshold behind the >90% eval score.
Own the clinical safety case for member-facing chat: hallucination, unsafe or incorrect advice, and missed escalation.
Validate Doctor Scribe output against the auto-generated debrief and referral-accuracy targets.
Partner with the LLM and Gen AI PM and Engineering lead on the pillar roadmap, validating every release against clinical safety, accuracy and compliance.
Work alongside the Member Experience and Medical Tools clinical leads, plus Quality & Compliance, Learning & Education, Operations and market/clinic leadership, across the product lifecycle.
Carry a small, protected clinical commitment (roughly 0.05–0.1 FTE) to stay grounded in clinic reality.
Minimum Requirements
A practising or recently practising physician with the credibility to set the clinical bar and act as DRI, or an equivalent clinical-scientific background with deep clinical fluency.
Direct experience with LLMs or generative AI in a healthcare or clinical-content setting: building, evaluating, or clinically validating generative outputs.
Strong grasp of the failure modes of generative models in a clinical context (hallucination, unsafe advice, missed escalation) and how to evaluate against them.
Working understanding of medical-device and clinical-software quality and safety obligations (e.g. EU MDR, GCP) as they apply to AI.
Ability to produce and validate specialist clinical content, not only to coordinate others who do.
Comfort operating across Swedish, UK and US clinical contexts, and the judgement to know when to override the tool with clinical reasoning.