Applied AI Engineer, Team Lead
At a glance
Senior AI Engineering role at Luminai. San Mateo · full-time · $200,000–$350,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Run experiments against internal AI benchmarks and refine evaluation methods to guide faster, more useful testing
- Train and tune machine learning models, then test their accuracy, generalization and performance
- Contribute to core product work that expands platform capabilities and add monitoring to check model behavior in critical settings
- Set technical standards for experimentation and evaluation, while mentoring engineers and helping resolve difficult tradeoffs
What you bring
- At least five years shipping high-quality software in challenging projects
- A computer science, machine learning or related degree at bachelor's or master's level
- Strong grounding in algorithms, data structures and system design, with experience putting ML models into production
- A record of leading technically with limited oversight and setting a high standard for teammates
Who this fits
This senior role suits an engineer ready to steer AI experimentation and evaluation while mentoring other engineers. The team works from its San Francisco or New York office four days each week, with Wednesday available for optional work from home.
From the employer
About Luminai
Healthcare operations have always depended on people to bridge the gaps that technology couldn't. It relies on complex manual work to carry out critical internal processes, yet most health systems don’t have enough resources to properly automate these tasks, leaving them stuck in outdated, labor-intensive SOPs.
Luminai structures the chaos, automates the manual handoffs, and deploys end-to-end workflows across every system, providing the integrated intelligence layer to improve processes over time. By delegating to autonomous AI systems those mission-critical workflows that previously expended valuable human time, Luminai allows doctors and administrators to do what they do best: Focus on Patients.
We've raised $60M in funding, including our recent Series B led by Peak XV Partners (formerly Sequoia India), with participation from healthcare-focused Define Ventures and continued support from General Catalyst and Y Combinator. We're backed by some of the best investors in Silicon Valley, including Kevin Weil (Chief Product Officer at OpenAI), Arash Ferdowsi (co-founder of Dropbox), Katie Stanton (former VP Global Media, Twitter), and CEOs of companies such as Flexport, Notion, Front, Ramp, and Twitch.
Our team is in-office 4 days a week (Monday - Friday, Wednesday optional WFH) in either San Francisco, California or New York, New York.
About the role
As a Lead Software Engineer working on AI systems, you will play a foundational role in research, experimentation and rapid improvement of AI systems towards building a capable, reliable AI automation platform, while also raising the technical bar for the engineers around you. The platform is used by organizations worldwide to deploy and scale executable AI automations in mission critical production environments. You are expected to have deep proficiency in the fundamentals of software engineering, a willingness to pick up new concepts as needed, and a proven ability to drive technical projects and set technical direction in ambitious environments.
What You'll Do
Design experiments and test ideas to optimize key internal AI benchmarks
Design and improve evaluation frameworks to accelerate the speed and direction of experimentation
Train, fine-tune, and optimize machine learning models. Perform rigorous evaluation and testing to ensure model accuracy, generalization, and performance.
Collaborate and contribute on the core product development to deliver higher platform capabilities
Set up observability and monitoring systems to safety check model behavior in critical settings
Set technical direction across experimentation and evaluation work, raising the bar on rigor, tooling, and best practices for the team
Mentor and unblock other engineers, acting as a senior voice on ambiguous technical tradeoffs
What We're Looking For
5+ years of proven track record shipping high-quality code in challenging projects
A track record of being the senior, steady hand on a team, comfortable operating with less oversight and setting the bar for others
Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field
Solid fundamentals in algorithms, data structures, system design
Attention to detail and a first-principles thinking towards real world deployment of intelligent systems
Experience shipping ML models to production
Bonus
Previous experience working with distributed computing systems in production