Machine Learning Engineer, Assistant Quality
At a glance
Junior Machine Learning Engineering role at Glean. San Francisco · $180,000–$205,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Improve the Assistant and autonomous agents by building machine-learning systems for real user workflows
- Set up evaluations and monitoring to track model quality, assistant usefulness and end-to-end performance
- Tune prompts, signals and workflows to strengthen reasoning, personalization and task completion
- Build data and ML infrastructure for experimentation, evaluation and ongoing model improvements
- Work with product, design and engineering to address customer problems and ship production systems
What you bring
- At least two years in machine learning, applied AI or software engineering with substantial ML responsibility
- You have coded and shipped production systems, rather than stopping at prototypes or research
- Experience in an area such as LLM applications, search, retrieval or recommendations
- Strong software engineering skills and proficiency with ML tooling and a language such as Python or Go
Who this fits
This role suits an engineer who enjoys applied machine learning and product work more than research alone, and who can move between modeling and production details. You’ll work in the San Francisco office four days each week. The listed base salary range is $180,000 to $205,000 per year.
From the employer
You will work on applied problems across agent quality, evaluation, personalization, retrieval, and orchestration. The ideal person is excited by shipping production systems, not pure research, and wants to help shape how Glean’s assistant gets better over time through stronger signals, tighter feedback loops, and better end-to-end execution quality.
You will:- Build and improve ML and LLM-powered systems that raise the quality of Glean’s AI Assistant and autonomous agents across real user workflows.
- Design evaluation, benchmarking, and monitoring loops to measure assistant quality, model quality, and end-to-end system performance.
- Develop and iterate on signals, prompts, workflows, and model-driven logic that improve reasoning, planning, personalization, and task completion quality.
- Work across areas such as RAG, semantic search, recommendation-style systems, post-training or reinforcement learning, and agent orchestration where they materially improve product outcomes.
- Partner closely with product, design, and engineering teammates to understand customer pain points and ship high-quality production systems quickly.
- Contribute to the data and ML infrastructure needed to support robust experimentation, offline and online evaluation, and continuous model improvement.
- 2+ years of industry experience in machine learning, applied AI, or software engineering with significant ML ownership.
- Strong hands-on coding ability and a track record of shipping production systems, not just prototypes or research projects.
- Experience in one or more of the following areas: LLM applications, NLP, search, retrieval, recommendations, evaluation frameworks, agent systems, or personalization.
- Comfort working across both modeling and product engineering details, including experimentation, quality measurement, and production iteration.
- Proficiency in common ML tooling and strong software engineering fundamentals in languages such as Python, Go, Java, or C++.
- A pragmatic, product-minded approach. You know when to use sophisticated ML techniques and when simple, reliable systems are the better answer.
- A proactive, low-ego working style and excitement about learning quickly in a high-velocity environment.
- This role is hybrid (4 days a week in our San Francisco office)
AI-First Mindset at Glean: At Glean, AI fluency is core to how we work and we're committed to ensuring every new hire feels confident integrating AI into their everyday work. As part of the interview process, you'll complete a brief AI-focused exercise or discussion so we can understand how you think about, design, and use AI to drive impact in your role. Feel free to reference any tools, platforms, or workflows you use today — prior Glean experience isn't required. Global Data Privacy Notice for Job Candidates and Applicants: Depending on your location, the General Data Protection Regulation (GDPR), California Consumer Privacy Act (CCPA), or other privacy laws may regulate the way we manage the data of job applicants. Our full notice outlining how data will be processed as part of the application procedure for applicable locations is available in our Privacy Policy. By submitting your application, you are agreeing to our use and processing of your data as required. US applicants and their applications are subject to arbitration of disputes as outlined in our Applicant Arbitration Agreement.
By clicking “Submit Application,” I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement, and I agree to the terms.