Senior Data Scientist, Data Quality and AI Evaluation
At a glance
Senior AI Research role at NVIDIA. US, CA, Santa Clara · full-time.
In listing AI Research salary
aimlroles summary, based on the employer's posting.
What you'll do
- Set measures and tests that expose where automatic labeling works, fails or slips backward
- Build human-reviewed reference datasets spanning driving conditions, difficult edge cases, past errors and new needs
- Trace patterns in sensor, camera and annotation records, then prioritize fixes with perception and auto-labeling engineers
- Create automated methods to group failures, locate comparable cases and select examples for human correction
- Run audits and experiments, set release pass criteria, and present results through dashboards and recommendations
What you bring
- At least twelve years in industry, with a bachelor’s degree or an equivalent record in a quantitative discipline
- Strong statistical and experimental skills, plus practical work assessing machine-learning performance and data quality
- Experience assessing AI or LLM systems and using Python and SQL to analyze large datasets and build repeatable workflows
- Know how to assess model results amid uneven classes, biased samples, data leakage and differences across driving scenarios
Who this fits
This senior role suits you if you can turn unclear data-quality concerns into measurable questions and recommendations, and work across technical and operational teams. Autonomous driving, robotics or computer vision experience is a plus, as are human-review labeling workflows and benchmark maintenance.
From the employer
At NVIDIA, we are building the next generation AI-native autonomous driving architecture — combining classical safety stacks, foundation models, and scalable AI systems into a unified production platform. Autonomous driving is entering a new era. Future AV systems will not be purely classical robotics stacks, nor purely end-to-end neural networks. The future lies in the deep integration of classical safety architectures and large-scale AI-driven systems. If you want to work on problems that build the future of autonomous systems over the next decade, this is the place.
What You’ll Be Doing
- Define quality metrics and evaluation methods that reveal where auto-labeling pipelines succeed, fail, or regress.
- Build and maintain human-verified golden datasets covering representative driving conditions, critical corner cases, historical failures, and new requirements.
- Analyze large-scale sensor, camera and annotation data to identify root causes, discover systematic errors, and prioritize improvements with perception and auto-labeling engineers.
- Develop automated approaches for failure clustering, similar-case discovery, and targeted selection of data for human correction.
- Build statistically sound audits and experiments, establish release acceptance criteria, and communicate findings through clear dashboards and recommendations.
- Partner with labeling operations to improve annotation guidelines, reviewer consistency, and the balance between quality, efficiency, and cost.
What We Need To See
- Great foundations in statistics, experimental design, sampling, hypothesis testing, and uncertainty estimation, with practical experience evaluating machine learning systems and data quality.
- Experience working on AI/LLM evaluation with proficiency in Python and SQL, including analyzing large datasets and building reproducible analytical workflows. Understanding of precision, recall, class imbalance, selection bias, data leakage, and evaluation across significant scenario groups.
- Ability to distinguish reference-label defects from model errors and translate ambiguous quality concerns into measurable questions and actionable recommendations.
- Strong communication and teamwork skills, with experience working across engineering, research, product, or operations teams.
- 12+ years of industry experience with Bachelor degree or proven track record for Master in statistics, mathematics, computer science, engineering, or a related quantitative field, or equivalent experience in practice.
Ways To Stand Out from the Crowd:
- Background with autonomous driving, robotics, or computer vision, particularly camera and LiDAR data, 2D/3D annotations, multi-object tracking, occupancy, or temporal and cross-sensor consistency.
- Experience designing human-in-the-loop labeling and audit workflows, measuring annotator agreement, or maintaining versioned benchmarks with protected evaluation sets.
#AutonomousVehicles
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:224,000 USD – 356,500 USD for Level 5; and 272,000 USD – 431,250 USD for Level 6.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.