Machine Learning & Scientific Computing Engineer (AI Evaluation)
At a glance
Mid-level Machine Learning Engineering role at Weekday AI. Remote, United States · part-time.
Pay not stated Machine Learning Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Create rigorous assignments from practical machine learning and scientific computing problems
- Build clear reference implementations and runnable examples that support model testing and benchmarking
- Check AI-generated work for accuracy, efficiency, sound methods, and real-world usefulness
- Write actionable feedback and set standards for reliable, reproducible technical evaluations
- Coordinate with research teams and subject experts to address gaps and keep evaluation data consistent
What you bring
- At least four years of professional or research work in machine learning, scientific computing, data science, or a related field
- Advanced Python skills and practical use of machine learning frameworks such as PyTorch, JAX, or TensorFlow
- Experience designing, running, and assessing machine learning experiments, including model selection and reproducibility
- Clear writing that explains technical approaches, findings, and engineering decisions
Who this fits
This part-time role suits someone with hands-on machine learning and scientific computing experience who can assess technical work and write precise feedback. You must be available for at least twenty hours each week on weekdays. The position is remote in the United States and is W-2 employment.
From the employer
This role is for one of our clients
Compensation: $90 - $140 per hour
1. Role Overview
Join a leading AI lab’s cutting-edge Generative AI team and contribute to the development of next-generation foundational AI models. We are seeking experienced Machine Learning and Scientific Computing Engineers with strong practical and research expertise in machine learning, deep learning frameworks, numerical methods, and scientific computing.
In this role, you will apply your technical knowledge to design and evaluate complex machine learning and scientific computing tasks, develop reliable reference solutions, and assess the accuracy and methodological quality of AI-generated outputs. Your expertise will help improve model capabilities, strengthen technical reasoning, and enhance the overall quality of AI training data.
The ideal candidate combines strong programming skills with a solid understanding of machine learning methodologies, scientific experimentation, and reproducible computational workflows.
This is a W-2 employment opportunity, with the opportunity to work as part of a leading AI lab’s extended workforce.
Requirements
2. Key Responsibilities
- Collaborate with research and engineering teams to identify technical knowledge gaps and improve AI model performance across machine learning, scientific computing, model training, evaluation, and numerical software development.
- Design challenging, technically rigorous assignments based on real-world machine learning and scientific computing problems.
- Develop accurate, well-structured solutions and reference implementations for complex technical tasks.
- Evaluate AI-generated solutions and technical outputs for correctness, efficiency, methodological soundness, and practical applicability.
- Provide detailed, clear, and actionable written feedback on machine learning implementations, scientific computations, and problem-solving approaches.
- Create and assess technical tasks covering model training, experiment design, data processing pipelines, numerical analysis, and scientific simulations.
- Develop runnable reference solutions and reproducible computational examples to support model evaluation and benchmarking.
- Establish evaluation rubrics and quality standards to assess the correctness, reliability, reproducibility, and scientific validity of machine learning and computational work.
- Work closely with other subject matter experts to maintain technical consistency, accuracy, and quality across AI training datasets.
3. Core Qualifications & Experience
- 4+ years of dedicated professional or research experience in Machine Learning, Data Science, Scientific Computing, or a closely related technical field, preferably within a recognised, top-tier organisation, technology company, or research university.
- A Master’s or PhD degree in Computer Science, Machine Learning, Applied Mathematics, Statistics, Computational Science, Engineering, or another quantitative discipline is highly relevant. Advanced academic qualifications may count toward the required experience.
- Strong hands-on experience with deep learning and machine learning frameworks such as PyTorch, JAX, or TensorFlow, including model development, training, validation, and evaluation.
- Advanced proficiency in Python programming, with practical experience using libraries and frameworks such as NumPy, pandas, and scikit-learn for data manipulation, numerical computation, statistical analysis, and machine learning workflows.
- Solid understanding of machine learning fundamentals, including supervised and unsupervised learning, model optimisation, feature engineering, training methodologies, evaluation metrics, and experiment design.
- Experience designing, implementing, and evaluating machine learning experiments, including data preparation, model selection, hyperparameter tuning, performance analysis, and reproducibility.
- Knowledge of scientific computing concepts, numerical methods, computational modelling, and scientific simulation is highly desirable.
- Ability to analyse complex technical problems, identify implementation errors, validate computational results, and develop efficient, well-documented solutions.
- Familiarity with research methodologies, benchmarking practices, reproducible experimentation, and the interpretation of technical and scientific results.
- Publications in recognised research venues, meaningful open-source contributions, or experience developing and deploying production-grade machine learning systems will be a strong advantage.
- Demonstrable career progression through increasing technical responsibility, research contributions, or ownership of machine learning and scientific computing projects.
- Ability to commit reliably to at least 20 hours per week during weekdays.
- Excellent written communication skills, with the ability to explain complex technical concepts, computational approaches, research findings, and engineering decisions clearly.