Machine Learning & Scientific Computing Engineer (AI Evaluation)
Weekday AI United States · $187K–$291K/yr
Technology, Information and Internet · 11-50 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Collaborate with research teams to design rigorous technical assignments and evaluate AI-generated solutions for accuracy and methodological soundness. Develop reference implementations and establish quality standards to improve model performance and technical reasoning.
What they look for
Requirements
Requires 4+ years of professional experience in machine learning or scientific computing and a strong background in deep learning frameworks. Candidates should possess advanced Python proficiency and a solid understanding of numerical methods and experimental design.
Full description
This role is for one of our clients
Compensation: $90 - $140 per hour
1. Role OverviewJoin a leading AI lab’s cutting-edge Generative AI team and contribute to the development of next-generation foundational AI models. We are seeking experienced Machine Learning and Scientific Computing Engineers with strong practical and research expertise in machine learning, deep learning frameworks, numerical methods, and scientific computing.
In this role, you will apply your technical knowledge to design and evaluate complex machine learning and scientific computing tasks, develop reliable reference solutions, and assess the accuracy and methodological quality of AI-generated outputs. Your expertise will help improve model capabilities, strengthen technical reasoning, and enhance the overall quality of AI training data.
The ideal candidate combines strong programming skills with a solid understanding of machine learning methodologies, scientific experimentation, and reproducible computational workflows.
This is a W-2 employment opportunity, with the opportunity to work as part of a leading AI lab’s extended workforce.
2. Key Responsibilities• Collaborate with research and engineering teams to identify technical knowledge gaps and improve AI model performance across machine learning, scientific computing, model training, evaluation, and numerical software development.
- Design challenging, technically rigorous assignments based on real-world machine learning and scientific computing problems.
- Develop accurate, well-structured solutions and reference implementations for complex technical tasks.
- Evaluate AI-generated solutions and technical outputs for correctness, efficiency, methodological soundness, and practical applicability.
- Provide detailed, clear, and actionable written feedback on machine learning implementations, scientific computations, and problem-solving approaches.
- Create and assess technical tasks covering model training, experiment design, data processing pipelines, numerical analysis, and scientific simulations.
- Develop runnable reference solutions and reproducible computational examples to support model evaluation and benchmarking.
- Establish evaluation rubrics and quality standards to assess the correctness, reliability, reproducibility, and scientific validity of machine learning and computational work.
- Work closely with other subject matter experts to maintain technical consistency, accuracy, and quality across AI training datasets.
3. Core Qualifications & Experience• 4+ years of dedicated professional or research experience in Machine Learning, Data Science, Scientific Computing, or a closely related technical field, preferably within a recognised, top-tier organisation, technology company, or research university.
- A Master’s or PhD degree in Computer Science, Machine Learning, Applied Mathematics, Statistics, Computational Science, Engineering, or another quantitative discipline is highly relevant. Advanced academic qualifications may count toward the required experience.
- Strong hands-on experience with deep learning and machine learning frameworks such as PyTorch, JAX, or TensorFlow, including model development, training, validation, and evaluation.
- Advanced proficiency in Python programming, with practical experience using libraries and frameworks such as NumPy, pandas, and scikit-learn for data manipulation, numerical computation, statistical analysis, and machine learning workflows.
- Solid understanding of machine learning fundamentals, including supervised and unsupervised learning, model optimisation, feature engineering, training methodologies, evaluation metrics, and experiment design.
- Experience designing, implementing, and evaluating machine learning experiments, including data preparation, model selection, hyperparameter tuning, performance analysis, and reproducibility.
- Knowledge of scientific computing concepts, numerical methods, computational modelling, and scientific simulation is highly desirable.
- Ability to analyse complex technical problems, identify implementation errors, validate computational results, and develop efficient, well-documented solutions.
- Familiarity with research methodologies, benchmarking practices, reproducible experimentation, and the interpretation of technical and scientific results.
- Publications in recognised research venues, meaningful open-source contributions, or experience developing and deploying production-grade machine learning systems will be a strong advantage.
- Demonstrable career progression through increasing technical responsibility, research contributions, or ownership of machine learning and scientific computing projects.
- Ability to commit reliably to at least 20 hours per week during weekdays.
- Excellent written communication skills, with the ability to explain complex technical concepts, computational approaches, research findings, and engineering decisions clearly.
Similar roles
-
Senior Machine Learning Engineer
Euromonitor Vilnius, Vilnius County, Lithuania · €60K–€90K/yr
-
Machine Learning Engineer
RZR Global Inc. San Francisco, California, United States
-
Data Engineer (Machine Learning & Data Platform)
CodeLink Da Nang, Vietnam
-
Staff Machine Learning Engineer - Medical Devices
Jobgether Canada · CA$146K–CA$258K/yr
-
Machine Learning Engineer
Jobgether Italy
-
Associate Machine Learning Engineer
Manulife Toronto, Ontario, Canada · CA$70K–CA$116K/yr