Jobgether

Data Scientist Talent Network

Jobgether India · $208K–$312K/yr

Internet Marketplace Platforms · 11-50 employees

7 h ago
Remote data-scientist Mid (2-5 yrs) Contractor India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design precise grading criteria for data science deliverables and evaluate AI-generated work for technical quality, accuracy, and rigor. Provide detailed, evidence-based assessments to improve the performance and reliability of AI-generated analytical outputs.

What they look for

Python SQL Statistical modeling Machine learning A/B testing Data analysis Experiment design Model validation Technical writing Critical thinking Data quality assessment AI model evaluation Benchmarking Data labeling Reproducibility

Requirements

Requires at least one year of professional data science experience with hands-on exposure to real-world analytical or machine learning projects. Candidates must possess a strong command of Python and SQL, along with deep knowledge of statistical modeling and experimentation methodologies.

Benefits

Competitive contract compensation Fully remote opportunity Flexible working environment Professional development in AI systems Collaboration with senior reviewers

Full description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Scientist Talent Network based in India.

This contract opportunity is designed for data science professionals who want to apply their technical expertise to the evaluation and improvement of advanced AI systems. You will assess complex data science deliverables, including exploratory analyses, statistical models, machine learning pipelines, and experimentation results. The role requires strong technical judgment and the ability to distinguish rigorous, reliable analysis from flawed or incomplete work. You will create precise evaluation criteria and provide detailed, evidence-based assessments that can be applied consistently across different assignments. Your feedback will help improve the quality, reliability, and performance of AI-generated data science outputs. Working remotely and asynchronously, you will collaborate with senior reviewers while contributing your real-world expertise to innovative AI evaluation projects.

\n

Accountabilities:

  • Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling, machine learning pipelines, and A/B test analyses.
  • Evaluate AI-generated and human-created data science work against established criteria to assess technical quality, accuracy, rigor, and consistency.
  • Review analytical approaches, statistical assumptions, modeling methodologies, experiment design, and interpretation of results.
  • Assess Python and SQL-based work for correctness, efficiency, reproducibility, and appropriate application to the underlying business or analytical problem.
  • Provide detailed written justifications for evaluations and scores to ensure transparency, accountability, and reproducibility.
  • Apply consistent, objective, and evidence-based judgment when evaluating complex technical work.
  • Identify methodological weaknesses, data issues, incorrect assumptions, statistical errors, and opportunities for improvement.
  • Assess machine learning workflows for appropriate model selection, validation, performance evaluation, and interpretation.
  • Incorporate structured feedback from senior reviewers and iterate on submitted evaluations to continuously improve quality.
  • Work independently and asynchronously while meeting deadlines and maintaining high standards of technical accuracy.

Requirements:

  • 1+ year of professional data science experience with hands-on exposure to real-world analytical or machine learning projects.
  • Experience working at a leading technology, research, quantitative, or data-driven organization is preferred.
  • Strong command of Python and SQL, with practical experience in data analysis and manipulation.
  • Strong knowledge of statistical modeling, machine learning, experimentation, and A/B testing methodologies.
  • Ability to evaluate exploratory data analyses, statistical models, machine learning pipelines, and experimental results critically and objectively.
  • Strong understanding of data quality, statistical assumptions, model validation, experiment design, and analytical best practices.
  • Exceptional written communication skills, with the ability to clearly explain technical reasoning, findings, and evaluation decisions.
  • Strong analytical and critical-thinking skills, with excellent attention to detail.
  • Consistent and methodical approach to evaluating complex technical work.
  • Comfortable receiving structured feedback and calibrating professional judgment against established evaluation standards.
  • Ability to work independently in a remote, asynchronous environment while managing priorities and meeting deadlines.
  • Experience with AI model evaluation, data labeling, benchmarking, human-data projects, or AI training is a plus.

Benefits:

  • Competitive contract compensation: $100–$150 per hour.
  • Fully remote opportunity, offering flexibility to work from your preferred location in India.
  • Flexible, asynchronous working environment designed for experienced data science professionals.
  • Opportunity to apply data science expertise to the development and evaluation of advanced AI systems.
  • Direct contribution to improving the accuracy, reliability, and capabilities of AI-generated analytical work.
  • Exposure to projects involving machine learning, statistical modeling, experimentation, and AI model evaluation.
  • Opportunity to collaborate with senior reviewers and participate in structured technical calibration.
  • Flexible contract engagement that allows you to contribute your expertise to impactful AI projects.

\nHow Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Similar roles