Clera

Lead Research Engineer, Data Quality

Clera United States · $130K–$225K/yr

Technology, Information and Internet · 11-50 employees

4 d ago
Senior (5-10 yrs) Full-time Visa sponsorship United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will lead a team to build systems for evaluating AI training data and define quality-control strategies across various environments. Additionally, you will translate research findings into production tools and pipelines while collaborating with domain experts to improve data generation.

What they look for

Python Docker Linux AI evaluation Machine learning Data quality Reinforcement learning Synthetic data validation Failure-mode analysis Task mutation Trajectory auditing Data generation Technical leadership System architecture Experiment design Mentorship

Requirements

Candidates must have at least 5 years of experience in AI or machine learning data evaluation and systems engineering. Proficiency in Python, Docker, and Linux is required, along with a strong background in AI benchmarks and synthetic data validation.

Benefits

Visa sponsorship

Full description

About the Role

Lead the research engineering work focused on measuring and improving training data for AI agents. You will shape the strategy and systems used to evaluate data across reinforcement learning environments, synthetic datasets, benchmarks, and domain-specific workflows.

What You'll Do

  • Lead a team building systems to evaluate large volumes of tasks across environments, datasets, benchmarks, and specialized workflows.
  • Define data quality strategy by creating quality-control systems, setting standards, and designing experiments to assess agent outputs.
  • Develop scalable approaches to validate synthetic data, including failure-mode analysis, task mutation checks, and trajectory auditing.
  • Work with research engineers, domain experts, and data vendors to diagnose quality problems and improve data generation.
  • Turn research findings into production tools, dashboards, validation pipelines, and feedback loops.
  • Help establish rigorous standards for assessing whether agent training data is useful, and mentor research engineers.

What We're Looking For

  • At least 5 years of research or engineering experience building AI or machine learning data evaluation and quality systems.
  • Experience leading technical teams or projects from problem definition through implementation and iteration.
  • Advanced proficiency in Python, Docker, and Linux environments.
  • Strong background in AI evaluations, post-training, synthetic data validation, benchmarks, or related evaluation infrastructure.
  • Sound judgment about what makes training tasks realistic, learnable, diverse, reliable, and useful.
  • Experience translating research insights into production systems and pipelines, and designing metrics, experiments, and quality processes.
  • Ability to work with subject-matter experts to turn domain judgment into scalable review or data generation systems.
  • Clear written communication, careful attention to detail, and experience in an early-stage startup environment.

Compensation & Benefits

Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.

Location

On-site in the United States.