AI Content Specialist (Mathematics & Python)
Gramian Consulting Group Nigeria
IT Services and IT Consulting · 2-10 employees
About the role
The role involves creating rigorous mathematical problems and implementing verified Python solutions to support advanced AI research. You will also develop discriminative test cases and perform quality control to ensure AI models meet high standards of accuracy and determinism.
What they look for
Requirements
Candidates must hold a Master's degree or PhD in Mathematics and possess strong Python programming skills, particularly with scientific libraries. Prior experience in AI data annotation, scientific research, or coding benchmarks is required.
Full description
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are seeking a mathematics-focused professional to support an advanced AI research initiative developing high-quality STEM coding datasets. In this role, you will create rigorous mathematical problems, implement verified Python solutions, and develop evaluation tests designed to assess the capabilities of frontier AI models. The position combines mathematical problem-solving, scientific programming, and AI quality evaluation, with a strong emphasis on accuracy, determinism, and first-submission quality.
CONTRACT: Contractor assignment, 4 weeks
COMMITMENT: Hourly, up to 40h/week
LOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam
PROCESS: Interest Check Form, CV and Google Scholar review
Key Responsibilities
- Author mathematical coding tasks containing one main problem and at least 3 logically connected sub-problems that progressively build toward the main solution.
- Implement verified golden solutions in Python with complete unit test coverage.
- Design discriminative test cases that distinguish correct from incorrect AI-generated outputs.
- Perform quality control validation using the Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics.
- Refine problem specifications, solutions, and test cases based on QC feedback.
- Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron.
- Ensure mathematical correctness, well-posedness, determinism, and compliance with project quality standards.
- Maintain high first-submission quality and minimize rework, targeting consistent L1 approval.
- Participate in review sessions, feedback meetings, and project standups during required overlap hours.
- Master's degree or PhD in Mathematics.
- Strong Python programming skills with experience in scientific computing.
- Experience using scientific Python libraries such as NumPy, SciPy, SymPy, or relevant domain-specific tools.
- Ability to formulate rigorous mathematical problems with clear constraints and expected outputs.
- Experience implementing scientific or mathematical solutions with unit tests and deterministic outputs.
- Prior experience in AI data annotation, scientific research, or scientific writing.
- Familiarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessment.
- Published research or academic project experience in mathematics or another STEM discipline.
•
Similar roles
-
Python Pyspark Developer
Unison Group Singapore, Singapore
-
Python Developer - Digital Forensics
The Mitre Corporation McLean, Virginia, United States · $159K–$238K/yr
-
Software Engineer Python Sr
Softtek Madrid, Community of Madrid, Spain
-
Full-stack Engineer 4 (Java, Python, AWS) (Enterprise Platforms Technology)
Capital One McLean, Virginia, United States · $197K–$225K/yr
-
Data & AI Engineer — AWS, Java & Python
Incentivio Mansfield, Pennsylvania, United States
-
Full-stack Engineer 4 (Java, Python, AWS, Spark)
Capital One Richmond, Virginia, United States · $179K–$205K/yr