JobCubby JobCubby
Sign up
Gramian Consulting Group

Physics & Python Specialist

Gramian Consulting Group Turkey

IT Services and IT Consulting · 2-10 employees

8 h ago
Remote python Mid (2-5 yrs) Contractor Turkey
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and implement complex scientific coding tasks in Python, including verified solutions and unit tests. Ensure scientific accuracy and optimize tasks to meet evaluation criteria for various LLM judges.

What they look for

Physics Python Scientific Computing NumPy SciPy SymPy AI Evaluation LLM Benchmarking Unit Testing Data Annotation Scientific Writing Problem Solving STEM Quality Control

Requirements

Requires a Master's degree or PhD in Physics with strong Python programming skills in scientific computing. Candidates should have experience in AI data annotation, scientific research, or coding benchmarks.

Full description

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are looking for a physics-focused professional to contribute to an advanced AI research initiative developing rigorous scientific coding tasks. The role combines physics expertise, Python-based scientific computing, and AI evaluation, requiring you to design complex scientific problems, implement verified solutions, and develop tests that assess the accuracy of AI-generated outputs. You will work on ensuring scientific correctness, determinism, and evaluation quality across structured STEM training tasks.

Responsibilities

Design scientific coding tasks consisting of one main physics problem and at least 3 logically connected sub-problems.

Implement verified golden solutions in Python with complete unit test coverage.

Develop discriminative test cases that distinguish correct from incorrect AI-generated outputs.

Perform quality control checks using the Turing Central Task Platform (CTP), including Tier 1 structure checks and Tier 2 quality rubrics.

Revise scientific tasks and solutions based on QC feedback.

Optimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and Nemotron.

Validate scientific correctness, well-posedness, determinism, and expected outputs.

Maintain high first-submission quality and minimize rework.

Participate in reviews, feedback sessions, and project standups during required overlap hours.

CONTRACT: Freelance / Contractor, short-term (8 weeks)

COMMITMENT: 40 hours per week, including 4 hours of overlap with PST working hours

LOCATIONS: Remote — Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Kenya, Nigeria, Pakistan, Turkey, or Vietnam

PROCESS: Not specified

  • Master's degree or PhD in Physics.
  • Strong Python programming skills with experience in scientific computing.
  • Experience with scientific Python libraries such as NumPy, SciPy, SymPy, or relevant domain-specific tools.
  • Ability to formulate rigorous physics problems with clear constraints and expected outputs.
  • Experience implementing scientific solutions with unit tests and deterministic outputs.
  • Prior experience in AI data annotation, scientific research, or scientific writing.
  • Familiarity with LLM evaluation frameworks or coding benchmarks.
  • Published research or academic project experience in physics or another STEM discipline.

Similar roles