JobCubby JobCubby
Sign up
B

Machine Learning Infrastructure Engineer

bareinsights San Francisco, California, United States · $200K–$400K/yr

7 h ago
machine-learning Senior (5-10 yrs) Full-time United States
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, deploy, and maintain large-scale distributed ML training and inference clusters. Build efficient, scalable end-to-end pipelines to manage petabyte-scale datasets across the full ML lifecycle.

What they look for

Machine Learning Infrastructure Distributed Training FSDP DeepSpeed GPU Optimization CUDA JAX Kubernetes Docker Cloud Platforms AWS GCP Azure Data Pipelines Observability Version Control

Requirements

Requires 2–10+ years of experience building ML infrastructure for foundation model training. Proficiency in distributed training frameworks and low-level GPU performance optimization is essential.

Full description

About the Role

This is an infrastructure engineering role at the core of building a large-scale physics foundation model — a novel class of AI designed to predict and influence physical systems. You'll sit at the intersection of ML systems engineering and cutting-edge research, directly enabling breakthroughs that go well beyond standard language or vision models.

What You'll Do

  • Design, deploy, and maintain large distributed ML training and inference clusters.
  • Build efficient, scalable end-to-end pipelines to manage petabyte-scale datasets across the full ML lifecycle.
  • Research and implement parallelization techniques and numerical precision trade-offs at varying model scales.
  • Profile and debug low-level GPU operations to squeeze out maximum performance.
  • Stay current with the latest research and bring new ideas directly into production work.

What We're Looking For

  • 2–10+ years of experience building ML infrastructure for core foundation model training (not just fine-tuning or deployment).
  • Deep expertise optimizing large-scale training and inference workloads.
  • Proficiency with distributed training frameworks such as FSDP or DeepSpeed.
  • Hands-on experience across the ML lifecycle — data preparation, training, evaluation, and optimization.
  • Background working in science or physical AI domains (e.g., autonomous vehicles, robotics, computational biology, or similar).
  • Familiarity with cloud platforms (GCP, AWS, or Azure) and their ML/AI service offerings.
  • Experience with containerization and orchestration tools such as Kubernetes and Docker.
  • Knowledge of monitoring, logging, observability, and version control best practices for ML systems.
  • Low-level GPU performance optimization experience (CUDA, JAX) is a strong plus.
  • Comfort thriving in a fast-paced, demanding engineering culture.

Compensation & Benefits

Salary range: $200,000 – $400,000 USD annually. Visa sponsorship is not available.

Location

On-site, 5 days per week in San Francisco, CA.

Similar roles