Software Engineering Manager, AIML — LLM Inference Quality
Apple Seattle, Washington, United States
Computers and Electronics Manufacturing · 10,001+ employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Lead a team of engineers to ensure the quality, correctness, and stability of LLM inference in production environments. Define technical roadmaps, establish quality standards, and collaborate with cross-functional teams to validate large-scale AI infrastructure.
What they look for
Requirements
Requires 8+ years of experience in software or ML systems development and 3+ years of engineering management experience. Candidates must have a strong background in compiled languages and experience architecting evaluation strategies for distributed systems.
Full description
Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a hands-on engineering manager to lead the team that owns the Quality, correctness, consistency, and stability of LLM inference in production.
Your team builds the automation frameworks, evaluation methodology, and qualification strategy that give Apple confidence in every model, prompt, serving stack, and infrastructure change before it reaches users. This is the safety net that lets Apple ship frontier AI quickly — without sacrificing quality, safety, or trust. We are seeking a deeply experienced manager who stays close to the technology to drive both the technical roadmap and the delivery of a high-performing team.
Description
As a technical manager, you will lead a team of engineers spanning quality engineering, distributed systems, and applied ML evaluation. Your team qualifies LLM inference and output-correctness automation frameworks for large-scale AI data center deployment and platform validation — validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them.
You will stay close to architecture, design reviews, and trade-offs, and partner with ML engineers, inference/performance engineers, distributed systems teams, and platform teams across Cupertino, Seattle, and other sites. You will hire and grow engineers, shape the team's roadmap, define quality bars where none exist yet, and represent the team to senior leadership and partners. This role requires strong technical depth, exceptional people-management skills, and the ability to navigate ambiguity in a fast-paced environment — including the inherently non-deterministic, probabilistic nature of generative output.
Minimum Qualifications
8+ years of experience in software and/or ML systems development, or equivalent experience. 3+ years of engineering management experience, with a proven track record of delivering complex, large-scale projects across multiple teams or organizations. Experience architecting test, qualification, or evaluation strategy for large-scale distributed systems — ideally ML serving or inference platforms. Hands-on background in one or more compiled languages (C, C++, Objective-C, or Swift) and proficiency in a scripting language (e.g., Python). Self-directed: the ability to drive a strategy or project from a simple idea to production, setting clear priorities and consistently delivering on schedule with measurable outcomes. B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
Preferred Qualifications
Experience with machine learning and LLMs — common practical applications and frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks). Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software. Experience using AI/LLMs to improve testing itself — test-case generation, defect detection, or reducing manual QA effort. Experience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines. Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift. Experience validating agentic workflows — tool-use, function-calling, and multi-turn coherence. Track record of hiring, developing, and retaining strong engineers, and leading change across multiple sites.
Similar roles
-
Manufacturing Engineering Manager
Dodge Industrial Belton, South Carolina, United States
-
Engineering Manager, Applied AI, Cloud Support Intelligence
Google Sunnyvale, California, United States · $207K–$300K/yr
-
Engineering Manager - Major Roadways
The City of Fort Worth Weatherford, Texas, United States · $112K–$145K/yr
-
Software Engineering Manager
LawnStarter Peru · $120K–$140K/yr
-
Software Engineering Manager - 2D Engine
Roblox San Mateo, California, United States · $294K–$343K/yr
-
Engineering Manager, Games - Audience
The New York Times New York, New York, United States · $160K–$190K/yr