at Apple
Location
Cupertino, United States of America
Compensation
$181k–$318k USD
Type
full time
Posted
1 weeks ago
Market range · company + function + seniority
p25 · target · p75 · n=626
Posted $318k · in the market band
Tailor your résumé to this role in 30 seconds.
Free account · ATS keyword check · per-job bullet rewrite by Claude.
As a foundation model evaluation Machine Learning Engineer, you will be entrusted with ensuring that foundation model performance can be measured quickly and reliably, in order to support crucial model shipping decisions. You will design, implement, and maintain crucial evaluation infrastructure.
You will collaborate extensively with ML researchers on both model hillclimbing and developing novel methodologies for measuring model performance.
Your responsibilities will span a number of high-impact parts of the Apple product and foundation model lifecycle.
Responsibilities
Ensure the stability, reliability, and performance of Apple's foundation model evaluation system.
Design and implement novel evaluation methodologies.
Help design and implement tooling to simplify metrics generation, ingestion, and reporting.
Leverage agentic LLM systems to facilitate and improve model evaluations.
5+ years of hands on ML engineering experiences, with at least 1+ years working directly on large language models or generative AI.
Bachelor’s, Master’s, or PhD in Computer Science, Machine Learning, or a related technical field — or equivalent practical experience.
Strong software engineering fundamentals: debugging, testing, code reviews, and production reliability / scalability.
Hands-on experience with LLM training and / or evaluation workflows, including any of the following: pre-training, post-training, online evaluation, offline evaluation, automated evaluation, human evaluation.
Hands on experience with evaluating large language models at scale or designing large language model benchmarks.
Strong communication skills, able to clearly and concisely convey important information.
Self-motivated and curious. Strive to continually learn on the job.
High level of creative and critical thinking skills with an innate drive to improve how things work. Have a high tolerance for ambiguity and the ability to identify the most important problems to solve.
We are looking for talented machine learning engineers who are excited to tackle some of the most meaningful and technically challenging problems in building and deploying foundation model–based products for our customers.
As a Machine Learning Engineer focused on foundation model evaluation, you will play a critical role in assessing the capabilities of the models that power Apple Intelligence features.
You will work closely with machine learning researchers to translate evaluation insights into actionable improvements that advance future model performance.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant
At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants
Apple accepts applications to this posting on an ongoing basis.
More open roles at Apple
Hiring velocity, headcount trend, and every open posting on one page.
Open postings ranked by description similarity — useful if this role isn't quite right.