Research Engineer, Privacy Evals - Meta Superintelligence Labs

Meta is seeking Research Engineers to join the Data & Privacy Research team within Meta Superintelligence Labs. This team studies, evaluates and aligns Meta's frontier AI model and systems, with a focus on memorization & privacy risks. We ensure that our frontier models and agents operate and behave within users' privacy and Meta's privacy expectations by rigorously measuring and mitigating across the entire frontier model development lifecycle - pre-training data curation to post-training alignment. As a Research Engineer on this team, you will work alongside AI researchers to develop new evaluations grounded in real-world threat models, maintain existing evaluations so they remain current and reliable, and produce written artifacts that Meta can trust during high-stakes launches. This is a highly technical role requiring the ability to deeply understand frontier LLM behavior, hypothesize and design true and grounded risk vectors and turn them into automated evaluations with high scalability and reliability. The evaluations you build will directly inform risk assessments and launch decisions within Meta Superintelligence Labs, making engineering reliability, rigor, and scalability paramount. You will succeed by delivering iteratively while re-prioritizing work based on evolving research needs and launch timelines as we advance the technical research frontier. The evaluations you produce will significantly influence pre-training data mixes, model behavior during post-training and will be read and acted upon by Meta's leadership during model launches and policy reviews.

Responsibilities

• Build and continuously refine evaluations for multimodal and agentic frontier AI models across pretraining and post-training
• Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
• Produce auditable technical artifacts, including evaluation reports and model cards, at high reliability and speed
• Scope and deliver end-to-end evaluations under ambiguous and rapidly shifting requirements, re-prioritizing as the threat landscape and Meta’s frontier models evolve
• Work across research, engineering, policy, and legal teams to align evaluation priorities with launch timelines

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 1+ years of experience in ML engineering, LLM research, or a related technical role
• Background in one or multiple of privacy-preserving LLM development, memorization, pretraining data curation and post-training alignment
• Proficiency in Python and experience with machine learning frameworks
• Experience scoping, designing, and delivering medium-to-large technical projects with minimal direction, defining milestones and coordinating dependencies
• Proven experience in software engineering practices, including version control, testing, and code review practices Experience working with large-scale distributed systems and data pipelines
• Experience in implementing or developing benchmarks for large language models and multimodal models (e.g., vision-language, audio, video, browser agents)
• Experience in red-teaming AI systems, adversarial machine learning, or abuse prevention systems
• Publications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, AI safety, or deep learning
• PhD or Master's degree in Computer Science or relevant technical field, or equivalent practical experience with a focus on privacy and/or safety domains