External Safety Testing Manager, Responsible Development and Innovation, DeepMind

As an External Safety Testing Manager in the Responsible Development and Innovation (ReDI) team, you’ll be integral to the delivery and scaling of our external safety partnerships and evaluations on DeepMind’s most groundbreaking models.

You will work with teams across Google and DeepMind, including Product Management, Research, Legal, Engineering, Public Policy, Trust and Safety (T&S), and Frontier Safety and Governance, to deliver external safety evaluations which are a key part of our responsibility and safety best practices, helping DeepMind to progress towards its mission.

Artificial intelligence will be one of humanity’s most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority.

Responsibilities

• Lead frontier safety post deployment testing strategy and execution.
• Lead efforts to optimize and scale the post deployment program to support novel risk and capability areas and changing external requirements, including identifying new partners with relevant skillsets.
• Lead engagement with various external testing partners and internal teams to execute the end-to-end testing process.
• Lead engagement with internal SMEs to assess the severity of findings and clearly communicate it to leadership, domain experts, governance, and modeling teams to inform internal risk assessments and mitigations.
• Work with legal and partnerships on contracting for new external testing partners.

Minimum qualifications:

• 8 years of experience working in either in a start-up, tech company, or consulting organization.
• Experience working with AI or in an AI lab/startup environment.

Preferred qualifications:

• Experience designing and implementing testing and evaluations of cutting edge AI systems.
• Demonstrated excellent communication skills and ability to work in cross-functional teams, foster collaboration, and influence outcomes.
• Demonstrated project management skills to optimize existing processes and create new processes.
• Subject matter expertise in generative AI safety considerations, including (but not limited to) frontier safety, such as chemical, biological, radiological, nuclear, cyber, harmful manipulation and alignment risks.