Director of Engineering, GPU Instances and Infrastructure

Google’s AI and Infrastructure (AI2) organization builds the technical foundation behind Google’s products as well as for Google Cloud’s compute and AI/ML offerings. We manage the underlying design elements, developer platforms, product components, and infrastructure at Google.

Google Compute Engine (GCE) is a cloud computing platform that empowers its users with a comprehensive suite of VM and Bare Metal instances for general compute, compute-optimized, memory-optimized, storage-optimized, and GPU/ TPU-accelerated workloads. GCE is one of Google Cloud Platform's (GCP) core services, and it is used by businesses of all sizes, from startups to enterprises running AI/ML, cloud native, and mission critical enterprise services. GCE is committed to driving cloud computing excellence for Google and the world. Our aim is to make it easier for developers to build, deploy, and manage scalable and cost-effective cloud applications. We work closely with hardware partners and Google’s engineering teams to harness the latest advancements in CPU (i.e. x86/ARM), Storage, Network, and GPU/TPU virtualization, all backed by security, reliability, and performance.

Additionally, we operate and maintain the infrastructure that provides public cloud infrastructure for customers to scale their operations. We deliver enterprise-grade cloud solutions that leverage Google’s technology to help companies operate more efficiently and adapt to changing needs, giving customers a foundation for the future.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $307,000-$427,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

• Lead the strategic direction for the GPU Instances and Infrastructure organization, aligning its goals with Google Cloud AI's overarching objectives and maximizing the impact of GPU acceleration across the company's initiatives.
• Collaborate with partner engineering teams within Product Areas, business teams, and across Google to integrate GPU acceleration into Google's systems and solutions, ensuring alignment with overarching goals and objectives.
• Oversee the development and delivery of GPU-accelerated products and solutions, including cross-stack systems that integrate GPU acceleration across different parts of the technology stack, including Frameworks, Data Management, Training, and Inference.
• Play a role in leveraging GPU acceleration for the training and inference of large language models, ensuring efficient and scalable performance for computationally demanding tasks.
• Work with internal and external partners to identify and adopt the latest innovations in GPU technology and chip-to-chip interconnects.

Minimum qualifications:

• Master's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
• 15 years of experience as an engineering leader.
• Experience in cloud computing, hardware acceleration, GPU infrastructure, computer architecture, and software engineering.
• Experience with technical innovation within cross-functional engineering environments.

Preferred qualifications:

• Experience in iterative development model.
• Experience working with a service mindset and delivering on complex engineering solutions.
• Experience leading and managing high-performing engineering teams in a fast-paced, demanding environment.
• Expertise in engaging with senior stakeholders and managing competing opinions and viewpoints.
• Expertise in collaborating with partners and customers to solve problems.

In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:

• Health, dental, vision, life, disability insurance
• Retirement Benefits: 401(k) with company match
• Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
• Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
• Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
• Baby Bonding Leave: 18 weeks
• Holidays: 13 paid days per year