Software Engineer III, Full Stack, Evaluations/Data Tooling

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The H2O Agents & Integrations Quality team (or HAIQu) has a core belief that quality and reliability are critical to customer satisfaction. It accelerates teams across H2O in collecting product quality signals, understanding quality headroom, identifying underlying root causes, and tracking quality trends.

The Tooling pod of the HAIQu organization, is responsible for building data management and evaluations platforms for AI-enabled products across Home and Health, including but not limited to: Voice Assistant in Smart Speakers/Displays, Perception Intelligence in Cameras, and Personal Health Agents. We build data tooling and human labeling tools used to manage evaluation datasets and ground-truth data for research and product development. The team's mission is to develop foundational tooling platforms that are shared across the Home and Health products.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $147000 - $211000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities

• Write product or system development code.
• Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
  
• Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  
• Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
  
• Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
  

Minimum qualifications:

• Bachelor’s degree or equivalent practical experience.
  
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
  
• 2 years of experience with full stack development, across back-end such as Python, Java or C++ codebases, and front-end experience including JavaScript and TypeScript.

Preferred qualifications:

• Master's degree or PhD in Computer Science or related technical fields.
  
• 2 years of experience with data structures and algorithms.
• Experience building tooling platforms, especially in the context of labeling, ratings, and evaluations.
• Experience with Natural Language Processing, Machine Learning, or Generative AI.