Software Development Engineer III, Machine Learning Annapurna - System Integration

Do you want to build AI-powered tooling that keeps custom silicon running reliably at scale? In Annapurna Labs at Amazon Web Services (AWS), we sit at the intersection of software and hardware, designing the systems that detect failures, generate repair instructions, and automate qualification for Trainium products. As a Software Development Engineer III, you will lead the technical design and delivery of this tooling platform — combining generative AI techniques with deep hardware knowledge to solve problems that few teams in the industry encounter. With hardware complexity and scope expanding rapidly, this is a rare opportunity to shape how we bring the next generation of custom chips to operational stability.

Key job responsibilities
- Design and deliver generative AI-based tools that identify complex hardware failures, dynamically create repair instructions from hardware system designs, and automate the qualification framework for post-new-product-introduction hardware changes on Trainium systems.
- Own system design decisions across the tooling software stack, evaluating tradeoffs in scalability, maintainability, and performance while partnering with silicon design and operations teams on cross-functional technical discussions.
- Collaborate with hardware design and sustaining teams to align tooling updates with upcoming silicon changes, creating the right integration checkpoints to ensure successful delivery.
- Drive adoption of engineering best practices across the team through code reviews, design reviews, and mentorship — raising the quality bar and helping fellow engineers grow.
- Evaluate and refine generative AI model outputs used in the tooling platform, applying responsible AI practices to ensure accuracy and reliability at production scale.

A day in the life
You start your morning reviewing system health metrics for the tooling platform, then join a design review where a teammate walks through a new generative AI model for automated failure diagnosis on Trainium hardware. You ask probing questions that sharpen the approach. After lunch, you pair with an engineer to work through a tricky data-modeling problem, then shift to a cross-team sync with hardware design engineers to align on upcoming silicon changes that will require updates to your qualification automation. Later, you write a technical document outlining how the tooling will scale to support the next generation of Trainium products.

About the team
Our team within Annapurna Labs builds the AI-powered software tooling that ensures Trainium systems meet operational stability targets before handoff to sustaining teams. We work at the intersection of software and silicon alongside systems development engineers, software development engineers, and hardware engineers — a cross-functional mix that is rare even within AWS. As Annapurna Labs continues to expand its custom chip portfolio, we are investing in new generative AI capabilities and scaling our platform to keep pace. If you are excited about solving problems where software meets hardware at industry-leading scale, we would love to hear from you. - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, Cupertino - 193,300.00 - 261,500.00 USD annually
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually