Software Engineer, AI Gateway
at Vercel
Location
Remote - United States
Compensation
$196k–$294k USD
Type
full time
Posted
8 months ago
Remote
Yes
Market range · company + function + seniority
p25 · target · p75 · n=23
Posted $294k · in the market band
Posting health
Aging · 65- ·Open 253 days
Tailor your résumé to this role in 30 seconds.
Free account · ATS keyword check · per-job bullet rewrite by Claude.
Job description
About Vercel:
Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.
Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.
About the role
What you'll do
- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
- Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.
What you need
- 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
- Experience contributing to or participating in open source projects
- Excellent communication skills and the ability to work effectively in a collaborative team environment
Benefits & Compensation:
- Competitive compensation package, including equity.
- Inclusive Healthcare Package.
- Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
- Flexible Time Off.
- We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
#LI-KR1
Disclosures:
- Privacy: Please review our Job Applicant Privacy Policy for more information on how we handle your data.
- Equal Opportunity: Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.
More open roles at Vercel
Hiring velocity, headcount trend, and every open posting on one page.
Similar roles
Open postings ranked by description similarity — useful if this role isn't quite right.
- Senior Systems Engineer, AI Gateway78% matchCloudflare· Austin, TX; San Francisco, CA· $194k–$266k USD
- Staff Software Engineer, AI Tooling72% matchVast Space· Long Beach, California, United States· $160k–$268k USD
- Staff Software Engineer, Inference API72% matchCerebras Systems· Sunnyvale, CA; Toronto, CAN
- Chief SW Engineer71% matchVisa· US - Foster City, CA· $231k–$369k USD
- Platform Engineer - AI Engineering71% matchDRW· Chicago· $130k–$190k USD
- Software Engineer, AI & Security71% matchGlean· Mountain View, CA· $140k–$265k USD