Software Engineer, Model Routing & Inference

Careers

Software Engineer, Model Routing & Inference

Engineering · Full-time · New York, San Francisco

Apply

Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense. We particularly like people who are truth-seeking, passionate, and creative. We enjoy spirited debate, crazy ideas, and shipping code.

About the Role

As a Software Engineer on the Model Routing & Inference team at Cursor, youll build the inference platform that powers every AI interaction in the product.

This team owns the full inference path: making Cursors AI faster, more reliable, and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion, and every chat message flows through your stack.

Example projects include...

• Building and evolving our inference gateway, a single abstraction over every providers API semantics, so model onboarding becomes a config change.

• Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.

• Designing routing backpressure and admission control so traffic spikes dont cascade into providers.

You may be a fit if

• You have deep experience building high-throughput, low-latency distributed systems, especially in inference serving, traffic routing, or real-time data pipelines.

• Youre comfortable reasoning about cost/performance tradeoffs at scale (GPU utilization, provider economics, capacity planning).

• You have strong software engineering fundamentals and enjoy shipping production systems that handle millions of requests.

• You make good calls in the gray area: weighing reliability, cost, latency, and user experience when there isnt a single "right" answer.

Applying

If there appears to be a fit, well reach to schedule 2-3 short technicals. After, well schedule an onsite in our office, where youll work on a small project, discuss ideas, and meet the team.

#LI-DNI

Apply for this role

Name*

Email*

Resume

Upload file

LinkedIn URL

GitHub Profile

Please write a short note on a project youre proud of:

Will you now or in the future require visa sponsorship to work in the country where this position is located?*

Has someone at Cursor referred you for this role? If so, please include their email here

Submit application