SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Mercor is an AI data company building infrastructure between human expertise and frontier AI models. The company operates a platform where millions of domain experts train frontier AI models, and is expanding into enterprise with AI agent infrastructure for Fortune 500 companies. Mercor is a profitable Series C company valued at $10 billion.
As Product Manager for the Model Gateway, you will own Mercor's LLM gateway—the shared infrastructure layer that every product surface depends on to access frontier models reliably, affordably, and within policy. This is a high-leverage platform role where your decisions on priority queueing, cost attribution, rate limits, and model usage policy directly impact all downstream product teams.
Key responsibilities include:
- Own the LLM gateway end-to-end: set roadmap and policy for the shared routing layer, from priority queueing to cost attribution to model access
- Design priority and fairness logic: define queueing and rate-limiting that balances revenue-blocking traffic against background jobs with explicit, consistent tradeoffs
- Make costs visible and attributable: work backwards from business outcomes to inform product decisions that impact business health and growth
- Negotiate rate limits and usage policy: turn contention over shared capacity into clear, defensible rules teams can plan around
- Partner with infrastructure: translate product needs into platform requirements and platform constraints back into product tradeoffs
- Connect gateway decisions to business outcomes: prioritize based on impact to cost, reliability, and velocity
Your users are internal: product managers and engineers building on the platform, plus infrastructure and finance partners who care about reliability and spend. Success means product teams moving fast without contention, transparent and attributable model costs, and scalable usage policies.
You'll work in-person five days a week at the San Francisco office, alongside researchers, operators, and AI companies shaping frontier systems.
