SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Arena is a platform for evaluating how AI models perform in real-world scenarios, founded by researchers from UC Berkeley's SkyLab. Tens of millions of people use Arena monthly to evaluate frontier AI systems, and leading AI labs, enterprises, and independent researchers rely on Arena's transparent, rigorous evaluations and open datasets.
You will be a Member of Product Staff—a general manager and owner of a major product pillar. This is a highly cross-functional role where you identify what to build, develop conviction, ship with engineering and research teams, and drive measurable outcomes. You stay close to users, close to data, and close to code. You write PRDs, query databases yourself, and remain engaged with products after launch until they achieve their goals.
Arena's product surface is unusually broad: a consumer product used by tens of millions monthly, an API and enterprise offering relied upon by leading labs and enterprises, and the evaluation methodology and leaderboard underlying everything. Depending on your background, you'll focus on one of three areas:
**Enterprise & API**: Own the API and enterprise product surface. Partner directly with customers to integrate models, run evaluations, and deliver results. Translate customer feedback into product and engineering initiatives. Own packaging and monetization so every new product ships instrumented, billable, and correctly represented in systems.
**Evaluation**: Own products that turn human preference into trustworthy evaluation—the leaderboard, methodology, and tools model developers use. Partner with research to develop new metrics, methodologies, and evaluation protocols beyond traditional benchmarks. Disentangle performance factors like style, reasoning, and robustness. Protect scientific integrity and transparency of the Arena leaderboard.
**Growth**: Own how tens of millions discover, use, and return to Arena. Run experiments and partner with design and marketing engineering to turn insights about highest-expectation users into products they can't stop using.
Key responsibilities include: owning product areas end-to-end from opportunity identification through measurable outcomes; shipping and iterating with measurement and course-correction; working with ML researchers to turn research into product; developing deep understanding of consumers, labs, enterprises, and researchers; monitoring user feedback and analytics to identify trends; writing PRDs and specs that align teams; making high-stakes decisions under uncertainty; and raising the product quality bar on the team.
**Requirements:**
- 5-10+ years of product management experience on consumer, developer, or enterprise products, ideally including 0-to-1 work at an early-stage company
- Track record of repeated, attributable impact across multiple projects with quantifiable outcomes (revenue, engagement, efficiency) that sustained after you moved on
- Strong product judgment, taste, and autonomous ownership; demonstrated ability to identify opportunities, validate with evidence, build buy-in, ship, and have bets pay off
- Experience killing important projects for product betterment
- Clear, persuasive communication skills; ability to build buy-in across engineering, research, design, and leadership
- Technical depth to work directly with engineers and researchers
- Genuine conviction about AI evaluation and Arena's mission
- Comfort with ambiguity in a startup environment
**Bonus qualifications:**
- Production experience with AI/LLM systems (inference pipelines, evaluation workflows, model integration, AI-powered features)
- Experience with developer- or enterprise-facing products and fluency in consumption or usage-based revenue models
- Comfort with real-world usage data and designing metrics beyond standard benchmarks, including statistically rigorous experiments
- Experience growing consumer or developer products at scale with hands-on ownership of experimentation and analytics
- Demonstrated ability to raise team bar with measurable before/after impact through introduced practices, tools, or standards
