SlipstreamJobsFresh Startup & VC-Backed Jobs

Senior AI Product Manager, Leaderboard

Scale - New York, NY, United States - Hybrid - posted 2026-08-04

Apply on the company site

SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.

Scale is seeking a Senior Product Manager to own and scale the SEAL Leaderboard portfolio—a suite of AI evaluation products, benchmarks, and public/private leaderboards that influence model development and purchasing decisions across the AI ecosystem. In this role, you will define strategy, roadmap, and operational excellence for Scale's evaluation products. You'll work cross-functionally with AI Product Management, ML Researchers, Engineering, Operations, and Go-To-Market teams to transform cutting-edge model evaluations into trusted industry benchmarks. Key responsibilities include: - Owning the roadmap and strategy for the SEAL Leaderboard portfolio, prioritizing benchmark development, leaderboard launches, infrastructure, and product expansion - Facilitating the Leaderboard Steering Committee and driving alignment across AI-PM, ML, Engineering, Operations, and GTM - Evaluating and operationalizing new leaderboard proposals aligned with customer demand, market opportunities, and company strategy - Managing the end-to-end leaderboard product lifecycle from ideation through launch, growth, maintenance, and sunset - Partnering with ML researchers to develop trustworthy evaluation methodologies and benchmark specifications - Driving infrastructure roadmap improvements to enhance scalability and accelerate benchmark releases - Establishing governance processes for benchmark quality, evaluation integrity, and release management - Engaging directly with frontier AI labs and enterprise customers to understand evaluation needs and gather feedback - Tracking adoption, usage, and business outcomes to guide roadmap decisions - Identifying new evaluation categories and leaderboard products that create revenue opportunities - Supporting GTM teams on customer engagements, thought leadership, and strategic partnerships Ideal candidates bring 5+ years in product management, technical program management, consulting, or customer-facing technical roles. Strong technical fluency with machine learning systems, AI model evaluation, and benchmarking is essential. Experience building products requiring cross-functional coordination, excellent stakeholder management, and strong analytical skills are critical. Experience with AI researchers, ML teams, or evaluation frameworks is strongly preferred. You should have an entrepreneurial mindset, comfort in ambiguous environments, and passion for advancing trustworthy AI evaluation and industry standards.

Similar roles