SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Patronus AI is a frontier AI research lab developing simulation infrastructure and evaluation tools to advance progress toward human-aligned AGI. The company is behind influential research in AI evaluation including FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, and Humanity's Last Exam. Founded by former researchers from Meta AI, Amazon AGI, and Google, the company serves foundation model labs and Fortune 500 enterprises like Adobe, backed by investors including Lightspeed Venture Partners and Stanford University.
As Expert Operations Manager, you will own the complete lifecycle of subject matter experts who define and judge AI agent performance in simulation environments. This highly autonomous role requires managing every stage from identifying expertise needs through sourcing, vetting, onboarding, engaging, and compensating experts across diverse professional domains.
Key responsibilities include: designing and continuously improving the expert vetting process; building sourcing strategies for senior and licensed professionals via registries, associations, alumni networks, and referral partners; partnering with research and delivery teams to match experts to projects; managing day-to-day expert engagements including work assignment, quality review, and payment approval; owning quality and incentive systems including scoring rubrics and peer review; tracking funnel metrics (conversion, time in stage, cost per expert, retention); and systematizing recurring operations into repeatable processes and tooling.
Your work directly impacts how quickly Patronus can establish credible evaluation environments in new domains and leverage global professional expertise for frontier AI model assessment.
Required: Bachelor's degree in Business, Operations, Economics, Engineering, or related field (or equivalent experience); 4+ years in expert networks, AI data/evaluation companies, marketplace operations, talent operations, or professional services resourcing with ownership of both throughput and quality; proven track record of building and scaling expert communities or talent pipelines; strong project management and cross-functional collaboration skills.
