SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Exa is an applied AI lab building a next-generation search engine powered by massive-scale infrastructure, state-of-the-art embedding models, and high-performance vector databases. The company powers search for Cursor, Cognition, HubSpot, and over 400,000 developers, with $350M in funding from Lightspeed, Benchmark, and a16z.
The Evals Team sits at the core of Exa's mission to build perfect search over all the world's information. This team trains foundational models for search and measures what "good search" actually means through comprehensive evaluation datasets.
As Product Manager on the Evals team, you will partner with research, product, GTM, and engineering to oversee the quality and completeness of evaluation data. Key responsibilities include:
- Ensuring search models are evaluated against comprehensive, high-quality datasets across numerous domains
- Managing relationships with external vendors and data providers
- Making strategic decisions on what data is important for evaluations and acquiring it
- Building specific, localized eval feedback and signal
- Defining metrics and success criteria for evaluation data suites
- Partnering closely with ML researchers, data engineers, infrastructure engineers, and product teams to shape data loops that improve search models
- Contributing to defining what perfect search means for the organization
Your work will directly impact Exa's mission of creating a perfect information society.
REQUIREMENTS:
- Strong negotiation and vendor relationship management skills
- Excellent written communication (human-written, not AI-generated)
- High ownership and attention to detail
- Strong numerical literacy and technical background
- CS/EE degree, production engineering experience, or equivalent depth earned on the job
The role is in-person in San Francisco. Exa sponsors visas for international candidates (STEM OPT, OPT, H1B, O1, E3).
