SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Intelligence is a product lab company building frontier AI evaluation platforms. The company operates DesignArena (5.5M+ users in 8 months), a benchmark for AI-generated visuals referenced by Andrew Ng, Elon Musk, and Demis Hassabis. Intelligence is trusted by frontier model providers like OpenAI to rigorously evaluate state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, and slide generation.
As a Member of Technical Staff in Frontier Evals, you will define how frontier AI models are measured. You'll design new benchmarks, run experiments, analyze model behavior, and build evaluation methodologies that become trusted signals for the industry. Your work will shape public leaderboards and evaluation tools shared with frontier labs.
Key responsibilities include:
- Design genuinely hard and useful evaluations that measure frontier model performance on real-world tasks, becoming industry-leading gold standards
- Investigate model failures and identify what they reveal about emerging capabilities
- Publish research, technical reports, and analyses that shape how frontier models are evaluated
- Work on projects tracked by industry leaders including Elon Musk, Mark Zuckerberg, Demis Hassabis, and Andrew Ng
The company is backed by Tier 1 investors including Index Ventures, Y Combinator, SV Angel, and Figma Ventures. The team is talent-dense with 11 members from Harvard and Berkeley, and the company is one of the fastest-growing seed-stage startups in San Francisco.
Location: San Francisco, Levi's Plaza. The company sponsors visas and handles relocation. Work schedule is Sunday-Friday, with Saturdays off.
Requirements:
- Strong STEM background: Computer Science, Data Science, Statistics, Math, Engineering, Physics, or related field
- Deep curiosity about frontier AI models and understanding of model behavior
- Excitement about discovering areas of failure and building better evaluation methodologies
- Genuine intellectual drive to be on the frontier of AI development
- Willingness to roll up your sleeves and do hands-on work
