SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Arena is a platform for evaluating how AI models perform in real-world scenarios, founded by researchers from UC Berkeley's SkyLab. The company has built a transparent, human-centered evaluation system used by tens of millions monthly, powering insights for leading AI labs, enterprises, and independent researchers.
As a Member of Technical Staff - Data Science, you will explore and analyze large, complex datasets that power millions of AI evaluations weekly. You'll generate and test hypotheses about model behavior, identify causal relationships, and uncover insights that help understand how frontier AI systems perform in actual workflows—from agentic coding to creative generation to professional productivity.
Key responsibilities include: exploring datasets to uncover patterns, biases, and causal relationships in model behavior; formulating and validating hypotheses through rigorous experimental design; building reproducible analysis pipelines using Python, Pandas, NumPy, and Spark for large-scale data processing; partnering with ML researchers and engineers to design evaluation metrics and analyses across domains and tasks; developing causal reasoning frameworks and statistical methods to explain model behavior; and communicating insights clearly to both technical and non-technical stakeholders through blog posts and presentations.
You'll need 6+ years of experience in data science, ML analytics, or applied research, ideally in AI/ML or large-scale data environments. Strong proficiency in Python (Pandas, NumPy, Spark) is essential, along with expertise in statistical modeling, causal inference, and experimental design. Experience reasoning about data distributions, sample quality, and distribution shifts is critical. Bonus qualifications include background in AI model evaluation, experience with LLM outputs and embeddings, and A/B testing experience.
Arena is a team of researchers, academics, and builders from UC Berkeley, Google, Stanford, and DeepMind. The culture emphasizes seeking truth, moving fast, and valuing craftsmanship, curiosity, and impact over hierarchy. The company offers competitive compensation and equity, comprehensive health and wellness benefits, and the opportunity to work on cutting-edge AI with a mission-driven team.
