SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Glean is a Work AI platform that powers intelligent search, AI assistants, and scalable AI agents for enterprise customers. The company has built an Enterprise Graph and Personal Knowledge Graph to deliver context-aware responses and automate work across teams. Glean is recognized as one of the world's most innovative companies and serves 1,000+ employees across 25+ countries.
As an AI Data Analyst, you will be central to ensuring the quality and reliability of Glean's AI product outputs. This role bridges QA, Engineering, Product, and the evaluation team to convert quality issues into structured, actionable data.
Key responsibilities include:
- Running ongoing human labeling for priority AI workflows, including response quality assessment, task success evaluation, and end-to-end workflow testing
- Triaging bad-query reports, downvotes, escalations, and routed quality issues to identify root causes
- Categorizing failure modes such as hallucinations, retrieval failures, tool-use issues, weak grounding, and workflow completion problems
- Performing qualitative analysis to identify recurring patterns and systemic issues
- Developing and improving labeling guidelines and rubrics to ensure consistency and realism
- Maintaining high-quality benchmark datasets that drive measurable product quality improvements
- Collaborating cross-functionally to translate ambiguous quality concerns into repeatable quality signals
You will work with real customer scenarios and competitive benchmarks, helping shape release readiness and product direction through data-driven insights.
