SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Mistral is a full-stack AI company providing frontier models, developer tools, applications, and compute infrastructure. They partner with enterprises across finance, manufacturing, defense, healthcare, and the public sector to build customized AI systems.
As a Code Data Annotation Quality Specialist on the Human Data Annotation team, you will ensure the quality of code annotations and maintain tools supporting annotators. This dual role focuses on upholding the highest standards for data used in training and evaluating AI models while improving annotator workflows and tooling.
Key responsibilities include:
- Reviewing and auditing code annotations against established rubrics and guidelines
- Generating and validating high-quality annotations yourself to model expected quality standards
- Identifying systemic issues, edge cases, and gaps in annotation guidelines
- Building and maintaining internal tools, dashboards, scripts, and utilities to streamline annotator workflows
- Troubleshooting environment, tooling, and version control issues for annotators
- Collaborating with annotation operations, technical program managers, and engineers to refine guidelines and processes
- Liaising with IT and engineering teams as needed
Required qualifications:
- Bachelor's degree in computer science, engineering, or related field, OR 2-5 years of professional experience in software engineering, technical support, or tool development
- Hands-on experience using code agents in development workflows
- Proficiency in at least one programming language (Python, JavaScript, etc.) with ability to read and reason about code across multiple languages
- Ability to apply consistent judgment against rubrics and identify edge cases and ambiguities
- Strong attention to detail and sustained focus for high-volume review work
- Comfort with Unix-like terminals, shell basics, package managers, environment setup, and version control
- Ability to troubleshoot local development environment issues across common operating systems
- Professional English proficiency with strong writing and comprehension skills
Mistral offers comprehensive benefits including healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, and location-specific perks.
