SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Perplexity AI is seeking an experienced Search Quality Analyst to help build and improve core search technologies. You will work at the intersection of data analysis and engineering, designing metrics, building data pipelines, and enhancing the quality of search and answer systems.
Key Responsibilities:
- Identify and diagnose quality issues in the search pipeline
- Design metrics from scratch to track and measure search quality
- Build datasets for model training, including LLM-as-a-judge labeling pipelines
- Improve search snippet quality and page selection algorithms for indexing
- Design and analyze A/B experiments to validate improvements
Required Qualifications:
- 4+ years of experience as a data analyst or in a related role
- Strong coding skills at a mid-level backend engineer level
- Proficiency with SQL and Python
- Demonstrated hands-on experience with at least one of: designing metrics from scratch, building LLM-as-a-judge labeling pipelines, training production ML models with measurable improvements, or designing/improving evals with known ground truth
Preferred Qualifications:
- Experience with search-related products
- Knowledge of statistics and A/B experiment design
- Experience with Apache Spark or Databricks
This is a hybrid role based in Belgrade, with flexibility to work from London or Berlin.
About Perplexity AI
AI / Data / Infrastructure — AI answer engine and search product for consumers and enterprises.
