SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Tripadvisor is seeking an AI Quality Assurance Program Manager to establish and oversee quality frameworks for AI systems across its Travel Experiences platform. This hybrid role (2–3 days per week in London) sits at the intersection of AI performance, traveler satisfaction, and product development.
You will define the end-to-end quality strategy, evolving QA from traditional sample-based auditing to continuous, AI-enabled quality management. Key responsibilities include:
• Establish comprehensive AI quality and testing frameworks, including evaluation benchmarks, testing protocols, and human-in-the-loop workflows to verify AI agents, support bots, and recommendation engines.
• Audit AI-generated outputs (automated support chats, tour recommendations, booking updates) for intent fulfillment, safety, tone, and hallucination prevention.
• Deliver executive-ready reporting that translates QA evaluation data, model accuracy rates, and error trends into strategic recommendations.
• Lead cross-functional improvements by partnering with Data Science, AI Engineering, Product, and Customer Experience teams to turn QA findings into prompt refinements, model fine-tuning, and knowledge base updates.
• Track project timelines for new AI deployments, manage QA regression testing schedules, and hold technical teams accountable to quality standards before full traveler rollout.
You bring 4–6 years of technical program management, QA management, or AI/ML product operations experience focused on system reliability and evaluation. Strong operational knowledge of AI/LLM testing methodologies, prompt evaluation, intent recognition accuracy, and AI safety guardrails is essential. You excel at analyzing AI logs, leveraging analytics tools, and translating quality metrics into clear dashboards and presentations. Exceptional cross-functional collaboration skills and deep interest in online travel and consumer-facing AI interactions are required.
Preferred: hands-on experience with modern LLM evaluation tools, annotation platforms, or customer service AI tools (Zendesk AI, Intercom, Salesforce); background in travel tech, e-commerce marketplaces, or fast-scaling consumer platforms.
