AI Quality Assurance Program Manager

About This Opportunity

We are representing a confidential travel technology company seeking an AI Quality Assurance Program Manager in London. This hybrid role sits at the intersection of artificial intelligence performance, customer satisfaction, and product development. You will establish testing frameworks, audit AI outputs, and transform quality findings into actionable operational insights that drive business performance.

This position requires 2-3 days per week in the London office.

Responsibilities

• Define AI Quality Strategy: Establish end-to-end quality frameworks across human and AI agents, evolving QA from traditional sample-based auditing toward continuous, AI-enabled quality management
• Build Testing Frameworks: Design and maintain comprehensive evaluation benchmarks, testing protocols, and human-in-the-loop workflows to verify AI agents, support bots, and recommendation engines
• Audit AI Outputs: Continuously evaluate AI-generated outputs including automated support chats, recommendation accuracy, and booking updates for intent fulfillment, safety, tone, and hallucination prevention
• Deliver Business Insights: Create executive-ready reporting that translates complex QA evaluation data, model accuracy rates, and error trends into strategic recommendations
• Lead Cross-Functional Improvements: Partner with Data Science, AI Engineering, Product, and Customer Experience teams to turn QA findings into prompt refinements, model fine-tuning, and knowledge base updates
• Maintain Release Standards: Track project timelines for new AI deployments, manage QA regression testing schedules, and hold technical teams accountable to quality standards before full rollout

What We're Looking For

Required Qualifications:

• 4-6 years of experience in technical program management, QA management, or AI/ML product operations focused on system reliability and evaluation
• Strong operational knowledge of AI/LLM testing methodologies, prompt evaluation, intent recognition accuracy, and AI safety guardrails
• Proven ability to analyze AI logs, leverage analytics tools, and turn quality metrics into clear, executive-ready presentations and dashboards
• Exceptional track record of bridging technical AI engineering teams with business stakeholders and front-line support operations
• Deep interest in online travel, customer behavior, and maintaining high trust across consumer-facing AI interactions

Preferred Qualifications:

• Hands-on experience with modern LLM evaluation tools, annotation platforms, or customer service AI tools
• Background in travel technology, e-commerce marketplaces, or fast-scaling consumer platforms

How We Work With You

Our talent team at Get A Job.ai partners with exceptional organizations to connect them with outstanding candidates. When you apply through our platform, a dedicated recruiter will screen your application and discuss the opportunity with you in detail. We will then submit qualified candidates to our client for consideration. Please apply exclusively through Get A Job.ai and do not contact the client directly.

Pay

Compensation details will be discussed during the screening process with our recruiting team.

Equal Employment Opportunity: Get A Job.ai is committed to creating an inclusive recruitment experience. We work with clients who value diversity and provide equal employment opportunities to all qualified candidates regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or veteran status.