Operations Specialist, AI Enablement

About This Opportunity

Our talent team is representing a confidential social technology client seeking an Operations Specialist for AI Enablement in London. This hybrid role sits at the intersection of quality assurance, trust and safety, and artificial intelligence, supporting systems that ensure responsible, policy-compliant user experiences at scale.

You'll evaluate AI-powered interactions and automated moderation decisions, conducting quality reviews that assess alignment with community policies and operational standards. Through case labelling, golden-set maintenance, and thoughtful analysis, you'll identify where automated systems perform well and where human judgment reveals opportunities for improvement.

Responsibilities

• Conduct quality reviews of AI-powered customer conversations and automated moderation decisions against established community policies and quality standards
• Analyse policy enforcement gaps and nuanced cases, identifying inconsistencies or misalignments and surfacing actionable insights
• Perform accurate case labelling to support AI model training, evaluation pipelines, and ongoing quality benchmarking
• Review and maintain golden sets that provide reliable ground truth for assessing AI quality, accuracy, and precision
• Report quality issues through established workflows with clear documentation and actionable feedback
• Collaborate with management on scoring consistency, calibration, recurring quality issues, and AI reliability improvements
• Identify patterns that can strengthen AI accuracy, customer satisfaction, and operational efficiency
• Use QA platforms and AI-supported tools to monitor quality and understand system behaviour, reviewing outputs critically for accuracy, bias, privacy, and fairness

What We're Looking For

• 1+ years of experience in Trust & Safety, content moderation, Customer Experience, quality assurance, or similar policy-driven environments (we welcome candidates with alternative backgrounds demonstrating equivalent skills)
• Sharp attention to detail with ability to objectively evaluate interactions against established policies and quality standards
• Familiarity with conversational AI systems, chatbots, automated moderation, or AI-supported workflows, with curiosity to understand system behaviour and limitations
• Understanding of or motivation to learn quality assurance practices including case labelling, calibration, consistent scoring, and golden-set evaluation
• Comfort learning digital tools and platforms, using data and quality insights to identify meaningful patterns
• Strong collaboration skills with ownership of deliverables and ability to see work through from insight to impact
• Thoughtful approach to AI assessment, evaluating outputs for accuracy, bias, privacy, and fairness rather than relying on automated results without review
• Based in or willing to relocate to London for hybrid working arrangements

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will screen qualified applicants and coordinate interviews with our client. We manage the entire submission and interview process on your behalf. Please do not contact the employer directly, as all communication flows through our team to ensure a professional, coordinated experience.

Pay

Compensation details will be discussed during the screening process and will be based on your qualifications, relevant experience, and skill set.

Equal Opportunity

Get A Job.ai is committed to inclusive recruiting practices. We encourage applications from candidates of all backgrounds and are happy to discuss reasonable adjustments to support you throughout the process.