Senior/Lead Quality Engineer – Chatbot

About This Opportunity

Our talent team at Get A Job.ai is representing a fast-growing AI technology company in their search for a Senior or Lead Quality Engineer to establish testing foundations for conversational AI products. This is a founding quality role within a newly formed product team of five engineers working on chatbot and LLM-powered components.

You'll define quality practices from the ground up for systems with dynamic, non-deterministic outputs—combining hands-on technical testing with strategic thinking to enable fast, confident releases. This role offers significant ownership and the chance to shape quality engineering at the intersection of software development and machine learning.

Responsibilities

• Develop and evolve quality practices, test strategy, and release processes for conversational AI products
• Establish and operate an output-evaluation framework for assessing quality, reliability, and regressions in LLM-based systems
• Design pragmatic testing approaches for validating non-deterministic AI behavior beyond conventional test cases
• Identify, test, and improve guardrails for AI-specific risks including prompt-injection scenarios and unexpected model behavior
• Partner with software and ML engineers through code reviews, technical discussions, and collaborative debugging
• Research testing gaps, evaluate tools and methods, and make evidence-based recommendations
• Design proof-of-concepts for new testing approaches and help productionize high-value solutions
• Support evolution of release testing with clearer quality signals and release-readiness criteria
• Build knowledge-sharing practices and contribute to the broader quality engineering community within the organization

What We're Looking For

Required:

• Strong hands-on experience in software quality engineering, SDET, test automation, or closely related engineering roles
• Experience testing chatbot, conversational AI, RAG systems, LLM-powered products, or other dynamic, non-deterministic systems
• Proficiency in at least one programming language with technical depth to understand production code and contribute to code reviews
• Experimental, investigative mindset—able to explore uncertain problem spaces and turn findings into practical improvements
• Clear written and verbal communication skills, including explaining technical concepts, risks, and trade-offs
• Strong collaboration skills and pragmatic approach to working with cross-functional teams
• Good judgment in prioritizing quality work based on risk, user impact, and delivery goals

Preferred:

• Experience with AI security and safety testing
• Background as a first or founding Quality Engineer in a team
• Experience mentoring engineers or influencing testing practices across teams
• Track record of bringing new methodologies and industry trends to engineering organizations

Location & Work Arrangements

This is a fully remote position available to candidates based in the UK, Americas, or Europe within UTC-5 to UTC+1 timezones. Our client offers flexible schedules and distributed work arrangements with optional co-working budgets.

How We Work With You

When you apply through Get A Job.ai, our recruiting team will review your profile and conduct an initial screening. Qualified candidates will be submitted directly to our client for consideration. The client's interview process includes a recruiter screen, hiring manager interview, take-home assignment with live follow-up, and behavioral interviews with senior leadership.

Important: Please apply only through Get A Job.ai. Do not attempt to contact the client directly, as this may disqualify your application.

Pay

Compensation details will be discussed during the screening process and are aligned with market data, internal frameworks, and individual experience. Our client offers generous base compensation plus equity options.

Equal Opportunity

Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work with clients who share our commitment to building diverse teams.