Senior QA Automation Engineer – AI /ML /Gen AI | On-site, Bangalore

Ntst is seeking a Senior QA Automation Engineer - AI /ML /Gen AI | On-site, Bangalore to join its full-time team in Bengaluru, India. This on-site opportunity centres on building reliable automation pipelines that safeguard the accuracy and performance of artificial intelligence, machine learning and generative AI systems for candidates searching Senior QA Automation Engineer - AI /ML /Gen AI | On-site, Bangalore jobs in Bengaluru, India or Ntst careers near me.

Role Overview

In the Senior QA Automation Engineer - AI /ML /Gen AI | On-site, Bangalore post at Ntst in Bengaluru, India you will own the end-to-end quality strategy for complex AI and GenAI products. Working fully on-site you will design scalable test automation, validate model behaviour under real-world conditions and embed quality gates into every stage of delivery so that AI-driven features ship with confidence and consistency.

Responsibilities

• Create and maintain comprehensive automation frameworks specifically for AI, machine-learning pipelines and generative AI applications.
• Build reusable test suites that cover data integrity, model accuracy, prompt evaluation, bias detection and output consistency.
• Integrate automated checks into continuous-integration and continuous-delivery pipelines so regressions are caught early.
• Partner with data scientists, engineers and product owners to define acceptance criteria that reflect real AI system risks.
• Execute performance, load and chaos tests tailored to the unique resource patterns of large language models and ML inference services.
• Analyse detailed test reports, root-cause defects, and drive permanent preventive actions across the AI development lifecycle.
• Coach junior quality engineers on modern AI testing techniques and automation best practices inside the Bengaluru team.

What You Bring

• Proven senior-level experience delivering QA automation for AI, machine-learning or generative AI systems.
• Hands-on mastery of common automation libraries and languages such as Python, Selenium, Pytest or equivalent frameworks adapted for model testing.
• Solid understanding of model validation metrics, data-quality checks, hallucination detection and ethical AI testing practices.
• Familiarity with CI/CD tooling, containerised environments and cloud-based test infrastructure used by AI teams.
• Ability to design both functional and non-functional test strategies that scale with growing model complexity.
• Strong analytical mindset, clear communication skills and readiness to collaborate on-site every day in Bengaluru, India.
• Track record of mentoring peers and continuously refining automation approaches for emerging GenAI technologies.

More About Ntst

Ntst is hiring for this role and offers a supportive team environment.

How to Apply

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there.