KPMG Global Services

QA Test Consultant- AI

KPMG Global Services · Bangalore, Karnataka, India

Business Consulting and Services · 10,001+ employees

7 h ago
Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The consultant will design comprehensive test strategies and implement automation frameworks to ensure the quality, safety, and performance of AI-powered solutions. They will collaborate with cross-functional teams to validate AI model behavior and establish evaluation mechanisms for LLM-based applications.

What they look for

Quality Engineering Software Testing Test Automation Playwright API Testing Generative AI LLM Evaluation Python TypeScript CI/CD DevOps RAG Evaluation Prompt Evaluation Azure DevOps Jira Responsible AI

Requirements

Candidates must have 4–6 years of experience in software testing and automation, with hands-on expertise in AI/GenAI applications and Playwright. A bachelor's degree in Computer Science, Engineering, or a related discipline is required.

Full description

We are seeking a highly motivated Quality Engineering (QE) Consultant with 4–6 years of experience in software testing, automation, and emerging AI technologies. The ideal candidate will have hands-on experience testing AI/GenAI applications, APIs, and web applications, along with strong expertise in Playwright automation and AI evaluation frameworks.

This role will focus on ensuring the quality, reliability, safety, and performance of AI-powered solutions by designing comprehensive test strategies, implementing automation frameworks, validating AI model behavior, and establishing evaluation mechanisms for large language model (LLM)-based applications.

The candidate will collaborate closely with Product Owners, Developers, Data Scientists, and AI Engineers to drive quality throughout the software development lifecycle.