GenAI QA Automation Engineer-Manager
At a glance
Manager-level AI Engineering role at Pwc (Crm Experienced Careers Site). Bangalore · full-time.
Pay not stated AI Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Build automated test frameworks for data-based solutions, checking coverage and supporting reliable releases
- Shape testing methods for generative AI products, including prompt checks, response quality and hallucination detection
- Use analytics and statistical methods to find patterns in complex datasets and support decisions
- Work with data science and engineering teams to improve pipelines, workflows and data quality
- Guide work across teams, review deliverables, coach colleagues and provide technical direction on client projects
What you bring
- At least eight years of experience and both bachelor's and master's degrees
- Strong hands-on Playwright automation with Python, including scalable frameworks built with Pytest
- Practical experience testing LLM or RAG applications, validating prompts, citations and response consistency
- English proficiency in both speaking and writing
Who this fits
This manager role suits someone who can lead QA automation delivery while coaching teams and reviewing work. You’ll collaborate across data science and engineering and provide technical guidance on client engagements. The role is based in Bangalore, India.
From the employer
Industry/Sector
Not ApplicableSpecialism
Data, Analytics & AIManagement Level
ManagerJob Description & Summary
The Opportunity
Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands-on learning, cutting-edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.
As a GenAI QA Automation Engineer-Manager you will lead the design and delivery of automated testing approaches for generative AI solutions, with a focus on validation, test coverage, and dependable release cycles within our Data and Analytics Engineering practice. As a Manager you will coach teams, guide execution across workstreams, and apply sound judgment to review deliverables, manage priorities, and support client-facing outcomes. In this role at PwC Acceleration Center India, you will collaborate across data science and engineering efforts, shape automation strategies for AI-enabled products, and help develop practical testing methods that support reliable deployment and ongoing enhancement.
Responsibilities
- Developing and implementing automated testing frameworks for data-driven solutions
- Leveraging advanced analytics and statistical techniques to extract insights from complex datasets
- Collaborating with cross-functional teams to design and optimize data pipelines and workflows
- Utilizing programming languages such as C++ and R for data modeling and predictive analysis
- Applying machine learning algorithms and neural networks to enhance data science projects
- Conducting exploratory and descriptive analysis to support strategic decision-making
- Building and maintaining data visualizations to communicate insights effectively
- Troubleshooting data science workflows to improve data quality and accuracy
- Engaging in continuous learning to stay updated with emerging technologies in artificial intelligence and data science
- Supporting client engagements by providing technical guidance and innovative solutions
What You Must Have
- At least a Bachelor's & Master's degree
- At least 8 years of experience
- Oral and written proficiency in English required
What Sets You Apart
- Extensive hands-on expertise in Playwright automation with Python, including the design and maintenance of scalable automation frameworks using Pytest, Page Object Model (POM), fixtures, parameterization, and data-driven testing techniques.
- Proven experience in REST API automation leveraging Python Requests, Pytest, Postman, and similar tools, with solid knowledge of HTTP methods, status codes, headers, JSON payloads, authentication, error handling, and API response validation.
- Strong proficiency in SQL for backend testing, covering database validation, complex joins, stored procedures, data reconciliation, and ensuring data integrity across systems.
- Skilled in automating diverse test scenarios, including functional, regression, integration, smoke, and end-to-end testing, aligned with Agile principles and best testing practices.
- Comprehensive understanding of test planning, test case design, defect lifecycle management, debugging, root cause analysis, and driving quality assurance in dynamic development environments.
- Experienced in using Git-based version control systems, performing code reviews, generating detailed test reports, and enforcing automation coding standards to maintain high-quality deliverables.
- Hands-on experience testing LLM/Generative AI and retrieval-augmented generation (RAG) applications, focusing on prompt validation, response accuracy, hallucination detection, citation verification, and output consistency.
- Proficient in leveraging AI-powered development tools such as Claude, Cursor, ChatGPT, and GitHub Copilot to accelerate automation scripting, debugging, SQL generation, API test creation, documentation, and overall engineering efficiency
Travel Requirements
Not SpecifiedJob Posting End Date