QA Automation Engineer – GenAI
At a glance
Mid-level AI Engineering role at NorthBay Solutions. Abu Dhabi · full-time.
Pay not stated AI Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Plan and run test coverage for software features, integrations, performance and security
- Build and maintain automated test frameworks with Pytest, Selenium or comparable tools
- Check APIs and connect automated tests to CI/CD pipelines with DevOps teams
- Assess AI and GenAI models for accuracy, fairness, resilience and input/output data quality
- Track defects in JIRA and guide junior QA engineers on quality practices
What you bring
- At least seven years of hands-on work in QA and automation engineering
- Practical skill with test automation tools such as Pytest or Selenium, plus strong API testing ability
- Knowledge of CI/CD integration and software testing methods across functional and non-functional work
Who this fits
This mid-level role suits an experienced QA automation engineer who can test AI/ML or GenAI systems and collaborate across teams. It is full-time and onsite in Abu Dhabi; applicants must already be based in the UAE.
From the employer
QA Automation Engineer – GenAI
Location: Abu Dhabi
Experience: 7+ Years
Company: NorthBay Solutions
About NorthBay Solutions
NorthBay Solutions is a global digital transformation company delivering innovative cloud-native and AI/ML-powered solutions. We solve complex business challenges with a focus on modern technologies and real-world impact. At NorthBay, we promote a culture of excellence, ownership, and continuous learning.
Note: This is a full-time onsite role based in Abu Dhabi, UAE. Only UAE based candidates can apply.
Position Overview
We are hiring a QA Automation Engineer – GenAI with 7+ years of experience. This role demands a strong foundation in automation testing and a passion for quality across cloud-native, AI/ML, and GenAI platforms.
Key Responsibilities
Design and execute detailed test strategies, test plans, and test cases
Conduct functional, integration, performance, and security testing
Build and maintain automation frameworks using Pytest, Selenium, or similar tools
Perform thorough API testing using Postman or comparable tools
Collaborate with DevOps to integrate test automation in CI/CD pipelines
Validate AI/ML and GenAI solutions by:
Testing model accuracy, fairness, and performance
Detecting bias and validating robustness
Ensuring input/output data quality
Manage and track defects using tools such as JIRA
Provide mentorship to junior QA engineers and promote quality best practices
Required Qualifications
7+ years of hands-on experience in QA and automation engineering
Proficiency with automation tools (e.g., Pytest, Selenium)
Strong skills in API testing
Knowledge of CI/CD integration
Solid understanding of software testing methodologies and lifecycle
Experience with functional and non-functional testing
Excellent communication and team collaboration skills
Preferred Skills
Experience testing AI/ML and GenAI systems, including:
Model validation and bias detection
Feature/data pipeline testing
Robustness and performance evaluation
Familiarity with cloud platforms (AWS, Azure, GCP)