Ai Quality Assurance Automation Engineer

AI Quality Assurance Automation Engineer

We are undergoing a significant AI uplift that will transform the New Zealand market.

Join our Digital Engineering team to design, develop, and deploy AI-driven software solutions that meet complex business challenges.

Description

This role focuses on creating advanced AI-powered QA automation solutions for testing AI-based applications and models.

You will build scalable test frameworks, perform functional and non-functional testing, and continuously improve methodologies to keep pace with rapid AI development.

Responsibilities

Design, develop, and implement AI QA automation solutions for AI-based applications, identifying performance bottlenecks, inconsistencies, and model biases.

Build and maintain automated test frameworks using tools such as Playwright, Appium, pytest, or custom AI testing tools.

Conduct functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness, and perform regression testing.

Stay current on AI advancements and adopt emerging technologies to enhance the QA process.

Test AI solutions on cloud platforms (AWS, Azure, Google Cloud) and on-premise services, ensuring optimal performance across environments.

Collaborate with AI developers, data scientists, and product teams to identify testing requirements and improve overall AI system quality.

Implement continuous improvement of testing methodologies and drive automation efficiency.

Develop test automation pipelines and report on key quality metrics.

Communicate test results, insights, and recommendations to stakeholders clearly and effectively.

Skills & Qualifications

4–5 years of test automation experience, focused on AI and machine learning applications.

Proficiency in Python (preferred), C#, Java, or TypeScript, and experience with Selenium, Appium, Pytest, or similar frameworks.

Experience with cloud-based AI services (AWS AI / ML, Azure Cognitive Services, Google Cloud AI) and on-premise AI solutions.

Knowledge of version control (Git) and CI / CD pipelines for automated testing.

Basic understanding of AI / ML concepts including data preprocessing, model training, evaluation metrics, and fairness.

Strong analytical and problem-solving skills to assess AI system performance and improve test coverage.

Excellent teamwork and communication skills, able to explain complex technical concepts to both technical and non-technical stakeholders.

Preferred Qualifications

Experience deploying AI on-premise and in hybrid environments.

Familiarity with AI ethics, fairness, and bias testing methodologies.

Experience with test-driven development (TDD) or behavior-driven development (BDD) in AI projects.

Why Join Us

Be part of a dynamic, forward-thinking team passionate about AI technology.

Work in an environment that fosters innovation and continuous learning.

Opportunity to lead AI QA and directly impact the quality of cutting-edge AI products.

Competitive salary and benefits package.

If you are a proactive, tech-savvy AI QA engineer with a strong automation background and a passion for advancing AI, we would love to hear from you!

#J-

• Ljbffr