Talent.com
AI Quality Assurance Automation Engineer

AI Quality Assurance Automation Engineer

Datacom AustraliaAuckland, Auckland, New Zealand
13 hours ago
Job description

AI Quality Assurance Automation Engineer

We are undergoing a significant AI uplift that will transform the New Zealand market. Join our Digital Engineering team to design, develop, and deploy AI-driven software solutions that meet complex business challenges.

Description

This role focuses on creating advanced AI-powered QA automation solutions for testing AI-based applications and models. You will build scalable test frameworks, perform functional and non-functional testing, and continuously improve methodologies to keep pace with rapid AI development.

Responsibilities

  • Design, develop, and implement AI QA automation solutions for AI-based applications, identifying performance bottlenecks, inconsistencies, and model biases.
  • Build and maintain automated test frameworks using tools such as Playwright, Appium, pytest, or custom AI testing tools.
  • Conduct functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness, and perform regression testing.
  • Stay current on AI advancements and adopt emerging technologies to enhance the QA process.
  • Test AI solutions on cloud platforms (AWS, Azure, Google Cloud) and on‑premise services, ensuring optimal performance across environments.
  • Collaborate with AI developers, data scientists, and product teams to identify testing requirements and improve overall AI system quality.
  • Implement continuous improvement of testing methodologies and drive automation efficiency.
  • Develop test automation pipelines and report on key quality metrics.
  • Communicate test results, insights, and recommendations to stakeholders clearly and effectively.

Skills & Qualifications

  • 4–5 years of test automation experience, focused on AI and machine learning applications.
  • Proficiency in Python (preferred), C#, Java, or TypeScript, and experience with Selenium, Appium, Pytest, or similar frameworks.
  • Experience with cloud‑based AI services (AWS AI / ML, Azure Cognitive Services, Google Cloud AI) and on‑premise AI solutions.
  • Knowledge of version control (Git) and CI / CD pipelines for automated testing.
  • Basic understanding of AI / ML concepts including data preprocessing, model training, evaluation metrics, and fairness.
  • Strong analytical and problem‑solving skills to assess AI system performance and improve test coverage.
  • Excellent teamwork and communication skills, able to explain complex technical concepts to both technical and non‑technical stakeholders.

    • Preferred Qualifications

  • Experience deploying AI on-premise and in hybrid environments.
  • Familiarity with AI ethics, fairness, and bias testing methodologies.
  • Experience with test‑driven development (TDD) or behavior‑driven development (BDD) in AI projects.

    • Why Join Us

  • Be part of a dynamic, forward‑thinking team passionate about AI technology.
  • Work in an environment that fosters innovation and continuous learning.
  • Opportunity to lead AI QA and directly impact the quality of cutting‑edge AI products.
  • Competitive salary and benefits package.

    • If you are a proactive, tech‑savvy AI QA engineer with a strong automation background and a passion for advancing AI, we would love to hear from you!

    #J-18808-Ljbffr

    Create a job alert for this search

    Automation Engineer • Auckland, Auckland, New Zealand