Talent.com
This job offer is not available in your country.
AI Quality Assurance Lead

AI Quality Assurance Lead

DatacomWellington, Wellington Region, NZ
19 days ago
Job type
  • Quick Apply
Job description

About Datacom

With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and with over 2 decades of operating in Malaysia and the Philippines, Datacom has experienced expediential growth. Through all this, Datacom has maintained high levels of profitability with a track record of delivering innovative, cost effective digital and technology solutions, all delivered by dynamic teams spread across various locations. Our people are the best in their fields – smart, passionate, and dedicated to providing exceptional IT services to our customers. This makes for a rewarding and fast-paced place to work.

Our purpose

Here at Datacom we connect people and technology in order to solve challenges, create opportunities and discover new possibilities for the communities we live in.

Position Overview

We are seeking an enthusiastic and innovative AI Quality Assurance Lead who is passionate about the latest developments in AI and machine learning. This role will focus on creating AI-driven QA solutions, adopting cutting-edge AI advancements, and ensuring the quality and reliability of AI-based systems. With over 5 years of experience in test automation across a wide range of tools, the ideal candidate will be proactive in adopting new technologies, ensuring the robustness and accuracy of AI models, and driving the quality agenda within the organization.

Key Responsibilities

  • AI QA Solutions Development : Design, develop, and implement advanced AI-powered QA automation solutions for testing AI-based applications, models, and systems. Use innovative techniques to identify performance bottlenecks, inconsistencies, and model biases.
  • Test Automation & Frameworks : Build and maintain automated test frameworks for AI systems using a wide variety of automation tools (e.g., Playwright, Appium, pytest, or custom-built AI testing tools). Ensure that test automation strategies are scalable, reusable, and aligned with industry best practices. Senior test automation coding skills in at least one of the following languages : python, typescript, java, C#.
  • AI Model Testing : Perform functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness. Conduct regression testing and ensure that AI solutions behave as expected across different scenarios.
  • Adopt AI Innovations : Stay up to date with the latest AI advancements and research. Actively explore and adopt emerging AI technologies (e.g., GPT models, neural networks, reinforcement learning) to continuously improve the quality assurance process.
  • Cloud and On-Premise AI Services : Test and validate AI solutions hosted on both cloud platforms (e.g., AWS, Azure, Google Cloud) and on-premise AI services. Ensure that the AI solutions perform optimally across both environments.
  • Cross-functional Collaboration : Work closely with AI developers, data scientists, and product teams to identify testing requirements, troubleshoot issues, and improve overall AI system quality. Provide feedback and insights on AI solution design from a QA perspective.
  • Continuous Improvement : Implement and continuously improve testing methodologies for AI systems. Drive automation efficiency and effectiveness, ensuring that testing is not only comprehensive but also aligned with fast-paced AI development cycles.
  • Pipeline development : Can describe and demonstrate the place and value propositions for test automation pipelines with AI solutions using PaaS (e.g. Azure DevOps, GitHub Actions).
  • Quality Metrics & Reporting : Establish key quality metrics for AI systems, track progress, and report on the effectiveness of AI testing strategies. Maintain clear, concise, and actionable documentation and reports on test outcomes, issues found, and resolutions.
  • Communication Skills : Ability to communicate (both written and orally) abstract concepts and value points to stakeholders in terms that can be understood and discussed.

Requirements

Skills & Qualifications :

  • Experience : At least 5 years of experience in test automation, with a strong focus on AI and machine learning-based applications and systems. Proven expertise in building automated test frameworks for complex systems.
  • Technical Skills :
  • Proficient in programming languages such as Python, C#, Java, or Typescript with a strong proficiency in python.
  • Hands-on experience with automation tools like Selenium, Appium, Pytest, or other testing frameworks.
  • Experience working with cloud-based AI services (e.g., AWS AI / ML, Azure Cognitive Services, Google Cloud AI) as well as on-premise AI solutions.
  • Knowledge of version control systems (e.g., Git) and CI / CD pipelines for automated testing.
  • AI / ML Knowledge : Basic understanding of AI / ML concepts, including data preprocessing, model training, evaluation metrics, and model fairness. Familiarity with testing methodologies for AI systems, including model validation and performance testing.
  • Analytical & Problem-Solving Skills : Strong analytical skills to assess AI system performance, debug issues, and design solutions to improve test coverage and efficiency.
  • Innovation and Learning : Demonstrated ability to stay current with AI industry trends and developments. Ability to quickly adapt to new tools, technologies, and methodologies.
  • Collaboration & Communication : Excellent teamwork and communication skills. Able to work effectively with cross-functional teams and explain complex technical concepts to both technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Experience with on-premise AI services and managing AI deployments in hybrid environments.
  • Familiarity with AI ethics, fairness, and bias testing methodologies.
  • Experience in test-driven development (TDD) or behavior-driven development (BDD) in AI projects.
  • Why join us here at Datacom?

  • Be part of a dynamic, forward-thinking team that is passionate about pushing the boundaries of AI technology.
  • Work in an environment that fosters innovation and continuous learning.
  • Opportunity to lead the way in AI QA, making a direct impact on the quality of cutting-edge AI products.
  • Competitive salary and benefits package.
  • If you're a proactive, tech-savvy AI QA engineer with a strong automation background and a passion for staying ahead of AI developments, we'd love to hear from you!

    Create a job alert for this search

    Quality Assurance • Wellington, Wellington Region, NZ

    Related jobs
    • Promoted
    Senior Automation Tester

    Senior Automation Tester

    Comspek InternationalWellington, Wellington, New Zealand
    Are you passionate about delivering high-quality digital experiences and driving excellence in agile testing practices? We're looking for a. Take initiative in thinking critically and laterally abou...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Assurance Advisor

    Senior Assurance Advisor

    RandstadWellington, Wellington, New Zealand
    As a Senior Assurance Advisor, you'll be responsible for conducting fieldwork for internal audits and providing input on the effectiveness of our systems, controls, and processes.You'll play a key ...Show moreLast updated: 1 day ago
    • Promoted
    Tet Analyst

    Tet Analyst

    ResyncWellington, Wellington, New Zealand
    Wellington, New Zealand | Posted on 13 / 08 / 2025.Resync Consulting Limited is seeking a skilled Test Analyst with strong analytical and communication skills to join our team working on projects withi...Show moreLast updated: 30+ days ago
    • Promoted
    Ai Quality Assurance Automation Engineer

    Ai Quality Assurance Automation Engineer

    DatacomWellington, Wellington, New Zealand
    The way we work and our customer needs are changing!.We are going through a huge AI uplift that will be a real game changer in the NZ Market. Our customers are loving our story and excited about our...Show moreLast updated: 30+ days ago
    • Promoted
    Ai Quality Assurance Automation Engineer (Permanent) - Wellington

    Ai Quality Assurance Automation Engineer (Permanent) - Wellington

    DatacomWellington, Wellington, New Zealand
    OverviewAI Quality Assurance Automation Engineer (Permanent) – Wellington.Join a Digital Engineering team delivering innovative AI-driven software solutions. You will work on cutting-edge projects, ...Show moreLast updated: 30+ days ago
    Senior Quality Assurance Automation Engineer - permanent

    Senior Quality Assurance Automation Engineer - permanent

    DatacomWellington, Wellington Region, NZ
    Quick Apply
    With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and...Show moreLast updated: 19 days ago
    • Promoted
    Cook

    Cook

    Dhiya LimitedLower Hutt, Wellington, New Zealand
    We are looking for Cook for a busy Restaurant in Wellington Region.Great opportunity to work with a friendly team in a busy workplace. Preparing awesome ethnic meals and Tandoori foods for our custo...Show moreLast updated: 25 days ago
    Senior Quality Assurance Automation Engineer - PERM

    Senior Quality Assurance Automation Engineer - PERM

    DatacomWellington, Wellington Region, NZ
    Quick Apply
    Datacom works with organisations and communities across Australia and New Zealand to make a difference in people’s lives and help organisations use the power of tech to innovate and grow.The Senior...Show moreLast updated: 19 days ago
    • Promoted
    Portfolio Technical Lead

    Portfolio Technical Lead

    Randstad New ZealandWellington, Wellington, New Zealand
    Portfolio Technical Lead role at Randstad New Zealand.This is a 6-month Fixed-Term or hourly rate contract.Responsible for the delivery of technical projects with a development background and leade...Show moreLast updated: 1 day ago
    • Promoted
    Test Lead

    Test Lead

    ResyncWellington, Wellington, New Zealand
    Wellington, New Zealand | Posted on 13 / 08 / 2025.Resync Consulting Limited is seeking an experienced Test Lead with a strong background in leading small teams and exceptional communication skills to ...Show moreLast updated: 30+ days ago
    • Promoted
    Ai Quality Assurance Lead

    Ai Quality Assurance Lead

    DatacomWellington, Wellington, New Zealand
    About DatacomWith over 6,200 people and centres of technical excellence across Australasia, Datacom is committed to developing its capabilities across Asia. Founded in 1965 in New Zealand, with over...Show moreLast updated: 30+ days ago
    • Promoted
    Portfolio Technical Lead

    Portfolio Technical Lead

    RandstadWellington, Wellington, New Zealand
    Our client is looking to hire a Portfolio Technical Lead who will be responsible for the delivery of technical projects.You will ideally have a development background and have leadership experience...Show moreLast updated: 9 days ago
    • Promoted
    Senior Quality Assurance Automation Engineer - Permanent

    Senior Quality Assurance Automation Engineer - Permanent

    DatacomNew Zealand
    About DatacomWith over 6,200 people, and centre's of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia.Founded in 1965 in New...Show moreLast updated: 22 days ago
    • Promoted
    Principal Consultant (Performance Testing & Test Automation)

    Principal Consultant (Performance Testing & Test Automation)

    DatacomWellington, Wellington, New Zealand
    Principal Consultant (Performance Testing & Test Automation).As a Principal Consultant within the Professional Services team, you will contribute to performance testing engagements and drive modern...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Advisor Quality Assurance

    Principal Advisor Quality Assurance

    New Zealand GovernmentWellington, Wellington, New Zealand
    Mō tēnei tūranga mahi | About this role • Strategic and operational leadership in quality assurance • Lead the engagement, design and delivery of audit and evaluation programmes • Champion inclusive, ...Show moreLast updated: 1 day ago
    • Promoted
    Engineering Team Lead - Security Governance & Data Protection

    Engineering Team Lead - Security Governance & Data Protection

    XeroWellington, Wellington, New Zealand
    At Xero, we’re here to help supercharge small businesses.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the right data, advisors and apps.When ...Show moreLast updated: 15 days ago
    AI Quality Assurance Automation Engineer

    AI Quality Assurance Automation Engineer

    DatacomWellington, Wellington Region, NZ
    Quick Apply
    The way we work and our customer needs are changing! We are going through a huge AI uplift that will be a real game changer in the NZ Market. Our customers are loving our story and excited about our...Show moreLast updated: 19 days ago
    • Promoted
    Quality Assurance Coordinator

    Quality Assurance Coordinator

    Tyler WrenWellington, Wellington, New Zealand
    Looking to step up from adviser support, FAP operations, or a financial services role into compliance? This is a fantastic opportunity to do just that. We’re representing our client in their search ...Show moreLast updated: 3 days ago