Talent.com
No longer accepting applications
AI Quality Assurance Lead

AI Quality Assurance Lead

DatacomHamilton, Waikato Region, NZ
4 days ago
Job type
  • Quick Apply
Job description

About Datacom

With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and with over 2 decades of operating in Malaysia and the Philippines, Datacom has experienced expediential growth. Through all this, Datacom has maintained high levels of profitability with a track record of delivering innovative, cost effective digital and technology solutions, all delivered by dynamic teams spread across various locations. Our people are the best in their fields – smart, passionate, and dedicated to providing exceptional IT services to our customers. This makes for a rewarding and fast-paced place to work.

Our purpose

Here at Datacom we connect people and technology in order to solve challenges, create opportunities and discover new possibilities for the communities we live in.

Position Overview

We are seeking an enthusiastic and innovative AI Quality Assurance Lead who is passionate about the latest developments in AI and machine learning. This role will focus on creating AI-driven QA solutions, adopting cutting-edge AI advancements, and ensuring the quality and reliability of AI-based systems. With over 5 years of experience in test automation across a wide range of tools, the ideal candidate will be proactive in adopting new technologies, ensuring the robustness and accuracy of AI models, and driving the quality agenda within the organization.

Key Responsibilities

  • AI QA Solutions Development : Design, develop, and implement advanced AI-powered QA automation solutions for testing AI-based applications, models, and systems. Use innovative techniques to identify performance bottlenecks, inconsistencies, and model biases.
  • Test Automation & Frameworks : Build and maintain automated test frameworks for AI systems using a wide variety of automation tools (e.g., Playwright, Appium, pytest, or custom-built AI testing tools). Ensure that test automation strategies are scalable, reusable, and aligned with industry best practices. Senior test automation coding skills in at least one of the following languages : python, typescript, java, C#.
  • AI Model Testing : Perform functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness. Conduct regression testing and ensure that AI solutions behave as expected across different scenarios.
  • Adopt AI Innovations : Stay up to date with the latest AI advancements and research. Actively explore and adopt emerging AI technologies (e.g., GPT models, neural networks, reinforcement learning) to continuously improve the quality assurance process.
  • Cloud and On-Premise AI Services : Test and validate AI solutions hosted on both cloud platforms (e.g., AWS, Azure, Google Cloud) and on-premise AI services. Ensure that the AI solutions perform optimally across both environments.
  • Cross-functional Collaboration : Work closely with AI developers, data scientists, and product teams to identify testing requirements, troubleshoot issues, and improve overall AI system quality. Provide feedback and insights on AI solution design from a QA perspective.
  • Continuous Improvement : Implement and continuously improve testing methodologies for AI systems. Drive automation efficiency and effectiveness, ensuring that testing is not only comprehensive but also aligned with fast-paced AI development cycles.
  • Pipeline development : Can describe and demonstrate the place and value propositions for test automation pipelines with AI solutions using PaaS (e.g. Azure DevOps, GitHub Actions).
  • Quality Metrics & Reporting : Establish key quality metrics for AI systems, track progress, and report on the effectiveness of AI testing strategies. Maintain clear, concise, and actionable documentation and reports on test outcomes, issues found, and resolutions.
  • Communication Skills : Ability to communicate (both written and orally) abstract concepts and value points to stakeholders in terms that can be understood and discussed.

Requirements

Skills & Qualifications :

  • Experience : At least 5 years of experience in test automation, with a strong focus on AI and machine learning-based applications and systems. Proven expertise in building automated test frameworks for complex systems.
  • Technical Skills :
  • Proficient in programming languages such as Python, C#, Java, or Typescript with a strong proficiency in python.
  • Hands-on experience with automation tools like Selenium, Appium, Pytest, or other testing frameworks.
  • Experience working with cloud-based AI services (e.g., AWS AI / ML, Azure Cognitive Services, Google Cloud AI) as well as on-premise AI solutions.
  • Knowledge of version control systems (e.g., Git) and CI / CD pipelines for automated testing.
  • AI / ML Knowledge : Basic understanding of AI / ML concepts, including data preprocessing, model training, evaluation metrics, and model fairness. Familiarity with testing methodologies for AI systems, including model validation and performance testing.
  • Analytical & Problem-Solving Skills : Strong analytical skills to assess AI system performance, debug issues, and design solutions to improve test coverage and efficiency.
  • Innovation and Learning : Demonstrated ability to stay current with AI industry trends and developments. Ability to quickly adapt to new tools, technologies, and methodologies.
  • Collaboration & Communication : Excellent teamwork and communication skills. Able to work effectively with cross-functional teams and explain complex technical concepts to both technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Experience with on-premise AI services and managing AI deployments in hybrid environments.
  • Familiarity with AI ethics, fairness, and bias testing methodologies.
  • Experience in test-driven development (TDD) or behavior-driven development (BDD) in AI projects.
  • Why join us here at Datacom?

  • Be part of a dynamic, forward-thinking team that is passionate about pushing the boundaries of AI technology.
  • Work in an environment that fosters innovation and continuous learning.
  • Opportunity to lead the way in AI QA, making a direct impact on the quality of cutting-edge AI products.
  • Competitive salary and benefits package.
  • If you're a proactive, tech-savvy AI QA engineer with a strong automation background and a passion for staying ahead of AI developments, we'd love to hear from you!

    Create a job alert for this search

    Quality Assurance Ai • Hamilton, Waikato Region, NZ

    Related jobs
    • Promoted
    Freelance Chemistry Expert - Quality Assurance (AI Trainer)

    Freelance Chemistry Expert - Quality Assurance (AI Trainer)

    MindriftWorkFromHome, Waikato, New Zealand
    Freelance Chemistry Expert – Quality Assurance (AI Trainer).Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may af...Show moreLast updated: 4 days ago
    • Promoted
    Remarkable AI Expert

    Remarkable AI Expert

    Remarkable AIWorkFromHome, Waikato, New Zealand
    Become a Customer Support Expert for brands you love!.Remarkable AI Experts are freelance customer support agents who help companies provide the best support for their customers through social chan...Show moreLast updated: 22 days ago
    • Promoted
    Engineering Director - AI Platform (ANZ Remote)

    Engineering Director - AI Platform (ANZ Remote)

    CanvaWorkFromHome, Waikato, New Zealand
    Engineering Director - AI Platform (ANZ Remote).Join the team redefining how the world experiences design.Hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte! Thanks for stopping by.We know job huntin...Show moreLast updated: 7 days ago
    • Promoted
    Lead Product Manager - Gen AI

    Lead Product Manager - Gen AI

    EnvatoWorkFromHome, Waikato, New Zealand
    Envato is a purpose-driven company empowering creatives to thrive.As our Lead Product Manager for GenAI, you will own the end-to-end direction and delivery for Envato's AI-powered tools.This is a h...Show moreLast updated: 30+ days ago
    • Promoted
    Division CFO, Trilogy (Remote) - $400,000 / year USD

    Division CFO, Trilogy (Remote) - $400,000 / year USD

    TrilogyWorkFromHome, Waikato, New Zealand
    Division CFO, Trilogy (Remote) - $400,000 / year USD.Division CFO, Trilogy (Remote) - $400,000 / year USD.This range is provided by Trilogy. Your actual pay will be based on your skills and experience —...Show moreLast updated: 11 days ago
    • Promoted
    Data Scientist / Algorithm Engineer (LLM) – AI Safety

    Data Scientist / Algorithm Engineer (LLM) – AI Safety

    BinanceWorkFromHome, Waikato, New Zealand
    Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 280 million people in 100+ countrie...Show moreLast updated: 6 days ago
    • Promoted
    Implementation Lead, Mid Market

    Implementation Lead, Mid Market

    Case IQWorkFromHome, Waikato, New Zealand
    Implementation Lead, Mid Market.Case IQ helps companies protect their employees, culture, and business through world-class software for uncovering, investigating, and preventing fraud, ethics, hara...Show moreLast updated: 18 days ago
    • Promoted
    AI Engineer – Remote Project

    AI Engineer – Remote Project

    TwineWorkFromHome, Waikato, New Zealand
    Join a dynamic project focused on leveraging artificial intelligence to drive innovation.This opportunity is ideal for those seeking to contribute to a single project with the possibility of ongoin...Show moreLast updated: 3 days ago
    • Promoted
    Technical Lead

    Technical Lead

    ReadyTechWorkFromHome, Waikato, New Zealand
    ReadyTech is an ASX-listed company delivering mission-critical software that empowers communities to thrive.We re-imagine, design, develop and deliver technology to solve our customers’ diverse pro...Show moreLast updated: 16 days ago
    • Promoted
    AI Agent Evaluation Analyst

    AI Agent Evaluation Analyst

    MindriftWorkFromHome, Waikato, New Zealand
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Show moreLast updated: 7 days ago
    • Promoted
    Quality Release Lead

    Quality Release Lead

    The a2 Milk CompanyPokeno, Waikato, New Zealand
    We’re excited to share that our business has recently joined the a2 Milk Company family.Formerly known as Yashili Dairy NZ Ltd, we are now operating as a2 Nutritionals NZ Limited, based in Pokeno.T...Show moreLast updated: 15 days ago
    • Promoted
    Freelance Mechanical Engineer - Quality Assurance (AI Trainer)

    Freelance Mechanical Engineer - Quality Assurance (AI Trainer)

    MindriftWorkFromHome, Waikato, New Zealand
    Freelance Mechanical Engineer - Quality Assurance (AI Trainer).This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates.Ple...Show moreLast updated: 2 days ago
    • Promoted
    Freelance Civil Engineer - Quality Assurance (AI Trainer)

    Freelance Civil Engineer - Quality Assurance (AI Trainer)

    MindriftWorkFromHome, Waikato, New Zealand
    Freelance Civil Engineer - Quality Assurance (AI Trainer).Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates curr...Show moreLast updated: 7 days ago
    • Promoted
    Value Stream Lead – Customer Experience

    Value Stream Lead – Customer Experience

    GallagherWorkFromHome, Waikato, New Zealand
    Our purpose at Gallagher is ‘Protect what matters most’ and we live it every day, whether that’s protecting the world’s highest security environments or agricultural businesses, we care deeply abou...Show moreLast updated: 22 days ago
    • Promoted
    Freelance Developer Consultant (Ruby) - Quality Assurance (AI Trainer)

    Freelance Developer Consultant (Ruby) - Quality Assurance (AI Trainer)

    MindriftWorkFromHome, Waikato, New Zealand
    Freelance Developer Consultant (Ruby) - Quality Assurance (AI Trainer).Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. This opportunity is only for ca...Show moreLast updated: 7 days ago
    • Promoted
    Threat Intelligence Lead

    Threat Intelligence Lead

    CanonicalWorkFromHome, Waikato, New Zealand
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.The Threat Intelligence Lead will own Canonical's threat intelligence strategy and execution, includin...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Software Developer (Kotlin) - Quality Assurance (AI Trainer)

    Freelance Software Developer (Kotlin) - Quality Assurance (AI Trainer)

    MindriftWorkFromHome, Waikato, New Zealand
    Freelance Software Developer (Kotlin) - Quality Assurance (AI Trainer).This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and r...Show moreLast updated: 6 days ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    DatacomWorkFromHome, Waikato, New Zealand
    Datacom works with organisations and communities across Australia and New Zealand to make a difference in people’s lives and help organisations use the power of tech to innovate and grow.As an AI E...Show moreLast updated: 28 days ago
    • Promoted
    Implementation Lead

    Implementation Lead

    SmarterDxWorkFromHome, Waikato, New Zealand
    We’re looking for an Implementation Lead who knows revenue cycle management inside and out - and is eager to take hands-on ownership throughout the implementation, including some technical componen...Show moreLast updated: 22 days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    FederatoWorkFromHome, Waikato, New Zealand
    Federato is on a mission to defend the right to efficient, equitable insurance for all.We enable insurers to provide affordable coverage to people and organizations facing today’s issues—climate, c...Show moreLast updated: 30+ days ago