Talent.com
This job offer is not available in your country.
Ai Quality Assurance Automation Engineer (Permanent) - Wellington

Ai Quality Assurance Automation Engineer (Permanent) - Wellington

DatacomWellington, Wellington, New Zealand
30+ days ago
Job description

OverviewAI Quality Assurance Automation Engineer (Permanent) – Wellington.

Join a Digital Engineering team delivering innovative AI-driven software solutions.

You will work on cutting-edge projects, collaborating with cross-functional teams to design, develop, and deploy AI models that address complex business challenges.

This role requires a strong software background and a passion for AI.ResponsibilitiesAI QA Solutions Development : Design, develop, and implement advanced AI-powered QA automation solutions for testing AI-based applications, models, and systems.

Identify performance bottlenecks, inconsistencies, and model biases.Test Automation & Frameworks : Build and maintain automated test frameworks for AI systems using tools such as Playwright, Appium, Pytest, or custom AI testing tools.

Ensure scalability, reusability, and adherence to best practices.

Senior automation coding skills in Python, TypeScript, Java, or C#.

AI Model Testing : Perform functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness.

Conduct regression testing and validate behavior across different scenarios.Adopt AI Innovations : Stay up to date with AI advancements and adopt emerging AI technologies to improve QA processes (e.g., GPT models, neural networks, reinforcement learning).

Cloud and On-Premise AI Services : Test and validate AI solutions hosted on cloud platforms (AWS, Azure, Google Cloud) and on-premise services; ensure optimal performance across environments.Cross-functional Collaboration : Work with AI developers, data scientists, and product teams to identify testing requirements, troubleshoot issues, and provide QA insights on solution design.Continuous Improvement : Implement and continuously improve testing methodologies for AI systems; drive automation efficiency and align with rapid AI development cycles.Pipeline Development : Describe and demonstrate the value of test automation pipelines for AI solutions using PaaS (e.g., Azure DevOps, GitHub Actions).

Quality Metrics & Reporting : Establish quality metrics, track progress, and report on testing outcomes, issues, and resolutions; maintain clear documentation.Communication : Communicate abstract concepts and value points clearly to stakeholders, both in writing and verbally.Skills & QualificationsExperience : 4–5 years in test automation with a focus on AI / ML applications; proven ability to build automated frameworks.Technical Skills : Proficient in Python, C#, Java, or TypeScript with strong Python experience; hands-on with Selenium, Appium, Pytest, or similar frameworks.Cloud & On-Premise AI : Experience with cloud AI services (AWS AI / ML, Azure Cognitive Services, Google Cloud AI) and on-premise AI solutions.Version Control & CI / CD : Knowledge of Git and CI / CD pipelines for automated testing.AI / ML Knowledge : Basic understanding of AI / ML concepts, data preprocessing, model training, evaluation metrics, and model fairness; experience testing AI systems (model validation and performance).

Analytical & Problem-Solving : Strong analytical skills to assess AI performance, debug issues, and improve test coverage.Learning & Adaptability : Ability to stay current with AI trends and quickly adopt new tools and methodologies.Collaboration & Communication : Excellent teamwork and the ability to explain technical concepts to technical and non-technical stakeholders.Preferred QualificationsExperience with on-premise AI services and hybrid deployments.Familiarity with AI ethics, fairness, and bias testing methodologies.Experience with test-driven development (TDD) or behavior-driven development (BDD) in AI projects.Why join usBe part of a dynamic, forward-thinking team pushing the boundaries of AI technology.Environment that encourages innovation and continuous learning.Opportunity to lead in AI QA and directly impact the quality of AI products.Competitive salary and benefits package.

#J-18808-Ljbffr

Create a job alert for this search

Automation Engineer • Wellington, Wellington, New Zealand

Related jobs
  • Promoted
Ai Quality Assurance Automation Engineer

Ai Quality Assurance Automation Engineer

DatacomWellington, Wellington, New Zealand
The way we work and our customer needs are changing!.We are going through a huge AI uplift that will be a real game changer in the NZ Market. Our customers are loving our story and excited about our...Show moreLast updated: 30+ days ago
Senior Quality Assurance Automation Engineer - permanent

Senior Quality Assurance Automation Engineer - permanent

DatacomWellington, Wellington Region, NZ
Quick Apply
With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and...Show moreLast updated: 20 days ago
  • Promoted
Cook

Cook

Dhiya LimitedLower Hutt, Wellington, New Zealand
We are looking for Cook for a busy Restaurant in Wellington Region.Great opportunity to work with a friendly team in a busy workplace. Preparing awesome ethnic meals and Tandoori foods for our custo...Show moreLast updated: 25 days ago
  • Promoted
Managers required

Managers required

SBNH Foods LimitedLower Hutt, Wellington, New Zealand
Are you passionate about pizza and leadership? Domino's Pizza is looking for a Store Manager & 2 dedicated Shift Managers to join our dynamic teams in . Kilbernie and Newtown, Wellington! If you thr...Show moreLast updated: 17 days ago
  • Promoted
Ai Solution Specialist - Manager

Ai Solution Specialist - Manager

Pwc New ZealandWellington, New Zealand
OverviewAI Solution Specialist - Manager at PwC New Zealand.Join our Digital, Data & Technology (DDT) team as an AI Solutions Architect at Manager level to shape practical, secure and scalable AI-e...Show moreLast updated: 5 days ago
  • Promoted
Test Lead

Test Lead

New Zealand GovernmentWellington, New Zealand
The Civil Aviation Authority and the Aviation Security Service offer distinctively different career opportunities and embrace diverse talent. All jobs at the Authority contribute to ensuring safe an...Show moreLast updated: 8 days ago
  • Promoted
Senior Test Automation Engineer

Senior Test Automation Engineer

Robert Walters New ZealandWellington, New Zealand
You will play a pivotal role in shaping quality assurance practices, driving automation initiatives, and supporting the ongoing evolution of technical processes. The organisation is committed to fos...Show moreLast updated: 30+ days ago
Senior Quality Assurance Automation Engineer - PERM

Senior Quality Assurance Automation Engineer - PERM

DatacomWellington, Wellington Region, NZ
Quick Apply
Datacom works with organisations and communities across Australia and New Zealand to make a difference in people’s lives and help organisations use the power of tech to innovate and grow.The Senior...Show moreLast updated: 20 days ago
Contract - Senior Quality Assurance Automation Engineer - Immediate start

Contract - Senior Quality Assurance Automation Engineer - Immediate start

DatacomWellington, Wellington Region, NZ
Quick Apply
With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and...Show moreLast updated: 20 days ago
  • Promoted
Test Lead

Test Lead

ResyncWellington, New Zealand
Wellington, New Zealand | Posted on 13 / 08 / 2025.Resync Consulting Limited is seeking an experienced Test Lead with a strong background in leading small teams and exceptional communication skills to ...Show moreLast updated: 30+ days ago
  • Promoted
Senior Automation Tester

Senior Automation Tester

Bnz Life Insurance LimitedWellington, New Zealand
Senior Automation Tester page is loaded## Senior Automation Testerremote type : Hybrid Rolelocations : BNZ Place Wellington, 1 Whitmore Streettime type : Full timeposted on : Posted Todaytime left to a...Show moreLast updated: 4 days ago
AI Quality Assurance Automation Engineer

AI Quality Assurance Automation Engineer

DatacomWellington, Wellington Region, NZ
Quick Apply
The way we work and our customer needs are changing! We are going through a huge AI uplift that will be a real game changer in the NZ Market. Our customers are loving our story and excited about our...Show moreLast updated: 20 days ago
  • Promoted
Senior Qa Engineer

Senior Qa Engineer

KiwibankWellington, New Zealand
Wellington / Auckland / Christchurch based opportunity.Banking benefits, flexible working options and more!.Fixed Term Contract - 12 Months. Hei kawe i nga mahi kia tutuki | This is us.Where making an i...Show moreLast updated: 30+ days ago
  • Promoted
Quality Assurance Coordinator

Quality Assurance Coordinator

Tyler WrenWellington, New Zealand
OverviewLooking to step up from adviser support, FAP operations, or a financial services role into compliance?.This is a fantastic opportunity to do just that. We're representing our client in their...Show moreLast updated: 3 days ago
  • Promoted
Senior Automation Tester

Senior Automation Tester

Comspek InternationalWellington, New Zealand
Are you passionate about delivering high-quality digital experiences and driving excellence in agile testing practices?.We're looking for a Senior QA Engineer to join our client's dynamic team and ...Show moreLast updated: 30+ days ago
  • Promoted
Ai Solution Specialist - Manager

Ai Solution Specialist - Manager

PwcWellington, New Zealand
Management LevelManagerJob Description & SummaryKia Ora,It's an incredibly exciting time to join PwC New Zealand.We're investing in the digital upskilling of all our staff, putting technology at th...Show moreLast updated: 9 days ago
  • Promoted
Ai Data Specialist - New Zealand

Ai Data Specialist - New Zealand

Rws TrainaiWellington, New Zealand
Part-time - 10+ hours per week.Flexible - work whenever you want.Until the end of December 2025 (an extension is possible). The role involves performing diverse data-related tasks, including : .Data c...Show moreLast updated: 3 days ago
AI Quality Assurance Lead

AI Quality Assurance Lead

DatacomWellington, Wellington Region, NZ
Quick Apply
With over 6,200 people, and centre’s of technical excellence spread across Australasia, Datacom is committed to developing and growing its capability across Asia. Founded in 1965 in New Zealand, and...Show moreLast updated: 20 days ago