AI Quality Assurance Automation Engineer

Overview

The way we work and our customer needs are changing! We are going through a huge AI uplift that will be a real game changer in the NZ Market. Our customers are loving our story and excited about our new service solutions. We are seeking AI Quality Assurance Automation Engineers who want to join our journey. You will join our Digital Engineering team, focusing on delivering innovative AI-driven software solutions. This role offers the opportunity to work on cutting-edge projects, collaborating with cross-functional teams to design, develop, and deploy advanced AI models that address complex business challenges. We need multiple people now, so this is your chance to put a New Zealand company on the global map!

Responsibilities

• AI QA Solutions Development : Design, develop, and implement advanced AI-powered QA automation solutions for testing AI-based applications, models, and systems. Identify performance bottlenecks, inconsistencies, and model biases using innovative techniques
• Test Automation & Frameworks : Build and maintain automated test frameworks for AI systems using tools such as Playwright, Appium, pytest, or custom-built AI testing tools. Ensure scalability, reusability, and alignment with industry best practices. Senior test automation coding skills in Python, TypeScript, Java, or C#
• AI Model Testing : Perform functional and non-functional testing of AI models to assess accuracy, bias, scalability, and robustness. Conduct regression testing and ensure AI solutions behave as expected across different scenarios
• Adopt AI Innovations : Stay up to date with the latest AI advancements and research. Actively explore and adopt emerging AI technologies (e.g., GPT models, neural networks, reinforcement learning) to continuously improve the quality assurance process
• Cloud and On-Premise AI Services : Test and validate AI solutions hosted on cloud platforms (AWS, Azure, Google Cloud) and on-premise AI services. Ensure optimal performance across environments
• Cross-functional Collaboration : Work with AI developers, data scientists, and product teams to identify testing requirements, troubleshoot issues, and improve overall AI system quality. Provide feedback and insights on AI solution design from a QA perspective
• Continuous Improvement : Implement and continuously improve testing methodologies for AI systems. Drive automation efficiency and effectiveness, ensuring testing is comprehensive and aligned with fast-paced AI development cycles
• Pipeline development : Describe and demonstrate the value of test automation pipelines with AI solutions using PaaS (e.g., Azure DevOps, GitHub Actions)
• Quality Metrics & Reporting : Establish key quality metrics, track progress, and report on the effectiveness of AI testing strategies. Maintain clear, concise, and actionable documentation and reports on test outcomes, issues found, and resolutions
• Communication Skills : Communicate abstract concepts and value points to stakeholders in terms that are understood

Skills & Qualifications

Preferred Qualifications

Why join us here at Datacom?

If you’re a proactive, tech-savvy AI QA engineer with a strong automation background and a passion for staying ahead of AI developments, we’d love to hear from you!

#J-18808-Ljbffr