Talent.com
This job offer is not available in your country.
English Language Specialist

English Language Specialist

iMerit TechnologyWorkFromHome, Taranaki, New Zealand
13 hours ago
Job description

Role Responsibilities

  • Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).
  • Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
  • Identify subtle errors, hallucinations, or biases in AI responses.
  • Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.
  • Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
  • Escalate unclear cases and contribute to refining evaluation guidelines.
  • Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.
  • Strong critical reading, observational, and evaluative skills across different modalities.
  • Ability to articulate nuanced judgments with precision and clarity.
  • Excellent English comprehension (CEFR B2 or above); additional languages a plus.
  • Familiarity with LLMs, generative AI, and multimodal systems.
  • Strong attention to detail and ability to apply guidelines consistently.
  • Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.
  • Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks.

Requirements

  • 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI / ML domains.
  • Demonstrated experience working with data annotation tools and software platforms.
  • Strong understanding of language and multimodal communication (instruction following in image generation, fact‑checking, narrative coherence in video, etc.).
  • Ability to adapt quickly to changing project directions and fast‑paced work environments.
  • Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.
  • Prior exposure to generative AI, prompt engineering, or LLM fine‑tuning workflows is a plus.
  • While moderation of high‑harm / high‑risk material is not part of this role, candidates should be aware that occasional exposure to NSFW or otherwise sensitive content may occur due to imperfections in client‑provided datasets. Applicants should indicate that they are comfortable working in environments where such incidental exposure is a possibility.

    What We Offer

  • Opportunities to shape the evaluation standards for next‑generation multimodal AI systems.
  • Innovative and supportive global working environment.
  • Competitive compensation and flexible remote working arrangements.
  • Continuous learning and growth in applied AI evaluation.
  • Join iMerit to help shape the benchmarks and standards that ensure AI systems are accurate, safe, and culturally aware across text, vision, and multimodal applications. If rigorous analysis and innovation excite you, we encourage you to apply!

    #J-18808-Ljbffr

    Create a job alert for this search

    English • WorkFromHome, Taranaki, New Zealand

    Related jobs
    • Promoted
    Country Manager - New Zealand

    Country Manager - New Zealand

    Twinkl LimitedWorkFromHome, Taranaki, New Zealand
    The following content displays a map of the jobs location - New Zealand.We're searching for a dynamic Country Manager with a strong educational background who can position Twinkl as the leading exp...Show moreLast updated: 30+ days ago
    • Promoted
    Mobility Specialist - APAC

    Mobility Specialist - APAC

    RemoteWorkFromHome, Taranaki, New Zealand
    Remote is solving modern organizations’ biggest challenge – navigating global employment compliantly with ease.We make it possible for businesses of all sizes to recruit, pay, and manage internatio...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Machine Learning Engineer

    Principal Machine Learning Engineer

    Vital.ioWorkFromHome, Taranaki, New Zealand
    We are looking for a Principal Machine Learning Engineer to join our remote-first team, in a New Zealand & Australia friendly timezone. You will be leading from the front on our ML efforts, ensuring...Show moreLast updated: 30+ days ago
    • Promoted
    English teacher

    English teacher

    Stratford High SchoolTaranaki, New Zealand
    Stratford High School Taranaki.We are seeking a talented and motivated English teacher to join our team.This is a full-time, permanent position, commencing at the start of term 1, 2026.Primary trai...Show moreLast updated: 30+ days ago
    • Promoted
    Translations Proofreader

    Translations Proofreader

    Volunteering NorthlandWorkFromHome, Taranaki, New Zealand
    Insight Endometriosis is a charity that supports people in New Zealand to make their own decisions about the treatment and management of their endometriosis. Each person's experience of endometriosi...Show moreLast updated: 30+ days ago
    • Promoted
    Chemistry Specialist | Upto $60 / hr Remote

    Chemistry Specialist | Upto $60 / hr Remote

    Crossing HurdlesWorkFromHome, Taranaki, New Zealand
    Crossing Hurdles is a recruitment firm.We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-edge AI models.Physics, Chemistry, A...Show moreLast updated: 9 days ago
    • Promoted
    Māori Language Specialist - AI Trainer

    Māori Language Specialist - AI Trainer

    Invisible AgencyWorkFromHome, Taranaki, New Zealand
    Are you an experienced Māori language professional eager to shape the future of AI? Large-scale language models are evolving rapidly, moving beyond simple chatbots into powerful engines of learning...Show moreLast updated: 30+ days ago
    • Promoted
    Sales Enablement Specialist

    Sales Enablement Specialist

    Employment HeroWorkFromHome, Taranaki, New Zealand
    Employment Hero is on a mission to make employment easier and more valuable for everyone.Our Employment Operating System brings hiring, HR, payroll and benefits into an all-in-one solution.Since ou...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior H&S Specialist - 10+ months Fixed Term

    Senior H&S Specialist - 10+ months Fixed Term

    Clarus CompanyNew Plymouth, Taranaki, New Zealand
    Senior H&S Specialist – 10+ months Fixed Term.Clarus, New Plymouth, Taranaki, New Zealand.Join the Clarus team and enjoy a career full of good energy and great rewards. At Clarus you’re part of a te...Show moreLast updated: 13 hours ago
    • Promoted
    Data Analytics Specialist (Remote)

    Data Analytics Specialist (Remote)

    Firefly Digital LimitedWorkFromHome, Taranaki, New Zealand
    In a few short years, Firefly Digital has grown to become one of New Zealand's top digital marketing agencies.We are a full-service digital performance agency that is growing FAST! And we've won a ...Show moreLast updated: 8 days ago
    • Promoted
    Physics Specialist | Upto $60 / hr Remote

    Physics Specialist | Upto $60 / hr Remote

    Crossing HurdlesWorkFromHome, Taranaki, New Zealand
    Crossing Hurdles is a recruitment firm.We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-edge AI models.Physics, Chemistry, A...Show moreLast updated: 9 days ago
    • Promoted
    Freelance Linguistics Specialist - English to Irish

    Freelance Linguistics Specialist - English to Irish

    Cactus CommunicationsWorkFromHome, Taranaki, New Zealand
    Freelance Linguistics Specialist - English to Irish.Job description : Freelance Linguistics Specialist.Editage, the flagship brand of CACTUS, is building a global pool of freelance contributors to s...Show moreLast updated: 25 days ago
    • Promoted
    English Dom – Online English Teacher English Dom

    English Dom – Online English Teacher English Dom

    VivaLingWorkFromHome, Taranaki, New Zealand
    The online English language school EnglishDom was founded in July 2007.Our main activity is the provision of English language learning services on Skype. At the moment we are leaders and one of the ...Show moreLast updated: 30+ days ago
    • Promoted
    Biology Specialist | $80 / hr Remote

    Biology Specialist | $80 / hr Remote

    Crossing HurdlesWorkFromHome, Taranaki, New Zealand
    Biology Specialist | $80 / hr Remote.Crossing Hurdles is a recruitment firm.We refer top candidates to our partners working with the world’s leading AI research labs to help build and train cutting-e...Show moreLast updated: 1 day ago
    • Promoted
    LMS Operations Specialist

    LMS Operations Specialist

    University PartnershipsWorkFromHome, Taranaki, New Zealand
    UP Education is a leading Australasian dual-sector education group, delivering foundation, vocational and higher education to domestic and international students. At UP Education, we are on a missio...Show moreLast updated: 30+ days ago
    • Promoted
    Remarkable AI Expert

    Remarkable AI Expert

    Remarkable AIWorkFromHome, Taranaki, New Zealand
    Become a Customer Support Expert for brands you love.Chatdesk (DBA Remarkable AI) Experts are freelance customer support agents who help companies provide the best support for their customers throu...Show moreLast updated: 16 days ago
    • Promoted
    Teach English in China! Training and Full Support Provided

    Teach English in China! Training and Full Support Provided

    English 1WorkFromHome, Taranaki, New Zealand
    Join English 1 to teach in China.Teaching English in China with training and full support provided.Teach English to kids aged 3-16. Do lesson planning and delivery.Leverage English 1's award-winning...Show moreLast updated: 30+ days ago
    • Promoted
    Home-Based Travel Specialist

    Home-Based Travel Specialist

    Live the Dash TravelWorkFromHome, Taranaki, New Zealand
    We are seeking a creative and detail-oriented.In this fully remote role, you will collaborate with clients to craft personalized travel experiences from start to finish. If you love planning, have a...Show moreLast updated: 30+ days ago