Talent.com
Lead Data Engineer

Lead Data Engineer

Astegic Inc.WorkFromHome, Auckland, New Zealand
1 day ago
Job description

JOB OVERVIEW :

The Lead Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up.

You will collaborate with our software engineers, database architects, data analysts and data scientists to ensure our data delivery architecture is consistent throughout the platform. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

What You’ll Be Doing :

  • Own the architecture and roadmap for scalable, secure, and high-quality data pipelines and platforms.
  • Lead and mentor a team of data engineers while establishing engineering best practices, coding standards, and governance models.
  • Design and implement high-performance ETL / ELT pipelines using modern Big Data technologies for diverse internal and external data sources.
  • Drive modernization initiatives including re-architecting legacy systems to support next-generation data products, ML workloads, and analytics use cases.
  • Partner with Product, Engineering, and Business teams to translate requirements into robust technical solutions that align with organizational priorities.
  • Champion data quality, monitoring, metadata management, and observability across the ecosystem.
  • Lead initiatives to improve cost efficiency, data delivery SLAs, automation, and infrastructure scalability.
  • Provide technical leadership on data modeling, orchestration, CI / CD for data workflows, and cloud-based architecture improvements.

Qualifications :

  • Bachelor’s degree in Engineering, Computer Science, or relevant field.
  • 8+ years of relevant and recent experience in a Data Engineer role.
  • 5+ years recent experience with Apache Spark and solid understanding of the fundamentals.
  • Deep understanding of Big Data concepts and distributed systems.
  • Demonstrated ability to design, review, and optimize scalable data architectures across ingestion.
  • Strong coding skills with Scala, Python and the ability to quickly switch between them with ease.
  • Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and / or MySQL.
  • Cloud Experience with DataBricks.
  • Strong understanding of Delta Lake architecture and working with Parquet, JSON, CSV, and similar formats.
  • Experience establishing and enforcing data engineering best practices, including CI / CD for data, orchestration and automation, and metadata management.
  • Comfortable working in an Agile environment.
  • Machine Learning knowledge is a plus.
  • Demonstrated ability to operate independently, take ownership of deliverables, and lead technical decisions.
  • Excellent written and verbal communication skills in English.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • REPORTING :

    This position will report to Sr. Technical Manager or Director of Engineering as assigned by Management.

    EMPLOYMENT TYPE : Full-Time, Permanent

    LOCATION : Remote (Pan India)

    SHIFT TIMINGS :

    10 : 00 AM – 07 : 00 PM IST

    WHO WE ARE :

    SalesIntel is the top revenue intelligence platform on the market. Our combination of automation and researchers allows us to reach 95% data accuracy for all our published contact data, while continuing to scale up our number of contacts. We currently have more than 5 million human‑verified contacts, another 70 million plus machine processed contacts, and the highest number of direct dial contacts in the industry. We guarantee our accuracy with our well‑trained research team that re‑verifies every direct dial number, email, and contact every 90 days. With the most comprehensive contact and company data and our excellent customer service, SalesIntel has the best B2B data available. For more information, please visit –

    WHAT WE OFFER :

    SalesIntel’s workplace is all about diversity. Different countries and cultures are represented in our workforce. We are growing at a fast pace and our work environment is constantly evolving with changing times. We motivate our team to better themselves by offering all the good stuff you’d expect like Holidays, Paid Leaves, Bonuses, Incentives, Medical Policy and company paid Training Programs.

    SalesIntel is an Equal Opportunity Employer. We prohibit discrimination and harassment of any type and offer equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • WorkFromHome, Auckland, New Zealand

    Related jobs
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Accenture New ZealandAuckland, Auckland, New Zealand
    Accenture is a leading global professional services company.We believe in inclusion and diversity and supporting the whole person. Our core values comprise of Stewardship, Best People, Client Value ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Intermediate

    Data Engineer - Intermediate

    Gentrack Ltd (Global)Auckland, Auckland, New Zealand
    Join Gentrack Ltd (Global) as a Data Engineer - Intermediate.We are entering a new era, with utilities worldwide transforming to meet business and sustainability targets. For over 35 years Gentrack ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Lotto New ZealandAuckland, Auckland, New Zealand
    Build and maintain data pipelines using Databricks and Azure tools.Transform raw data into structured, high-value assets for analytics. Collaborate with IT and Data & Analytics teams to meet busines...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VistaWorkFromHome, Auckland, New Zealand
    We're looking for a Data Engineer with a passion for continuous learning in an ever-changing and challenging technology landscape, who wants to deliver outstanding code and results.Sitting in Vista...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RandstadAuckland, Auckland, New Zealand
    Senior Data Engineer – Contract Role (Auckland-Based).Auckland | Contract | Immediate Start | Hybrid Working.Are you an experienced Senior Data Engineer looking to create meaningful impact through ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Engineer - Data Warehouse

    Lead Engineer - Data Warehouse

    KiwibankWorkFromHome, Auckland, New Zealand
    Banking benefits, flexible working options and more.Fixed Term Contract - 24 Months.Hei kawe i ngā mahi kia tutuki | This is us. Where making an impact matters.Kiwibank is challenging the status quo...Show moreLast updated: 1 day ago
    • Promoted
    Principal Engineer, Data Reliability

    Principal Engineer, Data Reliability

    XeroAuckland, Auckland, New Zealand
    Join to apply for the Principal Engineer, Data Reliability role at Xero.At Xero, we're here to help supercharge small businesses by automating routine tasks, surfacing actionable insights and conne...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer, Senior Consultant

    Data Engineer, Senior Consultant

    VisaAuckland, Auckland, New Zealand
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Robert Walters New ZealandAuckland, Auckland, New Zealand
    Work with cutting-edge Microsoft technologies, including Azure Databricks, Azure Data Factory, and Azure SQL in a collaborative environment that values continuous learning.You'll design and build r...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ASB BankAuckland, Auckland, New Zealand
    Ever wondered what it would be like to be the mastermind behind the data that drives our business forward? At ASB, we're all about empowering our people to make a real impact, and we're looking for...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Atomic Labs Ltd.WorkFromHome, Auckland, New Zealand
    Are you a highly skilled Senior Data Engineer looking for your next exciting challenge? We’re an NZ-based agency offering fully remote work, and we’re on the hunt for a talented individual to join ...Show moreLast updated: 1 day ago
    • Promoted
    Chapter Lead - Data / Analytics Engineering

    Chapter Lead - Data / Analytics Engineering

    ASB BankWorkFromHome, Auckland, New Zealand
    Chapter Lead - Data / Analytics Engineering.Join ASB as a Chapter Lead in our Data Engineering Chapter.Comprehensive banking & insurance benefits, career development opportunities.Here at ASB, the cu...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Robert Walters New ZealandWorkFromHome, Auckland, New Zealand
    An exciting opportunity has arisen for a Senior Data Engineer to join a forward-thinking organisation based in Auckland.Your expertise will directly empower business decision-making through robust,...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    New Zealand Media & Entertainment (NZME)WorkFromHome, Auckland, New Zealand
    NZME is on the hunt for a talented.This is your chance to architect and maintain the data platforms that power our business decisions, insights, and innovation. From cloud to on-premise, you’ll be a...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer, Senior Consultant

    Data Engineer, Senior Consultant

    TinkAuckland, Auckland, New Zealand
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Astegic Inc.WorkFromHome, Auckland, New Zealand
    The Senior Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.The ideal candidate...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DigitalgarageAuckland, Auckland, New Zealand
    This is a fantastic Senior Data Engineer contracting opportunity, migrating on-prem to Azure Cloud and implementing Fabric. You'll be stepping into a massive cloud migration project, helping to move...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Engineer

    Lead Engineer

    Southern Cross Health InsuranceAuckland, Auckland, New Zealand
    Southern Cross Health Insurance.We're a not-for-profit organisation on a mission to transform ourselves and empower New Zealanders to live their healthiest lives. With almost a million members in ou...Show moreLast updated: 12 days ago