Talent.com
Lead Data Engineer
Lead Data EngineerAstegic Inc. • Auckland, Auckland, New Zealand
Lead Data Engineer

Lead Data Engineer

Astegic Inc. • Auckland, Auckland, New Zealand
12 days ago
Job description

JOB OVERVIEW :

The Lead Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up.

You will collaborate with our software engineers, database architects, data analysts and data scientists to ensure our data delivery architecture is consistent throughout the platform.

You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

What You'll Be Doing :

Own the architecture and roadmap for scalable, secure, and high-quality data pipelines and platforms.

Lead and mentor a team of data engineers while establishing engineering best practices, coding standards, and governance models.

Design and implement high-performance ETL / ELT pipelines using modern Big Data technologies for diverse internal and external data sources.

Drive modernization initiatives including re-architecting legacy systems to support next-generation data products, ML workloads, and analytics use cases.

Partner with Product, Engineering, and Business teams to translate requirements into robust technical solutions that align with organizational priorities.

Champion data quality, monitoring, metadata management, and observability across the ecosystem.

Lead initiatives to improve cost efficiency, data delivery SLAs, automation, and infrastructure scalability.

Provide technical leadership on data modeling, orchestration, CI / CD for data workflows, and cloud-based architecture improvements.

Qualifications :

Bachelor's degree in Engineering, Computer Science, or relevant field.

8+ years of relevant and recent experience in a Data Engineer role.

5+ years recent experience with Apache Spark and solid understanding of the fundamentals.

Deep understanding of Big Data concepts and distributed systems.

Demonstrated ability to design, review, and optimize scalable data architectures across ingestion.

Strong coding skills with Scala, Python and the ability to quickly switch between them with ease.

Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and / or MySQL.

Cloud Experience with DataBricks.

Strong understanding of Delta Lake architecture and working with Parquet, JSON, CSV, and similar formats.

Experience establishing and enforcing data engineering best practices, including CI / CD for data, orchestration and automation, and metadata management.

Comfortable working in an Agile environment.

Machine Learning knowledge is a plus.

Demonstrated ability to operate independently, take ownership of deliverables, and lead technical decisions.

Excellent written and verbal communication skills in English.

Experience supporting and working with cross-functional teams in a dynamic environment.

REPORTING :

This position will report to Sr.

Technical Manager or Director of Engineering as assigned by Management.

EMPLOYMENT TYPE : Full-Time, Permanent

LOCATION : Remote (Pan India)

SHIFT TIMINGS :

10 : 00 AM – 07 : 00 PM IST

WHO WE ARE :

SalesIntel is the top revenue intelligence platform on the market.

Our combination of automation and researchers allows us to reach 95% data accuracy for all our published contact data, while continuing to scale up our number of contacts.

We currently have more than 5 million human-verified contacts, another 70 million plus machine processed contacts, and the highest number of direct dial contacts in the industry.

We guarantee our accuracy with our well-trained research team that re-verifies every direct dial number, email, and contact every 90 days.

With the most comprehensive contact and company data and our excellent customer service, SalesIntel has the best B2B data available.

For more information, please visit – .

WHAT WE OFFER :

SalesIntel's workplace is all about diversity.

Different countries and cultures are represented in our workforce.

We are growing at a fast pace and our work environment is constantly evolving with changing times.

We motivate our team to better themselves by offering all the good stuff you'd expect like Holidays, Paid Leaves, Bonuses, Incentives, Medical Policy and company paid Training Programs.

SalesIntel is an Equal Opportunity Employer.

We prohibit discrimination and harassment of any type and offer equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

#J-

  • Ljbffr
Create a job alert for this search

Data Engineer • Auckland, Auckland, New Zealand

Related jobs
Senior Full Stack Engineer

Senior Full Stack Engineer

Idexx Laboratories • Auckland, Auckland, New Zealand
IDEXX Veterinary Software is on a mission to offer the first vertical SaaS platform for Animal Health.We're expanding our engineering tribes to tackle a range of challenges, particularly in Clinica...Show more
Last updated: 30+ days ago • Promoted
Category Finance Analyst

Category Finance Analyst

Kraft Heinz • WorkFromHome, Auckland, New Zealand
Kraft Heinz is one of the largest food and beverage companies in the world, with eight.Our brands are truly global, with products produced and marketed in more than 40 countries.These beloved produ...Show more
Last updated: 30+ days ago • Promoted
Volunteer Online as a Conversation Partner

Volunteer Online as a Conversation Partner

Enginprogram • WorkFromHome, Auckland, New Zealand
Volunteer Online as a Conversation Partner.ENGin pairs English‑fluent volunteers from around the world with Ukrainian learners for weekly online conversation practice. Participants are matched 1‑on‑...Show more
Last updated: 7 days ago • Promoted
Principal Engineer, Data Reliability

Principal Engineer, Data Reliability

Roman Health Pharmacy Llc • Auckland, Auckland, New Zealand
At Xero, we're here to help supercharge small businesses.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the right data, advisors and apps.When ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Skycity Adelaide • Auckland, Auckland, New Zealand
SkyCity Adelaide, a renowned hospitality destination in Australasia, is on the lookout for a Data Engineer to join their innovative ICT team. This role is essential for advancing data platform effic...Show more
Last updated: 30+ days ago • Promoted
Data Architect / Engineer - 12 Months Fixed Term

Data Architect / Engineer - 12 Months Fixed Term

Engendertechnologies • Auckland, Auckland, New Zealand
Build the Future of Data in Agri-Tech.At Engender, we're tackling one of the dairy industry's biggest challenges with world-first, laser-based sperm-sorting technology. Our work helps farmers improv...Show more
Last updated: 30+ days ago • Promoted
Market Development and Purchasing Lead

Market Development and Purchasing Lead

1881 Global • Auckland City, Auckland, New Zealand
Joining our company as a Market Development and Purchasing Lead for Papua New Guinea and the Pacific Islands.This role provides a chance to drive significant market expansion, lead.Fabrics and Fash...Show more
Last updated: 21 hours ago • Promoted • New!
Community Engineer (multiple roles and seniority levels)

Community Engineer (multiple roles and seniority levels)

Canonical • WorkFromHome, Auckland, New Zealand
Our ambition is to set a standard of excellence when it comes to serving the open source ecosystem.This is your chance to be a part of that as a. Community Engineer at Canonical.We are building comm...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Robert Walters New Zealand • Auckland, Auckland, New Zealand
Work with cutting-edge Microsoft technologies, including Azure Databricks, Azure Data Factory, and Azure SQL in a collaborative environment that values continuous learning.You'll design and build r...Show more
Last updated: 30+ days ago • Promoted
Freelance English Writer - AI Trainer

Freelance English Writer - AI Trainer

Mindrift • WorkFromHome, Auckland, New Zealand
Be among the first 25 applicants.Get AI‑powered advice on this job and more exclusive features.This opportunity is only for candidates currently residing in the specified country.Your location may ...Show more
Last updated: 21 days ago • Promoted
Tech Lead

Tech Lead

Mattr • Auckland, Auckland, New Zealand
At MATTR, we're trailblazing the frontier of digital trust.As a high-growth SaaS company, we're delivering cutting-edge decentralised identity solutions that empower global organisations to put ide...Show more
Last updated: 30+ days ago • Promoted
Infrastructure Team Lead

Infrastructure Team Lead

Foodstuffs North Island • Auckland, Auckland, New Zealand
Ko Waimatou – About Us Kia ora.You know New World, PAK'nSAVE and Four Square right?.With 300+ stores and over 24,000 Foodies across Te Ika-a-Maui, our North Island Co-op has the privilege of helpin...Show more
Last updated: 9 hours ago • Promoted • New!
Freelance AI / ML Penetration Tester

Freelance AI / ML Penetration Tester

Mindrift • WorkFromHome, Auckland, New Zealand
At Mindrift, innovation meets opportunity.We believe in using the power of collective intelligence to ethically shape the future of AI. The Mindrift platform connects specialists with AI projects fr...Show more
Last updated: 21 days ago • Promoted
Associate Account Development Representative - ANZ

Associate Account Development Representative - ANZ

Camunda • WorkFromHome, Auckland, New Zealand
Associate Account Development Representative – ANZ.By creating production-ready, enterprise-grade agents with built-in governance, Camunda uniquely delivers trusted AI agents for business-critical ...Show more
Last updated: 30+ days ago • Promoted
Business Development Manager

Business Development Manager

Think Momentum • WorkFromHome, Auckland, New Zealand
READY TO DO THINGS DIFFERENTLY?.Are you a talented Business Development Manager ready to advance your career in the Personal Development Industry? Look no further – full training provided.Welcome t...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

SkyCity Adelaide • Auckland, Auckland, New Zealand
SkyCity Adelaide, a renowned hospitality destination in Australasia, is on the lookout for a Data Engineer to join their innovative ICT team. This role is essential for advancing data platform effic...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Absolute It • Auckland, Auckland, New Zealand
Deliver robust data solutions for enterprise-scale environments Work with SQL, Python, and modern cloud technologies Contract role supporting advanced data and AI initiatives About the Organisation...Show more
Last updated: 21 hours ago • Promoted • New!
Senior / Tech Lead - AI Development

Senior / Tech Lead - AI Development

Datacom • Auckland, Auckland, NZ
Quick Apply
Here at Datacom we connect people and technology in order to solve challenges, create opportunities and discover new possibilities for the communities we live in. The way we work and our customer ne...Show more
Last updated: 30+ days ago