Principal / Senior Data Engineer (Data Platforms)
Christchurch, New Zealand – a boutique technology firm that specialises in data‑centric solutions across AI, machine learning, and software engineering.
Overview
As a Principal / Senior Data Engineer, you will design and build real‑time data pipelines and implement data mesh architectures for clients. The role blends deep technical expertise with a client‑facing consulting approach, delivering data‑driven solutions that produce tangible business outcomes.
Technical Responsibilities
- Developing Data Solutions : Build and enhance data‑driven solutions using Databricks, Snowflake, Google Cloud, AWS, and data‑mesh principles.
- Data Pipeline Development : Create and optimise high‑performance batch and real‑time pipelines with Kafka, Flink, Dataflow, and Airflow.
- Big Data Processing & Analytics : Leverage Spark, Flink, and other frameworks for large‑scale data processing.
- Cloud Data Management : Manage cloud services such as AWS Redshift, S3, Google BigQuery, and GCS to enable efficient data sharing.
- Security and Compliance : Embed security‐by‑design and compliance gates in all data infrastructure.
Consulting Responsibilities
Client Advisory : Advise clients on optimal data practices aligned with their business needs.Professional Development : Stay current with industry trends, pursue certifications, and educate client teams.Ideal Skills and Experience
Core Data Engineering Tools : SQL, Spark, Databricks, Snowflake; familiarity with AWS S3, GCP BigQuery, Cassandra, MongoDB, Neo4J, HDFS.Pipeline Orchestration : AWS Glue, Apache Airflow, DBT, Kafka, Kinesis, Pub / Sub, Event Hubs.Data Storage & Modelling : BigQuery, Snowflake, Databricks; Parquet, Delta, ORC, Avro, JSON.Infrastructure as Code : Terraform, Pulumi.Programming Languages : Python, SQL, (additional Java, Scala, Go, Rust a plus).CI / CD : GitHub Actions, ArgoCD.Agile Delivery : Scrum, Kanban.Consulting Skills : Experience in professional services, stakeholder engagement, translating business requirements.Professional Experience and Qualifications
8+ years data‑engineering experience in commercial or enterprise settings.Consulting background highly preferred.Degree or equivalent in computer science or related field.Full New Zealand working rights and residence in Christchurch required.Benefits
Our Christchurch office is a renovated former print‑house on St Asaph Street, shortlisted for NZIA Canterbury Interior Architecture 2024, providing a high‑quality, creative environment.
Seniority Level
Mid‑Senior levelEmployment Type
Full‑timeIndustries
IT Services and IT Consulting#J-18808-Ljbffr