Senior Data Engineer (Medallion Architecture)
Develop and maintain data pipelines across the medallion lifecycle :
- Bronze : raw data ingestion
- Gold : consumption‑ready data for analytics / BI
Build scalable, reliable, and secure pipelines using Spark , Databricks , or similar frameworks.
Implement DataOps practices , Infrastructure‑as‑Code, and observability solutions to ensure smooth data operations.
Develop data models using best practices such as Data Vault 2.0 , Kimball , etc.
Co‑develop master and reference data tables, ensuring alignment with enterprise data governance standards.
Support mapping of the Data Estate, covering multiple functions like HR, Finance, Product, Infrastructure, etc.
Job Description
Data Engineering & Pipeline DevelopmentDevelop and maintain data pipelines across the medallion lifecycle :
Bronze : raw data ingestion
Silver : cleaned / transformed dataGold : consumption‑ready data for analytics / BIBuild scalable, reliable, and secure pipelines using Spark , Databricks , or similar frameworks.Implement DataOps practices , Infrastructure‑as‑Code, and observability solutions to ensure smooth data operations.Data Modeling & ArchitectureDevelop data models using best practices such as Data Vault 2.0 , Kimball , etc.
Co‑develop master and reference data tables, ensuring alignment with enterprise data governance standards.Support mapping of the Data Estate, covering multiple functions like HR, Finance, Product, Infrastructure, etc.Data Governance & QualityImplement and enforce data governance policies, including access control and security for sensitive data.
Co‑develop data quality pipelines to monitor and remediate issues in collaboration with domain data owners and stewards.Publish curated data assets on the data catalog for organizational use.Platform Reliability & SecurityEnsure the reliability and security of the Data Platform to minimize downtime for critical data products.
Serve as a subject‑matter expert (SME) on the platform stack : Databricks, Tableau, MicroStrategy, and similar technologies.Conduct feasibility assessments, POCs, and production rollouts of industry‑leading tools (e.g., dbt, Neo4j, Fivetran, Apache Atlas).Advisory & CollaborationProvide expert guidance on building, maintaining, and optimizing data pipelines.
Develop domain‑specific expertise in various functions and support cross‑functional data initiatives.Collaborate closely with the data governance team, analytics teams, and business stakeholders to drive adoption of best practices.Must‑Have Skills / Experience
Data Engineering & PipelinesExperience with Spark and Databricks for building and maintaining data pipelines.
Knowledge of medallion architecture (Bronze → Silver → Gold).Hands‑on with ETL / ELT processes and DataOps practices .Data Modeling & ArchitectureExperience with Data Vault 2.0 , Kimball , or other data modeling frameworks.
Ability to design and maintain master and reference data tables.Data Governance & QualityFamiliarity with data governance policies , access control, and security best practices.
Experience building or supporting data quality pipelines .Ability to publish curated datasets to a data catalog .Platform & Tool ExpertiseExperience with BI tools : Tableau, MicroStrategy.
Knowledge of data management or orchestration tools : dbt, Apache Atlas, Fivetran.Soft Skills & CollaborationAble to advise and mentor colleagues on data pipeline best practices .
Strong communication skills and ability to collaborate across multiple teams and business domains .Nice‑to‑Have / Bonus Skills
Exposure to Infrastructure‑as‑Code , monitoring, and observability for data platforms.Experience in public sector data initiatives.Domain expertise in HR, Finance, Product, or Infrastructure datasets .Conducting feasibility assessments, POCs, or production rollouts for enterprise‑grade data tools.Knowledge of security and reliability best practices for critical data products.This is a 1‑year Contract position under People Advantage (Certis Group). We appreciate your application and regret only shortlisted candidates will be notified.
By submitting your resume, you consent to the handling of your personal data in accordance with Certis Group Privacy Policy (
#J-18808-Ljbffr