JobCubby JobCubby
Sign up
Sabenza IT & Recruitment

Senior Data Engineer – Channel & Data Insights

Sabenza IT & Recruitment City of Johannesburg Metropolitan Municipality, Gauteng, South Africa · ZAR 1M/yr

IT Services and IT Consulting · 11-50 employees

13 h ago
data-engineer Senior (5-10 yrs) Contractor South Africa
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, build, and optimize robust data platforms and pipelines using the Microsoft Azure data estate. Collaborate with stakeholders to deliver scalable data products and ensure high-quality, secure data governance.

What they look for

Microsoft Fabric Azure Data Factory Databricks T-SQL Python Apache Spark Data Modeling ETL/ELT Azure Synapse Analytics CI/CD Infrastructure-as-Code Data Governance Microsoft Purview Data Warehousing Agile Data Engineering

Requirements

Requires 7-8 years of experience in platform and data engineering with deep expertise in Azure data services. Proficiency in T-SQL, Python, Apache Spark, and modern data modeling techniques like Kimball or Data Vault 2.0 is essential.

Full description

Our client is seeking a Senior Data Engineer to join the Channel & Data Insights team of a leading organisation in South Africa.

In this role you will design, build and optimise robust data platforms and pipelines that power critical channel and business insights. Working primarily on the Microsoft Azure data estate (including Microsoft Fabric), you will deliver scalable ETL/ELT solutions, modern data models and reliable data products that enable decision-making across the business.

Key Responsibilities

  • Design, develop and maintain scalable data platforms and pipelines using Microsoft Fabric (Lakehouse, Warehouse, Data Pipelines, notebooks, semantic models), Azure Data Factory, Databricks, ADLS Gen2, Azure Synapse Analytics, Event Hubs and Stream Analytics.
  • Implement robust ETL/ELT processes and modern data modelling approaches (Kimball and/or Data Vault 2.0) to support analytical and operational reporting needs.
  • Develop and optimize data transformations and processing logic using T-SQL, Python and Apache Spark.
  • Build and maintain CI/CD pipelines and Infrastructure-as-Code solutions (Bicep, ARM, PowerShell/CLI) via Azure DevOps to ensure reliable, repeatable deployments.
  • Apply data governance practices using tools such as Databricks Unity Catalog and/or Microsoft Purview to support data quality, lineage, security and compliance.
  • Collaborate closely with data analysts, product owners and business stakeholders to translate requirements into technical solutions and deliver measurable insights.
  • Monitor, troubleshoot and continuously improve platform performance, reliability and cost efficiency in an Agile delivery environment.
  • Contribute to best-practice standards, documentation and knowledge sharing within the data engineering team.

Requirements

7–8 years of solid hands-on experience as a platform and data engineer (intermediate to senior level).

Strong expertise across the Azure data platform, particularly Microsoft Fabric (Lakehouse, Warehouse, Data Pipelines, notebooks, semantic models), Azure Data Factory, Databricks, ADLS Gen2, Azure Synapse Analytics, Event Hubs and Stream Analytics.

Proven experience in ETL/ELT design, data modelling (Kimball and/or Data Vault 2.0) and data warehousing.

Strong proficiency in T-SQL, Python and Apache Spark.

Practical experience with Azure DevOps, CI/CD pipelines and Infrastructure-as-Code (Bicep, ARM, PowerShell/CLI).

Exposure to data governance tooling such as Databricks Unity Catalog and/or Microsoft Purview.

Experience working in Agile environments with strong communication and stakeholder engagement skills.

Advantageous: Relevant Azure certifications (AZ-900 plus one of DP-600 / DP-700 / DP-203) and prior financial services domain experience.

Similar roles