Senior Data Engineer (Azure & Databricks)
Task Talent Recruitment Belgium
Staffing and Recruiting · 2-10 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design and build scalable data pipelines on the Microsoft Azure platform while creating efficient storage structures and materialized views. Contribute to data governance initiatives and mentor other data engineers to ensure high-quality data exchange endpoints.
What they look for
Requirements
Requires at least 5 years of hands-on data engineering experience with Microsoft Azure, Databricks, and PySpark. Candidates must possess expertise in SQL performance tuning and be able to work on-site in Brussels.
Full description
About the Role
We are looking for a Senior Data Engineer to build data pipelines, efficient storage structures and powerful materialized views across analytical technologies, as well as data exchange endpoints for end users. The role also involves working with data governance tools covering glossary, modelling, lineage and data quality.
Key Responsibilities
- Design and build scalable data pipelines on the Microsoft Azure data platform.
- Create efficient storage structures and materialized views across analytical technologies.
- Build and maintain data exchange endpoints for users.
- Develop lakehouse solutions with Databricks, PySpark, Delta Lake and medallion architecture.
- Orchestrate pipelines with Azure Data Factory.
- Optimize Azure SQL performance through execution plans, indexing, partitioning and advanced T-SQL.
- Contribute to data governance: glossary, modelling, lineage and data quality.
- Set up and follow version control, CI/CD, automated deployment and monitoring practices.
- Mentor data engineers and act as a technical reference for the team.
Requirements
Must Have
- At least 5 years of hands-on data engineering experience.
- At least 1 year leading, mentoring or coaching data engineers, or acting as a technical reference.
- Hands-on experience with Microsoft Azure data services and the Microsoft data platform.
- Hands-on Databricks, PySpark, Delta Lake, Delta tables and medallion architecture.
- Expertise in Azure SQL and SQL performance tuning: execution plans, indexing, wait statistics, partitioning, dimensional modelling and advanced T-SQL.
- Azure Data Factory for orchestration and pipeline development.
- Practical experience with Parquet files and lakehouse data storage.
- Version control, CI/CD, automated deployment and monitoring practices.
- Fluent English.
- Able to work on-site in Brussels.
Nice to Have
- Unity Catalog and data governance in Databricks.
- Kafka or event-driven data ingestion.
- Azure cost optimization, cluster optimization and FinOps practices.
- Azure DevOps, infrastructure-as-code and platform automation.
- Data quality, data lineage, access control and operational monitoring.
- German language skills.
What We Value
- Challenges ideas with rational, no-nonsense thinking.
- Looks at data across the whole enterprise, not in silos, to maximize coherence, reuse and adoption.
- Drives results through continuous improvement and an analytical approach.
- Customer- and product-oriented, with an iterative way of working.
- Team player who shares ideas openly and communicates well.
Key Skills
Azure Data Services, Databricks, PySpark, Delta Lake, Medallion Architecture, Azure SQL, SQL Performance Tuning, T-SQL, Azure Data Factory, Parquet, Lakehouse, CI/CD, Azure DevOps, Kafka, Unity Catalog, Data Governance, Data Quality, Data Lineage, FinOps.
Similar roles
-
R0173157 Data Engineer (A)
Aerodyne Industries, LLC Houston, Texas, United States · $84K–$100K/yr
-
Senior Data Engineer
AIR Communities Denver, Colorado, United States · $125K–$145K/yr
-
Senior Data Engineer
ZoomInfo Technologies LLC Toronto, Ontario, Canada
-
Lead Data Engineer
AIR Communities Denver, Colorado, United States · $135K–$160K/yr
-
Data Engineer
Shaker Recruitment Marketing Oak Park, Illinois, United States
-
Lead Data Engineer
PetSmart Phoenix, Arizona, United States