Senior Data Engineer

ABOUT THE ROLE

We are looking for a Senior Data Engineer with strong Microsoft Fabric expertise to join a fast-growing data engineering team. You will be responsible for designing, building, and optimizing data solutions on the Microsoft Fabric platform — working across the full data engineering lifecycle from ingestion to serving.

The ideal candidate brings deep hands-on experience with Fabric, a strong engineering mindset, and the ability to work independently in a collaborative, delivery-focused environment.

WHAT YOU WILL DO

• Design and build end-to-end data pipelines using Microsoft Fabric Data Factory

• Develop and maintain Fabric Spark Notebooks for data transformation and processing

• Migrate legacy data pipelines and workloads onto the Microsoft Fabric platform

• Implement and manage data warehouse solutions using Fabric Warehouse and OneLake

• Build and maintain Medallion architecture (Bronze / Silver / Gold) on OneLake

• Design and implement SCD Type 1/2 patterns and complex transformation logic in PySpark and T-SQL

• Develop and maintain CI/CD workflows using Fabric Deployment Pipelines and Azure DevOps

• Collaborate with architects and business stakeholders to translate requirements into scalable data solutions

• Ensure data quality through reconciliation, testing, and validation across environments

• Support UAT, parallel run activities, and production cutover cycle

REQUIRED SKILLS

• Microsoft Fabric — Fabric Data Factory, Spark Notebooks, Fabric Warehouse, OneLake, Deployment Pipelines

• Azure Data Factory —pipelines, master/child patterns, Copy / Lookup / ForEach / Stored Procedure activities

• PySpark and Python — Delta Lake read/write, transformation logic, file I/O on OneLake / ADLS

• T-SQL — complex stored procedures, MERGE, SCD logic, dynamic SQL

• Medallion architecture (Bronze / Silver / Gold) implementation on Fabric or Databricks

• Databricks — notebooks, dbutils, workspace files, cluster configuration

• CI/CD with Azure DevOps and Git — branching strategy, PR-gated deployments, environment promotion

• Experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing and Data Integration Solutions and ETL data pipelines

• 5+ years in data engineering with at least 1 year hands-on in Microsoft Fabric

NICE TO HAVE

• Microsoft Fabric certification (DP-700 or equivalent)

• Experience migrating from Databricks or ADF to Microsoft Fabric

• Financial services or investment data domain knowledge

• Microsoft Purview — lineage, sensitivity labels, workspace scanning

• Power BI Direct Lake mode and semantic model design

• Experience in ETL design and development, Data Quality, and Data Engineering using Informatica.