Leonard Curtis

Data Engineer

Leonard Curtis Whitefield, Scotland, United Kingdom

Financial Services · 201-500 employees

Yesterday
data-engineer Mid (2-5 yrs) Full-time United Kingdom
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

The Data Engineer will build, maintain, and optimize robust data pipelines using Microsoft Fabric and Databricks. They are responsible for developing efficient ETL/ELT workflows and implementing data governance and quality checks.

What they look for

PySpark Databricks SQL T-SQL Delta Lake Microsoft Fabric ETL ELT Data pipelines Parquet JSON CSV Data orchestration Delta Live Tables Unity Catalog Power BI CI/CD

Requirements

Candidates must have strong proficiency in PySpark, Databricks SQL, and T-SQL with hands-on experience in production pipeline development. Practical knowledge of structural data formats and cloud-based orchestration tools is essential for this role.

Benefits

25 days holiday allowance Birthday leave Hybrid working Flexible benefit and well-being schemes Long-term incentive plan Enhanced family friendly policies Enhanced maternity pay Giving back days

Full description

We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.

  • Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats
  • Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities
  • Practical knowledge of structural data formats including Parquet, JSON, and CSV
  • Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment
  • Familiarity with unit testing data pipelines and implementing automated data quality checks
  • Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows
  • Implement Delta Live Tables (DLT) to automate batch and real-time streaming data processing
  • Build and maintain the Medallion Architecture silver & gold layer across shared storage
  • Write optimised transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL
  • Configure data access, masking, and governance policies within Databricks Unity Catalog.
  • Optimise Lakehouse table performance using Z-Order indexing, liquid clustering, and file compaction techniques
  • Deploy data pipelines using CI/CD frameworks, Git integration, and Databricks Asset Bundles (DABs)
  • Prepare finalised gold layer datasets to support real-time Power BI Direct Lake reporting model
  • Salary aligned with your skills and expertise
  • 25 days holiday allowance plus statutory public holidays and the option to purchase more
  • Long-term incentive plan (LTIP) – share in the company's growth (T&Cs apply)
  • Birthday leave
  • Hybrid working
  • Flexible benefit and well-being schemes
  • 2 giving back days per year. We encourage our team to support the wider community by providing paid leave to work with local charities or good causes
  • A hard working, fun and professional working environment
  • Enhanced family friendly policies, including enhanced Maternity pay

Leonard Curtis is a market leading professional services provider operating across the UK and offshore. Since our formation we’ve supported business owners and advisors by listening and offering practical solutions and tailored advice. Our expert team of specialists deliver positive strategic advice across restructuring and insolvency, funding, legal, business services and M&A advisory across 30 offices. A career with Leonard Curtis will open the door to varied career pathways.

We have built an environment that empowers you to express yourself to have confidence in who you are and what you’re capable of and develop the career you want.

Learning and Development

Leonard Curtis has a wealth of resources available to help you develop your career from the moment you join. Activities range from on-line learning modules to external training and qualifications.

Diversity and Inclusion

Diversity is a core business imperative of the Group. We are an equal opportunities employer which promotes inclusiveness and always employ the best professional for the job. Having a diverse workforce allows the Group to draw upon a range of different ideas and experiences which supports our business’s growth and creates an env

Similar roles