Lead Data Engineer

About the role

As Lead Data Engineer, you will combine hands-on development with technical leadership to advance our Databricks-based data platform. Working closely with engineers, architects, product owners, and business stakeholders, you will help translate business objectives into scalable data solutions and guide key technical decisions that balance short-term needs with long-term strategy.

What you'll do

In this role, you will serve as the technical authority within the data engineering team, driving best practices and ensuring the delivery of robust, high-quality solutions. You will contribute directly to development, define engineering standards, and mentor colleagues to strengthen the team's capabilities. As the primary point of contact for complex technical challenges, you will also help shape how data engineering is practiced across the organisation.

Your key responsibilities will include:

• Lead the design, development, and optimization of enterprise-scale data solutions on Databricks

• Design and implement scalable data ingestion frameworks for both batch and streaming workloads

• Own and evolve Databricks Asset Bundles / Declarative Automation Bundles, deployment pipelines, and multi-environment configurations

• Drive data governance initiatives through Unity Catalog, including access management, storage credentials, and metadata management

• Define and maintain engineering standards, including coding practices, code reviews, documentation, and data quality frameworks

• Mentor fellow data engineers and act as the primary technical escalation point for complex technical challenges

About you

You are a hands-on technical leader with end-to-end Databricks experience. You think beyond the task in front of you, taking a holistic view of the platform and making architectural decisions with scalability and the broader data strategy in mind. You understand how the work delivered by the engineering team connects to business outcomes and can balance short-term delivery needs with long-term maintainability and governance requirements.

We imagine that you:

• Have extensive hands-on experience delivering production-grade solutions using Databricks

• Are highly proficient in Python, PySpark, and SQL, including complex transformations, performance optimization, and query design

• Have experience designing Databricks Asset Bundles and managing deployments across multiple environments

• Possess strong knowledge of Unity Catalog, data governance, access control, and data management best practices

• Have built and maintained CI/CD pipelines using GitHub Actions, Azure DevOps, or similar technologies

• Can communicate architectural decisions and tradeoffs clearly to both technical and non-technical stakeholders

Furthermore, it is an advantage if you:

• Have experience with Databricks AI/BI Dashboards, Genie, or semantic layer design

• Are familiar with Azure identity and secrets management, including Entra ID, OIDC federation, and Azure Key Vault

• Have experience incorporating GDPR and data confidentiality requirements into data engineering solutions

What we offer

At DLG, you will join a collaborative and ambitious organisation where data plays an increasingly important role in driving business value and innovation. We offer an exciting opportunity to influence our modern data platform and contribute to strategic initiatives across the business.

We provide a flexible and supportive work environment with excellent opportunities for professional development, knowledge sharing, and career growth. You will become part of a culture characterized by collaboration, trust, and continuous improvement.

Practical information

The position is full-time and based in either Fredericia or Flensburg. Start date is expected to be in October/November.

Please submit your CV - applications will be reviewed on an ongoing basis. We expect to invite for the first round of interviews in the beginning of August.

If you have any questions that are not answered in the above, please contact Head of Data Engineering, Thomas Nielsen, at thonie@dlg.dk