About the role

The role involves designing and maintaining robust data engineering pipelines within cloud and on-premises environments to support analytics products. You will collaborate with technical teams to deliver end-to-end data solutions while ensuring data quality and security compliance.

What they look for

Data engineering Python SQL Azure Data Lake Azure Synapse Azure Data Factory Databricks Data pipeline design Database administration Data transformation Data security ETL ELT Data modelling DevOps CI/CD

Requirements

Candidates should have substantial experience in data pipeline management and strong proficiency in Python and SQL. Familiarity with the Microsoft data stack and agile project management principles is highly desirable.

Benefits

Flexi working

Full description

Job Requisition Number 9006

Work Type Permanent

Job Function Data / Knowledge Management

Salary Range £42,786.00 -£48,912.00

Base

Closing Date

Linea (St Mellons, Cardiff) - Hybrid Options

23:59 on 17 August 2026

What you’ll be responsible for

This is an exciting role that will allow you to be integral to the evolution of our cloud-based enterprise data platform. As a Data Engineer, you will be working on technical solutions, whilst supporting our existing set of SQL Servers that are predominantly used to feed data into a number of analytics products. This will help the business with data-led decision making to provide essential public services.

Your responsibilities will include:

Designing efficient and robust data engineering projects within both on-premises and cloud-based data stacks that add business value and comply with architectural and data security requirements.

Building, maintaining and supporting data engineering pipelines, with resolution of incidents.

End-to-end delivery of data engineering solutions, including data quality, testing, peer reviewing, documenting and demonstrating of completed solutions to the team.

Working closely with teams within data and other technical colleagues across the business.

Remaining aware of new data engineering approaches, and be able to suggest how the latest research, techniques and approaches could be implemented to achieve business benefit

Undertaking any other duties as required to meet the needs of the business.

About you

Essential Qualifications, Knowledge and Experience

Substantial experience of data pipeline design and management

Enthusiasm to add customer value whilst improving the effectiveness of the data engineering function

Proactive problem solving and being able to effectively communicate solutions to both the data team, and to stakeholders

Good understanding of database administration activities and principles

Data transformation approaches

Strong Python and SQL programming capabilities

Data security approaches – e.g. permission models (AD, role-based etc.) and techniques to protect data in certain circumstances (e.g. encryption, masking)

Desirable Qualifications, Knowledge and Experience

Familiarity with common agile project management principles, particularly in the context of data and analytical project delivery

Good understanding of typical ingestion patterns (e.g. ETL, ELT) and their effective implementation with on-premises and cloud-based environments

Knowledge of typical data modelling approaches (e.g. Kimball)

Experience using the Microsoft data stack (especially Azure Data Lake, Azure Synapse, Azure Data Factory, Databricks)

Experience of the full software/reporting lifecycle from planning and design through to deployment and maintenance

Knowledge of the Microsoft BI Stack, including Analysis Services, Integration Services and Reporting Services, and Power BI

Understanding of DevOps (or other source control technologies) – particularly code repositories and version control, containerisation methodologies, and application deployment practices (CI/CD pipelines)

Good to know

Hybrid based - in the Cardiff office when required.

Flexi working around core business hours (10:00 to 15:00), most of the team work 09:00 to 17:00

For an informal discussion about this opportunity, please contact Craig.Hodges@dwrcymru.com quoting the job ID [9006] in the subject line of your email.

Dŵr Cymru Cyf, a limited company registered in Wales No. 2366777. Registered office: Linea, Fortran Road, St. Mellons, Cardiff CF3 0LT