Lead Data Engineer (12 Month FTC)
AND Digital London, England, United Kingdom
IT Services and IT Consulting · 1,001-5,000 employees
About the role
The Lead Data Engineer will design, build, and evolve scalable data pipelines and architecture to support the client's Accounts platform. They will provide technical leadership, establish engineering standards, and mentor team members to ensure data reliability and governance.
What they look for
Requirements
Candidates must have extensive experience in data engineering, including strong SQL and Python skills, as well as experience with ETL/ELT pipelines and cloud-based platforms. Proven ability to lead technical delivery and define architectural standards in complex environments is essential.
Benefits
Full description
Lead Data Engineer - 12 Month FTC
Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We’ve been helping organisations build better digital products and stronger digital teams since 2014.
We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or ‘Clubs’) so that our partners are always prioritised by a regional team close to them.
This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Today we number more than 1,300 people with Clubs all over the UK and Europe with plans for global expansion in the next couple of years.
Join us - and help us fulfil our mission to close the world’s digital skills gap.
The Role
The Lead Data Engineer will play a key role in shaping, building and evolving the data capabilities that underpin our clients Accounts platform.
Working across data engineering, architecture and platform delivery, the role will provide technical leadership in the design and implementation of scalable, reliable and well-governed data solutions. This includes data pipelines, reference data services and operational data stores, ensuring that data is accurate, accessible, traceable and trusted across the wider ecosystem.
The successful candidate will combine strong hands-on data engineering expertise with the ability to lead technical direction, influence architecture decisions and establish engineering standards and best practices.
Key Responsibilities• Lead the design, development and ongoing evolution of robust, scalable data ingestion and processing pipelines.
- Provide technical leadership across ETL/ELT processes, data transformation and data integration services.
- Design and implement operational data stores and reference data services that support the Accounts platform and its consumers.
- Establish and maintain effective data quality, validation, monitoring, reconciliation and observability controls.
- Contribute to the evolution of data architecture, ensuring solutions are scalable, resilient, secure and aligned with wider technology strategy.
- Define and promote data engineering standards, patterns and best practices across the team.
- Support the development and implementation of data governance, lineage and data management practices.
- Work closely with software engineers, architects, product teams and other stakeholders to understand data requirements and translate them into effective technical solutions.
- Provide technical guidance and mentoring to other data engineers, helping to raise engineering capability and consistency across the team.
- Champion automation, Infrastructure as Code and modern engineering practices across the data landscape.
- Identify opportunities to improve the reliability, performance, maintainability and cost-effectiveness of data services and pipelines.
Essential ExperienceWe're particularly interested in candidates with experience in:
- Strong SQL skills and extensive experience working with relational and/or modern database technologies.
- Proven commercial experience developing data solutions using Python.
- Strong understanding of modern data engineering principles, practices and design patterns.
- Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
- Experience working with data quality, reconciliation, monitoring and operational data management.
- Experience contributing to data architecture and governance standards.
- Experience with Infrastructure as Code, ideally using Terraform.
- Experience working with cloud-based data platforms and modern engineering tooling.
- Experience leading technical delivery and making pragmatic architectural decisions in a complex technology environment.
Why join AND Digital?
We have three values: wonder, share, and delight. These values inform how we work with clients, and our culture: what it feels like to work for AND. We believe collaboration, ambition, curiosity and fun can drive innovation by creating a better environment for problem-solving.
By joining AND, we’ll provide:
- Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to people’s lives.
- A “Blended Working” model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
- A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
- An annual budget for training and upskilling, including allocated days off so you don’t have to study in your own free time.
- Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
- A safe environment for you to be yourself and challenge yourself.
Equal Opportunities Statement
At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.
We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.
Similar roles
-
Data Engineer
Central One Federal Credit Union Shrewsbury, Massachusetts, United States · $96K–$124K/yr
-
Data Engineer III
Playlist Brazil
-
Data Engineer - DataOps (Position located in Bengaluru, India)
KnowBe4 Bengaluru, Karnataka, India
-
Full Stack Data Engineer
Ford Motor Company India
-
Staff Data Engineer
Sandisk Bengaluru, Karnataka, India
-
Senior Data Engineer (French Speaker) | BPCE-SI
Natixis in Portugal Porto, Portugal