About the role
The senior data engineer will develop and maintain data ingestion pipelines and build lakehouse and warehouse layers within the Microsoft cloud data stack. They will also collaborate with project teams and stakeholders to deliver digital tools and data infrastructure that support business intelligence activities.
What they look for
Requirements
Candidates must have at least 3 years of experience with data engineering tools and proficiency in SQL and Python/PySpark. Experience with Microsoft Fabric, Azure Data Factory, or Databricks is preferred, along with strong communication skills for a client-facing consultancy environment.
Benefits
Full description
Mace combines construction expertise with consultancy to unlock potential in every person or project and redefine the boundaries of ambition. Our values shape the way we consult and define the people we want to join us on our journey.
The role:
The role is for a senior data engineer specializing in the Microsoft cloud data stack. It is a client-facing role supporting fee-earning projects and programmes.
The principal responsibility of the role is to contribute to the development of digital tools, processes and outputs, including the data infrastructure underpinning all BI activity, that support the wider project team and enable effective delivery of projects for our clients.
As part of your role, you will interface with the Mace project team and occasionally stakeholders from other organizations, if working on a joint venture project or directly for a client. You will be part of the Digital Centre of Excellence community, sharing knowledge and experience with other BI and Data professionals.
This is an excellent opportunity to learn from experienced practitioners and further develop your technical skill set.
You'll be responsible for:
- Developing and maintaining data ingestion pipelines in Microsoft Fabric.
- Designing and building the lakehouse and warehouse layers, and modelling a curated consumption layer for direct use by BI developers.
- Interpreting source system specifications and agreeing data requirements with system providers and other stakeholders.
- Developing, optimising and troubleshooting transformations in PySpark notebooks and SQL.
- Establishing and operating CI/CD for Fabric items through Azure DevOps across development, test and production environments.
- Validating data against source systems and communicating findings clearly to clients and colleagues.
- Adhering to a structured development lifecycle that includes requirements definition, design, development and testing, user acceptance testing, deployment, handover and post-implementation support.
- Attending training and other sessions organized by the centre of excellence, as well as keeping your knowledge of the industry up to date through self-endeavor and structured training as directed.
You'll need to have:
- Experience of Microsoft Fabric is preferred; candidates whose depth is in Azure Data Factory, Azure Synapse or Databricks are encouraged to apply and will be supported to develop their Fabric skills in the role.
- A minimum of 3 years' experience with data engineering tools.
- The ability to write and optimise complex SQL against a data warehouse.
- Python, including PySpark for transformation in Fabric notebooks.
- A solid working knowledge of ELT and ETL, medallion architecture and lakehouse design principles, and demonstrable experience of building data warehouses and data marts.
- Demonstrable experience of integrating data from APIs, including pagination and the management of schema change.
- Effective management of version control and release processes throughout the development lifecycle.
- Knowledge of good data structure and an understanding of data security.
- Evidence of organized ways of working to manage deliverables to time and quality.
- Understanding of working in a consultancy environment and management of stakeholders including clients, colleagues and data owners.
- Excellent written and oral communication skills (in English), including the ability to explain technical matters to a non-technical audience.
You'll also have:
- A working knowledge of DAX and M, sufficient to collaborate effectively with our BI developers, who lead on report development.
- The ability to work collaboratively as part of a team.
- A willingness to share knowledge and support the development of others.
- The confidence to ask questions, make suggestions and challenge the status quo.
- A commitment to working inclusively, an aptitude for problem-solving, and good interpersonal skills.
Our values
Safety first - Going home safe and well: We champion a safe, diverse and inclusive working environment, understanding the importance of wellbeing in every team.
Client focus - Deliver on our promise: We own the quality of deliverables, strategic outcomes and build long term relationships with our clients.
Integrity - Always do the right thing: We influence positive outcomes within our industry, while always aligning with our compliance obligations.
Create opportunity - For our people to excel: We champion a continuous improvement culture throughout all activities, inspiring our people and teams to develop.
Mace is an inclusive employer and welcomes interest from a diverse range of candidates. Even if you feel you do not fulfil all the criteria, please apply as you may still be the best candidate for this role or another role within our organisation.
We are also open to discussing part time, flexible, and hybrid working options if suitable within the role.
#LI-Onsite #LI-AH1
Similar roles
-
Data Engineer - fully remote within Europe (m/f/d)
JobLeads Careers Hamburg, Germany
-
Senior Data Engineer
Publicis Groupe Holdings B.V Bengaluru, Karnataka, India
-
Lead Data Engineer
Publicis Groupe Holdings B.V Bengaluru, Karnataka, India
-
Senior Data Engineer
Talan Málaga, Andalusia, Spain
-
Data Engineer
MerQube Inc Bengaluru, Karnataka, India
-
GCP Data Engineer
EXL Gurugram, Haryana, India