JobCubby JobCubby
Sign up
Expleo

Data Engineer Senior | Microsoft Azure

Expleo Lisbon, Portugal

IT Services and IT Consulting · 10,001+ employees

Yesterday
Remote data-engineer Senior (5-10 yrs) Full-time Portugal
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The role involves interacting with business and technical teams to gather requirements and design scalable data solutions. You will be responsible for developing pipelines, optimizing transformation processes, and ensuring data quality, security, and governance.

What they look for

Microsoft Azure Azure Databricks PySpark Azure Data Factory ETL ELT Azure Data Lake Storage Parquet Delta Lake Data Engineering Data Architecture Agile Scrum DataHub Scala Azure Synapse

Requirements

Candidates must have over 5 years of experience in data engineering with strong proficiency in Microsoft Azure, Databricks, and PySpark. Experience in end-to-end data lifecycle management and the ability to translate functional requirements into technical specifications are essential.

Full description

Overview

Expleo is a trusted partner for your innovation journey. As a global engineering, technology and consulting service provider, we are ideally positioned to help you achieve your ambitions and future-proof your business. With a smart blend of bold thinking and reliable execution, we’re able to fast-track innovation through each step of your value chain.

We are strategically positioned to build value, with global footprint across 30 countries.We are as global and local as you need us to be, with strong best-in-class pan-European technological centres and unique best-shoring capabilities.

We leverage a network of high value-adding affiliates in consulting and industrial excellence, and leading partners across multiple sectors to provide you with the most comprehensive services and solutions in an ever-changing environment.

Responsibilities

-Interagir diretamente com equipas de negócio e técnicas-Levantar e interpretar requisitos-Transformar requisitos em especificações técnicas-Desenhar soluções de dados-Desenvolver pipelines-Otimizar processos de transformação-Participar na definição de arquitetura e standards-Garantir qualidade, segurança e governança dos dados-Apoiar tecnicamente perfis mais juniores

Essential skills

- 5+ anos de experiência em Data Engineering- Experiência sólida em Microsoft Azure- Forte experiência em Azure Databricks- Experiência com PySpark- Experiência com Azure Data Factory- Experiência em desenvolvimento e otimização de ETL/ELT- Experiência com Azure Data Lake Storage / ADLS- Experiência com Parquet- Experiência com Delta Lake

Experiência end-to-end:- ingestão, transformação, modelação, disponibilização- Capacidade de desenhar arquiteturas escaláveis e orientadas a performance- Experiência com DataHub / plataformas de dados- Capacidade de traduzir requisitos funcionais em soluções técnicas- Experiência em Agile / SCRUM

Desired skills

-Migração Scala → PySpark-Azure Synapse-JIRA-Confluence-Experiência de liderança técnica-Experiência em arquitetura de dados-Diferença fundamental face ao P1 (perful mid level)

Similar roles