Data Engineer Mid-Level | Microsoft Azure
Expleo Lisbon, Portugal
IT Services and IT Consulting · 10,001+ employees
About the role
Develop and maintain data pipelines, including ingestion, transformation, and modeling processes. Ensure the availability and performance of data solutions within the Microsoft Azure ecosystem.
What they look for
Requirements
Requires 2-5 years of experience in data engineering with a strong focus on Microsoft Azure and Azure Databricks. Proficiency in PySpark, ETL/ELT development, and data lifecycle management is essential.
Full description
Overview
Expleo is a trusted partner for your innovation journey. As a global engineering, technology and consulting service provider, we are ideally positioned to help you achieve your ambitions and future-proof your business. With a smart blend of bold thinking and reliable execution, we’re able to fast-track innovation through each step of your value chain.
We are strategically positioned to build value, with global footprint across 30 countries.We are as global and local as you need us to be, with strong best-in-class pan-European technological centres and unique best-shoring capabilities.
We leverage a network of high value-adding affiliates in consulting and industrial excellence, and leading partners across multiple sectors to provide you with the most comprehensive services and solutions in an ever-changing environment.
Responsibilities
Procuramos um Data Engineer com experiência prática no desenvolvimento de soluções de dados em Microsoft Azure, com especial foco em Azure Databricks.O profissional deverá ter capacidade para trabalhar no desenvolvimento de pipelines, ingestão e transformação de dados, preparação/modelação e disponibilização de informação. Essential skills
- 2–5 anos de experiência em Data Engineering- Experiência sólida em Microsoft Azure- Experiência em Azure Databricks- Experiência com PySpark / notebooks- Experiência em desenvolvimento de ETL/ELT- Experiência com Azure Data Lake Storage / ADLS- Conhecimentos de Parquet- Conhecimentos de Delta Lake
Experiência no ciclo completo de dados:- ingestão, transformação, modelação, disponibilizaçãoCapacidade de desenvolver soluções escaláveis e com atenção a performanceExperiência em SCRUM / Agile
Desired skills
- Experiência com Azure Data Factory- Experiência de migração de Scala para PySpark- Azure Synapse- JIRA- Confluence
Similar roles
-
Data Engineer
TabaPay Palo Alto, California, United States · $130K/yr
-
Senior Market Data Engineer
Coinbase United States · $191K–$225K/yr
-
Senior Data Engineer
Pie Insurance United States · $140K–$175K/yr
-
Data Engineer
Associated Wholesale Grocers Kansas City, Kansas, United States
-
Data Engineer - Azure Data Engineer and Monitoring
Jalasoft Argentina
-
Data Engineer
ZipLiens Franklin, Tennessee, United States · $89K–$120K/yr