Data Platform Engineer
Expleo · Porto, Portugal
IT Services and IT Consulting · 10,001+ employees
About the role
You will be responsible for designing, developing, and maintaining data pipelines and platforms within a cloud environment. The role involves ensuring scalability, reliability, and compliance while collaborating with a multicultural team.
What they look for
Requirements
Candidates must have 3–5 years of experience and strong hands-on knowledge of SQL and distributed data processing. Proficiency in Python or Scala, AWS cloud services, and various data engineering tools like Apache Kafka and AirFlow is required.
Full description
Overview
We are looking for a Data Platform Engineer with 3–5 years of experience to join our growing team. You will be responsible for designing, developing, and maintaining data pipelines and platforms in a cloud environment, ensuring scalability, reliability, and compliance.
This is a great opportunity to work with cutting-edge technologies, contribute to impactful data solutions, and collaborate with a talented, multicultural team.
Essential skills
-Proven experience working with data pipelines in production environments.
-Strong hands-on knowledge of SQL and distributed data processing (Apache Spark).
-Proficiency in troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi, Apache AirFlow.
-Strong programming skills in Python or Scala for data engineering tasks.
-Experience with AWS cloud data services.
-Familiarity with Grafana.
-Understanding of data governance, security, and compliance in the cloud.
-Experience with CI/CD pipelines and testing frameworks for data workflows.
-Strong problem-solving, communication, and collaboration skills.
-Fluency in Portuguese and English (written and spoken).
