DATA Engineer GCP
TECDATA ENGINEERING Madrid, Community of Madrid, Spain
IT Services and IT Consulting · 201-500 employees
About the role
Design and maintain ETL/ELT processes using Python and manage data ingestion via Pub/Sub. Orchestrate data workflows using Airflow and Dataform while managing infrastructure with Terraform.
What they look for
Requirements
The role requires proficiency in Google Cloud Platform, specifically BigQuery and GKE. Candidates must be able to optimize SQL queries and manage cloud-based data engineering projects.
Full description
Funciones principales: Diseñar y mantener procesos ETL/ELT con Python. Trabajar con Google Cloud Platform (GCP), especialmente BigQuery. Gestionar ingesta y procesamiento de datos mediante Pub/Sub. Utilizar Dataform y Airflow para modelado y orquestación. Gestionar infraestructura como código con Terraform. Trabajar con GKE (Google Kubernetes Engine) y monitorizar aplicaciones en clústeres. Crear y optimizar consultas SQL para mejorar rendimiento e integridad de los datos. Participar en proyectos de ingeniería de datos y soluciones cloud.
Similar roles
-
Senior Data Engineer R&D
MSD Prague, Prague, Czechia
-
Sr Data Engineer
Porch Group India
-
FBS SAP Informatica Power Center Data Engineer
Capgemini Mexico
-
Forward Deployed Data Engineer
Total Performance Consulting Georgia, United States
-
Senior Data Engineer - Algolia
Perficient Bogota, RAP (Especial) Central, Colombia
-
Senior Data Engineer - Tableau
Perficient Bogota, RAP (Especial) Central, Colombia