JobCubby JobCubby
Sign up
TECDATA ENGINEERING

Data Engineer – Migración de Cloudera a GCP

TECDATA ENGINEERING Madrid, Community of Madrid, Spain

IT Services and IT Consulting · 201-500 employees

Oct 16
Remote data-engineer Senior (5-10 yrs) Full-time Spain
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Migrate Cloudera workloads and data pipelines to Google Cloud, including migration to Dataproc and Dataproc Serverless. Validate and optimize cloud data pipelines and work with streaming, storage, governance, and target database services.

What they look for

HDFS Google Cloud Storage Apache Spark Scala PySpark Dataproc Dataproc Serverless Spark Streaming Apache Kafka Kudu Cloud SQL Google Spanner Bigtable Hive Metastore Apache Ranger Data Governance

Requirements

Requires experience with HDFS and Google Cloud Storage, advanced Apache Spark, Scala, and PySpark, and migrating workloads to Dataproc. Candidates should also have experience with Spark Streaming, Kafka, Kudu, cloud databases, data governance tools, and cloud pipeline migration, validation, and optimization.

Full description

Buscamos un Data Engineer – Migración de Cloudera a GCP

Requisitos imprescindibles:

  • Experiencia con HDFS y Google Cloud Storage.
  • Experiencia avanzada con Apache Spark, Scala y PySpark, y migración de workloads a Dataproc y Dataproc Serverless.
  • Experiencia en Spark Streaming y Apache Kafka, incluyendo servicios gestionados de Kafka en GCP.
  • Conocimientos de Kudu y soluciones de destino como Cloud SQL, Google Spanner y Bigtable.
  • Experiencia con Hive Metastore, Apache Ranger y gobierno del dato, incluyendo Dataplex, Cloud IAM y BigQuery Policy Tags.
  • Experiencia en migración, validación y optimización de pipelines de datos en entornos cloud.

Similar roles