JobCubby JobCubby
Sign up
Valce Talent Solutions

Azure data engineer

Valce Talent Solutions Ciudad de México, Mexico

IT Services and IT Consulting · 11-50 employees

7 h ago
Remote data-engineer Senior (5-10 yrs) Full-time Mexico
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

The Data Engineer will design, build, and maintain scalable cloud-native data pipelines and infrastructure for analytics and real-time processing. They will collaborate with stakeholders to ensure data quality, security, and performance across the enterprise data platform.

What they look for

Azure Data Factory Azure Databricks Python SQL PySpark Spark Delta Lake Azure Synapse Analytics ETL/ELT Data Engineering RESTful APIs Kubernetes Docker Apache Airflow Data Governance Cloud Architecture

Requirements

Candidates must have strong proficiency in SQL, Python, and Azure cloud technologies including Databricks and Synapse Analytics. Experience with distributed data processing frameworks, API development, and containerization tools like Docker and Kubernetes is required.

Full description

Remote position in México

Data Engineer

Role Overview

The Data Engineer is responsible for designing, building, and maintaining scalable, cloudnative data pipelines and data infrastructure that support analytics, reporting, business intelligence, and real-time data processing.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time

data processing.

  • Build and optimize data models, Delta Tables, and Lakehouse architectures to

support analytics and reporting.

  • Develop and integrate RESTful APIs and data services to facilitate seamless data

exchange across enterprise systems.

  • Implement real-time and high-frequency data ingestion frameworks using streaming

technologies and event-driven architectures.

  • Design and manage cloud-native data solutions leveraging Azure services including

Azure Data Factory, Azure Databricks, ADLS, Event Hubs, and Synapse Analytics.

  • Develop and optimize Databricks Spark applications for large-scale data

transformation and processing.

  • Ensure data quality, governance, security, and compliance across data platforms.
  • Collaborate with data scientists, analysts, application teams, and business

stakeholders to deliver scalable data solutions.

  • Troubleshoot, monitor, and optimize pipeline performance and data platform

reliability.

  • Support DataOps and CI/CD practices for data pipeline deployment and

automation.

Required Skills & Qualifications

  • Strong proficiency in SQL and relational databases such as Oracle, SQL Server, and

MySQL.

  • Strong programming skills in Python, PySpark, PL/SQL, Java, or Scala.
  • Hands-on experience with Azure Cloud technologies:

o Azure Data Factory (ADF)

o Azure Databricks

o Azure Data Lake Storage (ADLS)

o Azure Synapse Analytics

o Azure Event Hubs

o Azure Functions

o Azure API Management

o Azure DevOps

  • Experience with Databricks Lakehouse architecture, Delta Lake, and Delta Tables.
  • Expertise in API development, API integration, RESTful services, and microservices

architecture.

  • Experience processing high-volume and high-frequency data with low-latency

requirements.

  • Strong knowledge of real-time data ingestion and streaming technologies such as

Kafka, Azure Event Hubs, or Kinesis.

  • Experience with Spark, Hadoop, and distributed data processing frameworks.
  • Hands-on experience with OpenShift, Kubernetes, Docker, and containerized

deployments.

  • Experience with workflow orchestration tools such as Apache Airflow and Azure

Data Factory.

  • Understanding of data governance, data security, and compliance best practices.

Preferred Qualifications

  • Experience with Delta Live Tables (DLT), Auto Loader, and Change Data Capture

(CDC).

  • Knowledge of DataOps, CI/CD, and Infrastructure as Code (IaC).
  • Familiarity with event-driven architectures and real-time analytics platforms.
  • Azure Data Engineer (DP-203) and Databricks certifications

mandatory skills:

  • Python
  • Azure
  • SQL

REMOTE

ADVANCED ENGLISH

Similar roles