Nir Yu

Data Engineer (Databricks + Fabric)

Nir Yu Mexico, Chihuahua, Mexico

IT Services and IT Consulting · 201-500 employees

5 d ago
Remote data-engineer Mid (2-5 yrs) Full-time Mexico
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and build ETL/ELT pipelines using Databricks and Microsoft Fabric while managing production data platforms. Govern data quality and lineage using Unity Catalog and automate deployments through CI/CD and infrastructure as code.

What they look for

Databricks Microsoft Fabric PySpark Delta Lake Unity Catalog Medallion Architecture ETL ELT SQL Python CI/CD Infrastructure as Code Data Pipelines OneLake Dataflows Gen2 Warehouse

Requirements

Requires hands-on production experience with Databricks, PySpark, and Microsoft Fabric, along with advanced SQL and Python skills. Candidates must hold or commit to earning DP-900 or DP-700 certifications and possess fluent English and Spanish proficiency.

Full description

Responsibilities:

  • Build and run production data platforms for our clients. This is hands-on work, not an architect who only reviews.
  • Design and build ETL/ELT pipelines in Databricks and Fabric.
  • Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.
  • Govern data with Unity Catalog: permissions, lineage and quality.
  • Automate deployments with CI/CD and infrastructure as code.
  • Gather requirements with the client and with other teams.
  • Spot improvements in the client's platforms that could turn into new projects.

Requirements:

  • Hands-on Databricks in production. PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.
  • Microsoft Fabric in production, across the full platform. Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse. A proof of concept does not count.
  • Advanced SQL and Python.
  • A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days. Verify it with the Microsoft Learn link.
  • English B2 or higher and fluent Spanish.

Similar roles