JobCubby JobCubby
Sign up
EXL

Azure Lead Data Engineer

EXL Bengaluru, Karnataka, India

Business Consulting and Services · 10,001+ employees

7 h ago
data-engineer Principal (10+ yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT to integrate data from various sources. Collaborate with cross-functional teams to monitor, troubleshoot, and optimize data pipelines while ensuring data quality and governance standards.

What they look for

Azure Data Factory Snowflake Dbt Sql Data Engineering Etl Elt Data Integration Cloud Computing Data Governance Data Warehousing Snowsql Python Pyspark Devops Ci/Cd

Requirements

Requires a Bachelor's or Master's degree in Computer Science or a related field with 8+ years of experience in data engineering. Candidates must possess strong expertise in Azure Cloud, Snowflake, and SQL, along with excellent problem-solving and communication skills.

Full description

Key Responsibilities:

  • Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
  • Build and maintain data integration workflows from various data sources to Snowflake.
  • Write efficient and optimized SQL queries for data extraction and transformation.
  • Work with stakeholders to understand business requirements and translate them into technical solutions.
  • Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
  • Maintain and enforce data quality, governance, and documentation standards.
  • Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Must-Have Skills:

  • Strong experience with Azure Cloud Platform services.
  • Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines.
  • Proficiency in SQL for data analysis and transformation.
  • Hands-on experience with Snowflake and SnowSQL for data warehousing.
  • Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse.
  • Experience working in cloud-based data environments with large-scale datasets.

Good-to-Have Skills:

  • Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions.
  • Familiarity with Python or PySpark for custom data transformations.
  • Understanding of CI/CD pipelines and DevOps for data workflows.
  • Exposure to data governance, metadata management, or data catalog tools.
  • Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • 8+ years of experience in data engineering roles using Azure and Snowflake.
  • Strong problem-solving, communication, and collaboration skills.

Responsibilities

Key Responsibilities:

  • Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
  • Build and maintain data integration workflows from various data sources to Snowflake.
  • Write efficient and optimized SQL queries for data extraction and transformation.
  • Work with stakeholders to understand business requirements and translate them into technical solutions.
  • Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
  • Maintain and enforce data quality, governance, and documentation standards.
  • Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Qualifications

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • 8+ years of experience in data engineering roles using Azure and Snowflake.
  • Strong problem-solving, communication, and collaboration skills.

Similar roles