BTL / ETL - Data Engineer - SQL / DBT In Azure Databricks
EXL · Gurugram, Haryana, India
Business Consulting and Services · 10,001+ employees
5 h ago
Senior (5-10 yrs)
Full-time
India
Log in
to apply, save this posting, or score it against your profile with AI.
About the role
Design, develop, and maintain Business Translation Layer (BTL) pipelines using SQL and DBT within Azure Databricks. Monitor system performance, resolve data processing issues, and collaborate with teams to integrate pipelines into the larger architecture.
What they look for
SQL
DBT
Azure Databricks
Azure DevOps
Harness
GitHub
Azure Synapse
ADLS
Data Warehousing
Distributed Computing
Database Design
Data Pipeline Optimization
Secure Coding
Data Transformation
Cloud Implementation
Software Development
Requirements
Requires 3-6 years of experience with a strong background in software development, distributed computing, and data warehousing. Must be proficient in SQL, Databricks, and Azure cloud platforms, with experience in GitHub and build management.
Full description
Responsibilities
- Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks
- Create build from Github and release pipeline and Databricks using Azure Devops / Harness
- Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
- Diagnose system performance issue related to data processing and implement solution to address
- Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
- Maintain integrity and quality across all pipelines and environments.
- Understand and follow secure coding practice to make sure code is not vulnerable
