JobCubby JobCubby
Sign up
Brillio

Lead Data Engineer - R01569363

Brillio Bangalore, Karnataka, India

Artificial Intelligence · 5,001-10,000 employees

Jul 30
data-engineer Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design and implement scalable ETL processes and data pipelines using Azure services to support real-time and batch analytics. Collaborate with cross-functional teams to manage data sources, optimize SQL performance, and deliver actionable insights through Power BI reporting.

What they look for

Azure Synapse Analytics Azure Data Factory Azure Data Explorer Pyspark Delta Lake SQL Performance Tuning Power BI Data Modeling DAX Azure Data Lake Azure DevOps Azure Kubernetes Service Event Hub Azure Sentinel Streaming Analytics

Requirements

Requires 4 to 6 years of hands-on experience in data engineering with substantial expertise in Azure analytics and pipeline development. Candidates should hold a bachelor's degree in a relevant field and possess professional certifications such as Microsoft Certified: Azure Data Engineer Associate.

Full description

Lead Data Engineer

\n

Primary Skills

  • AKS, Event Hub, Azure DevOps, Azure sentinel, Cosmos DB, Azure Functions

Specialization

  • Azure Data Engineering Advanced: Senior Lead Data Engineer

Job requirements

  • Experience Range: with at least 4 to 6 years of hands-on experience in data engineering, including substantial expertise in Azure analytics and pipeline development Key Responsibilities: 1. Design and implement scalable ETL processes using Azure Data Factory, Synapse Analytics, and Spark, delivering robust real-time and batch data feeds 2. Develop and optimize data pipelines and models for large-scale lakehouse and warehouse analytics systems, achieving high performance and reliability targets 3. Integrate and manage data sources from Azure Data Explorer, Kusto, and Delta Lake formats to enable advanced analytics and reporting capabilities 4. Configure and maintain cloud-hosted data architectures, leveraging Azure services to ensure secure, efficient, and resilient data operations 5. Collaborate with cross-functional teams to capture data requirements and drive test-driven, data-driven development methodologies 6. Monitor, troubleshoot, and enhance SQL performance, ensuring efficient query execution and maintaining data quality across all systems 7. Develop and maintain Power BI reports, focusing on data modeling and DAX to deliver actionable insights to stakeholders 8. Document technical business processes and data architecture, supporting organizational knowledge sharing and compliance Required Skills: 1. Azure Synapse Analytics 2. Azure Data Factory 3. Azure Data Explorer (Kusto) 4. Pyspark 5. Delta Lake 6. SQL performance tuning 7. Power BI (Data Modeling and DAX) 8. Azure Data Lake Preferred Skills: 1. Azure DevOps for CI/CD 2. AKS (Azure Kubernetes Service) 3. Event Hub 4. Azure Sentinel 5. Experience with large-scale streaming analytics Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline 2. Microsoft Certified: Azure Data Engineer Associate 3. Microsoft Certified: Azure Solutions Architect Expert Additional Information: Location: Bangalore

\n

Similar roles