Data Engineer

Data Engineer

Department: Development

Employment Type: Permanent - Full Time

Location: Pune, India

Reporting To: Prashanth Mavungal

Description

We are seeking a highly skilled Data Engineer to design, develop, and optimize enterprise-scale data solutions on Azure. The ideal candidate will have strong expertise in ETL development, real-time data processing, Azure data services, advanced SQL, and data modeling.   This role will be responsible for building scalable, high-performance data pipelines, driving best practices, and supporting business-critical analytics and reporting initiatives.

Key Responsibilities

· Design, develop, and maintain scalable batch and real-time data pipelines. 

· Architect and implement data integration solutions using Azure Data Factory, Azure Storage Accounts, and Azure Event Hub. 

·Develop and optimize complex SQL queries, stored procedures, and database workloads to ensure performance and scalability. 

· Build and support real-time/streaming data processing solutions leveraging Event Hub architecture. 

· Design and implement robust data models to support analytics, reporting, and data warehousing requirements. 

· Establish and maintain data quality, monitoring, performance tuning, and operational best practices.

Drive CI/CD implementation and automate deployment processes for data engineering solutions. 

· Collaborate with business stakeholders, architects, and development teams to deliver reliable and scalable data platforms. 

· Mentor junior engineers and contribute to technical design reviews and solution architecture discussions.

Skills, Knowledge and Expertise

· 5+ years of experience in Data Engineering, ETL Development, or related roles. 

· Strong hands-on experience in designing and developing ETL/ELT pipelines. 

Proven experience with: 

• Azure Data Factory (ADF)

• Azure Storage Accounts (Blob Storage/Data Lake Storage)

• Azure Event Hub

· Strong experience in real-time/streaming data processing using Event Hub architecture. 

Advanced SQL expertise, including: 

• Complex Joins

• CTEs & Window Functions

• Query Optimization

• Performance Tuning

• Stored Procedures & Database Design

· Solid understanding of data modeling concepts, including dimensional modeling, star schema, and enterprise data warehouse design. 

· Experience with CI/CD practices, Git, and Azure DevOps. 

· Strong troubleshooting, analytical, and problem-solving skills. 

· Experience working in Agile delivery environments.

Preferred Skills

• Experience with Azure Databricks, Spark, or Python.

• Knowledge of Data Lake, Lakehouse, and modern cloud-based data architectures.

• Exposure to data governance, monitoring, and security best practices.

• Experience in designing scalable enterprise data platforms.