Senior Data Engineer

• Design and develop scalable data ingestion and transformation pipelines integrating data from multiple source systems.

• Implement data cleansing, validation, and quality processes to ensure accurate, consistent, and reliable data.

• Build complex datasets and data models to support reporting, analytics, dashboards, and business decision-making.

• Analyze data and reporting requirements to identify trends, data gaps, and quality issues.

• Work closely with cross-functional teams using Agile methodology to deliver reliable and high-quality data solutions.

Requirements

• At

least 5 years of experience as an expert in Data Engineering and Analysis.

• Expertise in data ingestion, data processing

and analytical pipelines for big data, relational databases, and data warehouse solutions

• Hands-on experience with Agile software

development

• Experience in designing and hands-on

development in cloud-based analytics solutions.

• Expert level understanding on Azure Data

Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.

• Designing and building of data pipelines

using API ingestion and Streaming ingestion methods.

• Knowledge of Dev-Ops processes

(including CI/CD) and Infrastructure as code is essential.

• Thorough understanding of Azure and AWS

Cloud Infrastructure offerings.

• Expertise in Azure Databricks,

Azure Stream Analytics, Power BI is desirable

• Knowledge of SAP and BW/ BPC is desirable.

• Expert in Python, Scala, SQL is desirable

• Experience developing security models.