About the role
Design, develop, and maintain efficient data pipelines to support real-time and batch data requirements while ensuring compliance with corporate standards. Collaborate with the data team to implement scalable data models, optimize performance, and provide mentorship to junior engineers.
What they look for
Requirements
Requires a bachelor's degree and experience in building and maintaining robust data ingestion and transformation processes. Candidates should have strong skills in data validation, monitoring, and integrating data from diverse sources like ERP systems.
Full description
- Design, develop, and maintain efficient data pipelines to process data from multiple sources, supporting real-time and batch data requirements
- Implement ETL/ELT processes for data ingestion, transformation, and storage that align with the business unit needs / requirements as well as Corporate IT standards
- Help integrate data from various sources, including third-party systems and ERP data, ensuring seamless flow between the business unit and Corporate IT infrastructure
- Assist in implementing data validation and monitoring tools to maintain data accuracy, consistency, and reliability across the platform
- Support the Senior Data Architect in implementing scalable data models and optimizing pipeline performance
- Create and update documentation for data flows, transformations, and processes to ensure transparency and compliance with corporate standards
- Identify opportunities to enhance pipeline efficiency and reduce latency, especially for real-time data applications
- Perform data analysis and reporting to assist in operational decision-making and performance optimization
- Ensure data processes and pipelines comply with Corporate IT’s data governance, security, and compliance standards
- Stay updated with industry trends and implement new technologies to enhance data infrastructure
Provide mentorship and support to Junior Data Engineers
Similar roles
-
Data Engineer and Reporting Specialist
N STREET VILLAGE INC Washington, District of Columbia, United States · $75K–$85K/yr
-
Senior Data Engineer – Azure
Aurora Engineering AB Gothenburg, Sweden
-
Data Engineer - Cape Town
Ten Group Cape Town, Western Cape, South Africa
-
Data Engineer
Zensar Hyderabad, Telangana, India
-
Lead Data Engineer
Ground Control Billericay, England, United Kingdom
-
Senior Data Engineer
WPP Warsaw, Masovian Voivodeship, Poland · PLN 102K–PLN 205K/yr