Data Engineer – Cloud Platform & Data

About the Assignment

You will join the Data Solutions & Products team within the Cloud Platform & Data organization. The team is building and operating a strategic B2B API platform to monetize vehicle and connected car data externally.

The platform enables secure data sharing with external data aggregators, fleet customers, and third-party partners such as insurance and charging companies. The objective is to maximize the value of connected vehicle data while enhancing market competitiveness across Europe.

In this role, you will play a key part in developing, deploying, and maintaining modern data products on the data platform. You will also perform verification activities following deployments to minimize system disruptions, data loss, and security vulnerabilities, ensuring business continuity and user satisfaction.

You will work closely with stakeholders, providing secure access to required datasets while leveraging your expertise in data warehousing, ETL processes, AWS, and Databricks.

Key Responsibilities

• Design, develop, and maintain scalable batch and streaming data pipelines to ingest data from multiple sources.

• Build and automate data ingestion and orchestration pipelines.

• Develop and implement data processing workflows, including data cleansing, deduplication, and transformation.

• Operate and maintain the data platform in collaboration with the infrastructure team.

• Perform platform upgrade testing, including regression, functional, and security testing.

• Implement measures to ensure data security, accuracy, completeness, and consistency.

• Configure monitoring tools to track pipeline performance, data quality, and overall system health.

• Diagnose and resolve issues related to data pipelines, storage systems, and integrations.

• Collaborate with stakeholders to define data models and ensure data meets business requirements.

• Provide technical guidance and secure data access support to data consumers.

• Document data pipelines, architectures, and workflows to ensure maintainability and knowledge sharing.

• Design and maintain data models for reporting and analytics.

• Develop simple dashboards using Power BI.

Required Qualifications

• Minimum 5 years of continuous experience in Data Engineering.

• Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or equivalent practical experience.

• Strong hands-on experience with big data technologies, including:

• Data Lakes

• Apache Spark

• Apache Flink

• Apache Kafka

• Good understanding of:

• Data Warehousing

• ETL Processes

• DevOps

• CI/CD

• Software Testing

• Strong programming skills in SQL and/or Python.

• Hands-on experience with:

• AWS (Redshift, EMR, S3)

• Azure (Data Factory, Power BI Service)

• Experience with modern data platforms such as:

• Databricks

• Snowflake

• Experience building reports and visualizations using Power BI.

• Experience with Infrastructure as Code (IaC) is considered an advantage.

• Experience working with automotive connectivity data is preferred.

• Fluent in English.

• Chinese language skills are considered an advantage.

Preferred Technical Skills

Experience with:

• CANalyzer

• CANoe

• DSA

• SystemWeaver

Personal Attributes

• Pragmatic, self-driven, and solution-oriented.

• Comfortable working in ambiguous and evolving environments.

• Curious, flexible, and eager to learn new technologies.

• Proactive, self-motivated, and capable of managing multiple priorities.

• Strong sense of ownership and accountability.

• Collaborative team player with excellent communication skills.