Lead Data Engineer / Architect (all genders)
The businesses of Merck KGaA, Darmstadt, Germany Bratislava, Region of Bratislava, Slovakia
Pharmaceutical Manufacturing · 10,001+ employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Lead a team of engineers to design, build, and operate a robust Security Data Platform for ingestion, normalization, and processing. Collaborate with cross-functional teams to ensure the platform supports observability and effective threat detection.
What they look for
Requirements
Requires a bachelor's or master's degree in computer science or a related field with extensive experience in large-scale data platform design. Proficiency in Kubernetes, Kafka, Flink, and programming languages like Java or Python is essential.
Full description
Your role:
We are seeking a highly skilled Lead Data Engineer / Data Architect with a strong developer background to design, build, and operate our Security Data Platform. This role will focus on end-to-end data management, design and architect analyzation, ingestion, normalization, storage, processing, and serving the solutions. The primary emphasis will be on Security Data and Observability Data, serving as the foundation for fraud and threat detection, detection engineering, and response through different types algorithms and machine learning approaches. Additionally, the platform will provide observability for the entire application landscape, facilitating troubleshooting and reporting.
Key Responsibilities:
- Lead a team of engineers and developers in the implementation of the Data Platform.
- Design and architect data ingestion, normalization, storage, processing, and serving solutions.
- Ensure the Data Platform supports observability across the application landscape.
- Collaborate with cross-functional teams to gather requirements and deliver effective data solutions.
- Monitor and optimize platform performance, scalability, and security.
Who you are:
- Bachelor's or master’s degree in computer science, Data Engineering, or a related field.
- Demonstrated experience in designing and implementing large-scale data platforms. (Expertise in programming languages such as Java and Python is a plus)
- Proven experience with Kubernetes for container orchestration.
- Strong knowledge of Apache Kafka for real-time data streaming and experience with Apache Flink for stream processing.
- Experience with analytical databases (e.g. OLAP) and Massively Parallel Processing MPP architectures, especially in the context of optimization and performance tuning
- Familiarity with lakehouse architectures (e.g. Apache Iceberg) - Experience with MLOps and ML model delivery pipelines
- Knowledge of Elasticsearch to support migration to alternative solutions
- Excellent leadership and team management skills, Project Management skills is a plus
- Strong analytical and problem-solving skills and ability to work collaboratively in a fast-paced environment.
- Hands-on experience in projects using or applying machine learning
Our Tech Stack
Kubernetes, Apache Kafka, Apache Flink, Java, Python, TypeScript, Postgres, Apache Doris, Grafana.
Job Evaluation: Expert 3
Department: EF-DS-TITJ Identity & Access Management
Similar roles
-
Data Engineer
Medtronic Edinburgh, Scotland, United Kingdom · £77K–£115K/yr
-
Associate Data Engineer
AAA Costa Mesa, California, United States · $86K–$115K/yr
-
Senior Data Engineer
Clera Munich, Bavaria, Germany
-
Senior Data Engineer(BQ)
NTT DATA Romania SA Bucharest, Romania
-
Data Engineer
Takeda Bengaluru, Karnataka, India
-
Data Engineer Intern
PwC Prague, Prague, Czechia