JobCubby JobCubby
Sign up
S

Data Engineer (m/f/d)

Schwarz Dienstleistungen · Barcelona, Catalonia, Spain

Retail · 1,001-5,000 employees

13 h ago
Mid (2-5 yrs) Full-time Spain
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, build, and maintain scalable batch and real-time data pipelines while ensuring data integrity and quality. Develop statistical and machine learning algorithms to extract actionable business insights and solve complex problems.

What they look for

Python SQL Spark Kafka Kubernetes Hive SQL Server MongoDB ELK Cassandra Agile Methodology Scikit-Learn Pandas Spark ML MLflow .NET

Requirements

Candidates must be proficient in Python, SQL, and Big Data frameworks like Spark and Kafka, with experience in both relational and non-relational databases. Familiarity with Agile methodologies and machine learning tools is highly desired.

Full description

Schwarz Digits creates the technological foundation for digital sovereignty in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero. At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation. We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.  

Data Engineer

 Employment Area: Location: Employment Type:  Your tasks

We are seeking a highly skilled and motivated Data Engineer to join our team. In this role, you will be involved in building scalable data solutions, driving data operations, and developing statistical and machine learning algorithms that deliver real business value. This is an exciting opportunity for someone who thrives in dynamic, agile environments and is passionate about using data to solve complex problems. Design, build, and maintain batch and real-time data pipelines. Conduct data operations, including exploration, provisioning, cleaning, testing, and ALM. Develop and implement algorithms in statistics and machine learning. Collaborate closely with business stakeholders to translate requirements into technical solutions. Ensure data integrity, quality, and availability across all systems. Extract actionable business insights.

Your profile

Must-have: Programming languages: Python, SQL. Must-have: Experience with Big Data frameworks such as Spark, Kafka, Kubernetes, Hive. Must-have: Familiarity with relational (e.g., SQL Server) and non-relational databases (e.g., MongoDB, ELK, Cassandra). Agile methodology experience. Nice-to-have: Knowledge of Machine Learning tools: Scikit-Learn, Pandas, Spark ML, MLflow. Nice-to-have: Knowledge of deploying infrastructure and devops. Nice-to-have: Experience in .NET. Passion for continuous learning and staying up to date with emerging technologies. Creative, innovative thinker with a proactive mindset. Strong problem-solving skills and ability to adapt quickly to change. Collaborative spirit with excellent communication skills. Comfortable working in a multi-cultural environment with fluency in English.

We look forward to receiving your application. Aidan Cutanda Lundy · Reference no. 48246 Stiftsbergstraße 1 · 74172 Neckarsulm, Germany