Senior Data Engineer Engineer (m/w/d)
EVERIENCE · Brussels, Brussels-Capital, Belgium
IT Services and IT Consulting · 51-200 employees
About the role
You will be responsible for ensuring high-quality access to data sources, focusing on data governance, standardization, and the structuring of the data lifecycle. Additionally, you will oversee data management systems, including Big Data and IoT platforms, while integrating structured and unstructured data.
What they look for
Requirements
The role requires a Master's degree in a relevant field and 8-10 years of experience in data engineering and governance. Candidates must possess strong proficiency in Python, .NET/C#, SQL, and cloud-based big data technologies like Databricks and AWS.
Full description
Description de l'entreprise
Everience is an international consulting group delivering AI-augmented digital services and placing people at the heart of the AI revolution.
With a presence in Europe, Africa, Asia and America, Everience offers its 4,000-strong workforce the most demanding and stimulating environment in which to transform and develop their skills, learning about new AI-based roles and building their future employability.
Through its Symbiotic Academy the group offers a unique hub for training, practical application and exchange where everyone can experiment, learn, and progress in the fields of artificial intelligence and data.
In accordance with its core purpose of orchestrating the symbiotic relationship between humans and AI in the workplace, Everience is making the augmented employee the driving force of a “symbiotic age”, where AI enhances talents and opens up new career opportunities.
Description du poste
You will be responsible for ensuring high-quality access to data sources, with a strong focus on data quality, standardization, qualification, and governance to enable effective use by Data Analysts and Data Scientists.
You will contribute to the definition and implementation of data policies and to the structuring of the data lifecycle, ensuring compliance with regulatory requirements in collaboration with key data governance stakeholders.
You will oversee data management and processing systems, including Big Data and IoT platforms. You will ensure the integration of structured and unstructured data from multiple sources and maintain high data quality within the Data Lake through rigorous testing, validation, and deduplication processes.
Data Qualification & Data Management:
- Capture structured and unstructured data generated by internal applications and external sources.
- Integrate and consolidate data from multiple systems and environments.
- Structure data through semantic modeling and standardization practices.
- Map available data assets and maintain data consistency.
- Clean and enrich datasets, including duplicate elimination and quality remediation.
- Validate data integrity and business consistency.
- Create and maintain data repositories where required.
Datastream Team Scope:
Support data management activities across Downstream and Upstream domains, with a particular focus on data used for forecasting purposes and business-critical analytics.
Technical Skills & Expertise:
Data Engineering & Development
- Proficiency in Python and .NET/C# for script development and ETL implementations.
- Strong knowledge of software development best practices and version control using Git.
- Expertise in modern data acquisition, preparation, integration, and transformation techniques.
Databases & Data Warehousing
- Strong understanding of relational databases and SQL.
- Ability to design efficient data models and optimize query performance.
- Experience working with enterprise data warehouses and large-scale data platforms.
Big Data & Cloud Technologies
- Experience with Databricks, including ETL development, Spark cluster management, and SQL optimization.
- Experience with PySpark and Apache Spark ecosystems.
- Knowledge of AWS cloud services and data platform solutions.
- Experience building and orchestrating ETL workflows using Airflow and DAGs.
Qualifications
- Master's Degree in Computer Science, Data Engineering, Data Science, Information Systems, Applied Mathematics, or a related field.
- 8-10 years of experience
- Strong knowledge of Data Governance, Data Quality, Data Warehousing, and Data Lake architectures.
- Experience working in Agile environments and large-scale enterprise ecosystems.
- Excellent communication, stakeholder management, and problem-solving skills.
Informations complémentaires
All our positions are open to both women and men and are, of course, open to people with disabilities.
- Niveau d'expérience: 10-15 ans
- Département: Fonctions d'ingénierie
- Type de contrat: CDI