Data Engineer-Conversational Analytics
ALDI Magyarország Debrecen, Great Plain and North, Hungary
Retail · 5,001-10,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Develop and optimize data processing pipelines and semantic layers to support conversational analytics and AI use cases. Ensure high data quality and performance while managing scalable data integration solutions within a global data lake environment.
What they look for
Requirements
Requires strong proficiency in Python, Spark, Databricks, and SQL for data management and pipeline development. Candidates should have a data-centric mindset with foundational knowledge of UNIX, data modeling, and semantic layers.
Benefits
Full description
My responsibilities:
- Provide trusted data for conversational analytics, including a semantic layer, metric definitions, and a business glossary that text-to-SQL questions can use
- Maintain, develop, and optimize the data layer of AI us cases in the global data lake environment, ensuring high data quality, reliability, and overall performance
- Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks
- Manage scalable and efficient data integration and processing solutions using Databricks
- Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
- Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
- Support data modelling initiatives for coherent structure design and document all technical processes to ensure operational continuity
The knowledge I own:
- Strong background and understanding of database data management (general SQL knowledge, data querying, data quality control)
- Strong programming knowledge in Python (pyspark)
- Advanced level Big Data / data lake framework (Spark, Databricks)
- Strong cloud knowledge and handling of Databricks
- Basic familiarity with UNIX operating system, especially shell scripting
- Basic understanding of network level problems and connectivity requirements
- Basic understanding of data modelling principles and semantic layers (metric definitions, business glossaries) for conversational analytics
- Data-centric mindset
- Structured, analytical thinking
- Strong communication skills
- Well-organized
The offer that would convince me:
- A constantly growing organization and increasing opportunities
- Secure, long-term job opportunity
- Varied and engaging job responsibilities
- The chance to build data products used by colleagues across the international organization
- Outstanding salary
- Flexible work arrangements
- Home office possibility
Online application:
Please use our online application and attach your resume.
AIIS Adatkezelési tájékoztató
Privacy notice
Similar roles
-
Data Engineer
EKN Engineering Irvine, California, United States
-
Senior Workforce Analytics & Data Engineer
RGP San Jose, California, United States · $198K–$229K/yr
-
Data Engineer
Bluetab, an IBM Company San Isidro, Lima, Peru
-
AI Data Engineer
UKG Lowell, Massachusetts, United States · $72K–$103K/yr
-
System Data Engineer
Ericsson Stockholm, Sweden
-
Data Engineer – Cloud & AI Solutions
Sopra Steria Assago, Lombardy, Italy · €33K–€40K/yr