Data Engineer
Caixa Mágica Software Lisbon, Portugal
Software Development · 51-200 employees
About the role
The Data Engineer will design, implement, and test IT solutions within the Data Warehouse, ensuring data quality and pipeline integrity. They will also collaborate with business areas to optimize management platforms and document all technical processes.
What they look for
Requirements
Candidates must have over 6 years of experience in data environments, with expertise in Hadoop, ETL, and various programming languages like Java and Python. A bachelor's or master's degree in Computer Engineering or a related field is required, along with strong analytical and communication skills.
Benefits
Full description
Overview:
Analyses, plans, implements and technically tests IT solutions in the context of projects within the scope of the DataWarehouse. Ensures the formalisation and ensures that documentation is completed in accordance with current procedures. Occasionally participates in meetings with the Business Areas and in working sessions with the team responsible for functional definition, carrying out certification/quality tests and monitoring UAT tests. Proposes improvements to management platforms and tools, with the aim of optimising and innovating them. Formalises and documents the technical analyses it carries out, the technical solutions it implements, the technical tests it performs and the decision-making meetings it participates in. Communicates and validates its activities and decisions with the person in charge, thus ensuring that they are aligned with the department's recommendations in terms of posture and Roadmap. Reports to the Data Hub Chapter.
What are we looking for?
- Experience in the environment of the service : >6 years
- Ensure implementation of data access, referencing, and quality
- Responsible for implementing raw data ingestion pipeline (Data Lake or other)
- SQL / NO SQL expertise
- Ensure industrialisation, supervision, and integration of solutions or data while guaranteeing the service commitment of the production environment, etc.
- Expert in Hadoop zoo Ecosystem
- Knowledge / Mastery of Data
- Knowledge / Technical mastery of the DevOps environment
- Technical mastery of the Data environment
- Expert in Access and Exchange layer (Kafka, Nifi, etc.)
- Expert in Java, Scala, Python, Hive, Spark, etc.
- Expert in ETL and Bash
- Power Bi 3
- Jira/Confluence/ Draw IO
- Knowledge of applications from a user perspective: MS Outlook, Word, Excel and PowerPoint
- Bachelor's or Master's degree in Computer Engineering, Information Technology or similar areas
- Experience in Datawarehouse solutions, with an understanding of all phases of construction
- Minimum of 4 years of experience in functional/technical analysis and definition of corporate data models
- Experience in projects/environments with Agile framework
- Preference for experience in the Banking area (consumer credit)
- Strong communication and organizational skills
- Ability to gather requirements, document and lead meetings
- Autonomy and proactivity. Critical thinking
- Ability to synthesize and solve problems. Adaptability and resilience
- Focus on the customer and delivering results
What can you expect from us?
- A permanent job contract for a long term project;
- Tech equipment + SIM Card + personal smartphone;
- Health and Life Insurance;
- Social events and team buildings;
- The commitment of letting you grow with us, and be rewarded accordingly;
- A dynamic and young team that will be always there to support you;
- Training in the latest technologies;
- Coffee, fruits, snacks and a warm welcoming when you pass by the office.
Similar roles
-
Data Engineer
Fastmarkets Sofia, Sofia-City, Bulgaria
-
Data Engineer - Data & Technology, SCD
Inter IKEA Group Älmhult, Skåne County, Sweden
-
Senior Data Engineer
Morgan Advanced Materials Poland
-
Senior Backend Data Engineer
Eleos Health Tel-Aviv, Tel-Aviv District, Israel
-
Data Engineer (ETL & PySpark)
Unison Group Singapore, Singapore
-
Senior Data Engineer
Version 1 Mumbai City, Maharashtra, India