A

Data Engineer (Test Job)

ATOM Technologies Limited Dubai, Dubai, United Arab Emirates

IT Services and IT Consulting · 11-50 employees

5 h ago
data-engineer Senior (5-10 yrs) Full-time United Arab Emirates
Log in to apply, save this posting, or score it against your profile with AI.

About the role

The Data Engineer will manage the end-to-end data lifecycle, including ingestion, transformation, and curation of data pipelines. They will also collaborate with data scientists and stakeholders to build scalable AI/ML solutions and ensure robust data governance and security.

What they look for

Data Engineering Python SQL ETL/ELT Pipelines Snowflake Databricks Azure GCP AWS Data Modelling Machine Learning Generative AI CI/CD DevOps Data Governance Cloud Architecture

Requirements

Candidates must have at least 5 years of experience in data engineering with proficiency in Python, SQL, and cloud platforms like Snowflake or Databricks. A bachelor’s or master’s degree in a quantitative field such as computer science, statistics, or mathematics is required.

Full description

INTRODUCTIONATOM is a leading end-to-end, integrated insurance operating system built on the latest technology stack. ATOM enables MGAs, Brokers and Insurers to automate the entire life cycle of the insurance process incorporating not only insurance underwriting and claims handling but also all associated support and corporate activities.

Based in one of the most innovative areas of Dubai, the DIFC Innovation Hub, a dynamic group of more than 40 passionate and dedicated insurance and software professionals are on a mission to take the specialty insurance industry to the next level.

We are looking for an experienced Data Engineer to join our growing team!

ROLE SUMMARYAs a Data Engineer you will contribute across the end-to-end data development lifecycle for data ingestion, cleansing, validation, transformation, curation and presentation. Reporting to the Principal Data & AI, you will work within a talented team of data engineers to deliver high-impact, secure data and AI solutions that support the ambitious goals of ATOM’s customers and stakeholders.

RESPONSIBILITIES•       Hands-on Engineering & Delivery

◦       Develop, test, and maintain robust ETL/ELT pipelines to ingest and transform data from multiple sources into the data lake and data marts.

◦       Implement robust web scraping solutions.

◦       Optimise performance and cost of data workloads (partitioning, compression, query tuning, etc).

•       Data Modelling & Platform Contribution

◦       Apply data modelling standards (dimensional models, star/snowflake schemas, canonical data models) to support reporting, analytics, and AI/ML use cases.

◦       Contribute to the evolution of the cloud data architecture under the guidance of the Principal Data & AI.

 

•       Analytics, BI, ML & AI Enablement

◦       Work with data scientists, ML engineers, and analytics teams to support the productionisation of ML/AI and LLM-based solutions through reliable data pipelines and feature stores.

◦       Expose curated, well-documented datasets to enable self-service reporting, dashboards, and analytical tools.

•       Quality, Governance & Security

◦       Follow data governance, data quality, and metadata management practices across the platform.

◦       Apply security best practices (IAM roles and policies, encryption at rest and in transit, row/column-level security, auditing and monitoring).

•       Collaboration & Ways of Working

◦       Partner with product, engineering, and business stakeholders to understand data requirements and translate them into scalable technical solutions.

◦       Contribute to code reviews, documentation, testing, and DevOps/CI-CD practices, adhering to clean code, reusable components, version control, and observability standards.

•       Hands-on experience as a data engineer with focus on Snowflake, Databricks, Azure, GCP and/or AWS platforms.

•       Strong programming skills in Python, SQL and other relevant languages.

•       Proven experience in developing ETL/ELT pipelines using various technologies, including but not limited to dbt, Informatica, Talend, AWS Glue, Python, SQL, etc.

•       Working knowledge of SAP HANA / SAP HANA Cloud data modelling, XS Engine, Calculation Views, SDI/SDA is a strong plus.

•       Experience with analytical frontend tools (e.g. Power BI, Tableau, Spotfire, MicroStrategy, SAP Analytics Cloud).

•       Exposure to Large Language Models, generative AI, and intelligent agents, including hands-on experience building Agentic AI workflows and automations using tools such as n8n, LangChain / LangGraph, Make (Integromat), Zapier AI, CrewAI, or similar orchestration frameworks.

•       Experience delivering CI/CD and DevOps capabilities in a data environment.

•       A bachelor’s or master’s degree in computer science, Statistics, Mathematics or related.

•       A collaborative, proactive problem solver with strong communication skills and the ability to work effectively across diverse teams.

•       At minimum 5 years of experience in a similar role.

Similar roles