About the role

You will build and enhance enterprise data pipelines that ingest data from multiple sources into Databricks Unity Catalog and Delta Lake. Additionally, you will strengthen the remediation and matching layer of the pipeline, including automatic remediation and LLM-assisted workflows.

What they look for

PySpark Python Databricks Unity Catalog Delta Lake Data pipelines Entity resolution Data remediation API integration LLM-assisted workflows AI-enabled data engineering Enterprise data platforms

Requirements

Candidates must have strong experience in PySpark, Python, and Databricks, along with hands-on experience in enterprise data pipelines and entity resolution. A minimum of 5 years of experience in data engineering is desirable.

Benefits

Medical insurance Mental health support Financial consultations Legal consultations Udemy access Language courses Company-paid certifications

Full description

Ciklum is looking for a Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Data Engineer, become a part our Enterprise Data Strategy team. In this role, you will build and enhance enterprise data pipelines that ingest data from multiple sources into Databricks Unity Catalog and Delta Lake, supporting entity resolution, data remediation, and AI-enabled data workflows.

Responsibilities:

Strengthens the remediation and matching layer of that pipeline, specifically automatic remediation
D&B DataBlocks matching
LLM-assisted remediation
Supports the CMG redesign project

Requirements:

Strong experience in PySpark, Python, and Databricks (Unity Catalog & Delta Lake)
Hands-on experience with enterprise data pipelines, entity resolution/matching, and data remediation
Experience integrating APIs into data engineering workflows
Exposure to LLM-assisted data workflows or AI-enabled data engineering is a plus

Desirable:

5+ years of experience in Data Engineering
Experience working with large-scale enterprise data platforms and modern data architectures

What’s in it for you?

Strong community: Work alongside top professionals in a friendly, open-door environment
Growth focus: Take on large-scale projects with a global impact and expand your expertise
Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

About us:

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Explore, empower, engineer with Ciklum!

Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.

#LI-MA1