P

Lead Data Engineer

Publicis Groupe Holdings B.V Bengaluru, Karnataka, India

Information Services · 11-50 employees

3 h ago
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and implement end-to-end Generative AI and LLM-based architectures while integrating them with enterprise data and applications. Develop, fine-tune, and deploy custom AI models and data pipelines to ensure scalability and performance.

What they look for

Generative AI Large Language Models Python SQL PySpark AWS Data Engineering Machine Learning LangChain LlamaIndex Vector Databases ETL/ELT Solution Architecture Data Pipelines Cloud Computing Deep Learning

Requirements

Requires a Bachelor’s or Master’s degree in Computer Science or a related field with at least 8 years of experience in data engineering and AI solution development. Candidates must possess strong expertise in Python, SQL, cloud platforms, and modern AI frameworks.

Full description

Overview

About Business Unit:

As part of the Digital Integration Services team, you’ll be at the forefront of modernizing marketing and delivering ground-breaking solutions. From crafting data-driven, personalized experiences that customers truly value to turning marketing visions into reality - we empower brands to achieve their goals.

Our team of 1,200 experts in strategy, analytics, creative, and digital experience uses innovative technology and data-driven insights to craft relevant, customer-centric strategies for the world’s leading brands.

Organization Objective/Purpose

  • This position is in the Engineering team under the Digital Experience organization. We drive the first mile of customer experience through personalization of offers and content. We are currently on the lookout for a smart, highly driven individual.
  • You will be part of a team that is focused on building solutions and pipelines using latest engineering (data & AI/ML) design principles and tech stacks. You will also be expected to Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery and automate continuous integration and deployment processes/pipelines.
  • The incumbent is also expected to partner with various stakeholders, bring scientific rigor to design and develop high quality software.
  • She / He also must have excellent verbal and written communication skills and be comfortable working in an entrepreneurial, start-up environment within a larger company.

Role Summary:

We are seeking an experienced Data Engineer with deep expertise in Generative AI, Large Language Models (LLMs), and scalable AI/ML/Data solution design. The ideal candidate will be capable of building & architecting robust Gen AI solutions while engaging with partners to shape AI strategy and adoption.

This role requires strong experience across data engineering, cloud platforms, and AI solution delivery — ensuring end-to-end integration from data foundation to deployed intelligent systems.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice.

Responsibilities

  • Solution Architecture & Design
  • Design and implement end-to-end Generative AI and LLM-based architectures, integrating with enterprise data and applications.
  • Define reference architectures, frameworks, and best practices for scalable AI driven applications.
  • Architect and operationalize RAG (Retrieval-Augmented Generation) and LLM-based workflows using cloud-native components (e.g., AWS Bedrock, SageMaker, Lambda, API Gateway).
  • Ensure scalability, reliability, and governance across AI, data, and ML pipelines.
  • Hands-on Development
  • Develop, fine-tune, and deploy LLMs and custom AI models using frameworks like LangChain, LlamaIndex, and Hugging Face.
  • Build data ingestion and transformation pipelines integrating structured and unstructured data.
  • Use SQL and Python for data wrangling, feature engineering, and analytics within AI workflows.
  • Implement vector search and semantic retrieval with platforms such as Pinecone, FAISS, or Chroma.
  • Innovation & Leadership
  • Stay ahead of with advancements in AI/ML frameworks, LLM technologies, and Gen AI ecosystems.
  • Evaluate emerging tools, open-source models, and platforms for enterprise AI applications.
  • Mentor data scientists and engineers in building and scaling AI-powered systems.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science or related field.
  • 8+d years of total experience, including significant hands-on in Data Engineering solutions & exposure to Generative AI solution development.
  • Experience working on AdTech or MarTech technologies is added advantage
  • Strong analytic thought process and ability to interpret findings

Required Skills & Competencies:

  • Proven expertise in Generative AI and LLM architectures (OpenAI, Anthropic, Azure OpenAI, Hugging Face, LangChain, LlamaIndex).
  • Strong hands-on experience in Python, SQL, PySpark and data pipeline design (ETL/ELT, data orchestration, and transformation).
  • Solid understanding of data management, governance, and integration patterns for AI systems.
  • Proficiency in AWS cloud services (SageMaker, Bedrock, Lambda, ECS, API Gateway, S3, Glue, Redshift).
  • Experience building machine learning & deep learning models.
  • Experience with vector databases and embedding pipelines for contextual retrieval.
  • Excellent problem-solving and communication skills; ability to present technical concepts to non-technical audiences.

Preferred Skills:

  • Familiarity with enterprise data architectures, data lakes, and knowledge graphs.
  • Experience with Databricks, AWS AI services, or cloud-native LLM hosting and orchestration.
  • Contributions to AI open-source projects or participation in technical communities.

In addition, the candidate should have strong eye for business, and interpersonal and communication skills, yet also be able to work independently. He / she should be able to communicate findings and the way techniques work in a manner that partnersders, both technical and non-technical, will understand.

Additional Information

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Our pillars aren't just words. They're how we show up every day.

  • People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.
  • Collaboration: We work together, support one another, and collectively achieve goals.
  • Growth: There are endless opportunities for growth through learning, development and career advancement.
  • Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.
  • Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

  • Act with integrity
  • Work together to win together
  • Innovate with purpose
  • Respect all voices
  • Empower with accountability

These pillars and values are our foundation—shaping our culture, guiding our decisions, and uniting us in common purpose.

Epsilon is an Equal Opportunity Employer. Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.

Similar roles