Senior Data Engineer
Mastercard pune, Maharashtra, India
IT Services and IT Consulting · 10,001+ employees
About the role
The Senior Data Engineer will design, build, and maintain scalable batch and near-real-time data pipelines to support analytics and machine learning workloads. They will also collaborate with data scientists and platform engineers to implement reliable data models and ensure secure data handling practices.
What they look for
Requirements
Candidates must have strong proficiency in SQL and Python or Scala, along with experience in distributed processing frameworks like Spark or Hadoop. A solid understanding of cloud data ecosystems, specifically AWS and Databricks, is required to troubleshoot and optimize production pipelines.
Full description
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Senior Data Engineer
Data Engineer / Machine Learning Engineer Level 7 | FTE | Needed: Q3 Overview The Data Engineering team builds trusted, scalable datasets and pipelines that power analytics, BI, and machine learning use cases across Mastercard. This role will help design and deliver resilient data pipelines, curated data models, and ML-ready feature datasets while partnering closely with platform engineering, data science, and BI stakeholders. Role As a Data Engineer / MLE, you will:
- Design, build, and maintain scalable batch and near-real-time data pipelines.
- Develop curated datasets and data models that enable reliable analytics and ML workloads.
- Implement pipeline reliability patterns (monitoring, alerting, retries, performance tuning).
- Partner with data scientists to enable feature engineering and model operationalization.
- Ensure secure data handling aligned to enterprise governance and compliance expectations.
- Drive engineering best practices (code quality, testing, documentation, CI/CD where applicable).
All About You Essential Skills (Must Have):
- Strong proficiency in SQL and Python (or Scala) for data engineering.
- Experience building data pipelines using distributed processing (e.g., Spark,PySpark,HADOOP).
- Experience in using data technology technology like AWS, S3, Databricks.
- Solid understanding of data modeling (dimensional and/or lakehouse patterns) and data quality concepts.
- Experience working with cloud data ecosystems (AWS preferred) and object storage / lake patterns.
- Ability to troubleshoot performance and reliability issues in production pipelines.
- Strong communication skills and ability to collaborate across engineering and analytics stakeholders.
Nice to have:
- Experience with Databricks or similar lakehouse platforms.
- Exposure to ML feature pipelines, model deployment patterns, or MLOps concepts.
- Experience in payments / banking / regulated environments.
- Familiarity with data governance tooling (catalog, lineage) and PII handling patterns.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Similar roles
-
Associate, Data Engineer
WPP Media Hong Kong, Hong Kong Island, Hong Kong S.A.R.
-
DATA Engineer H/F - Asnières-sur-Seine
Smile Group Asnières-sur-Seine, Ile-of-France, France
-
Senior Data Engineer (m/w/d) – Snowflake
JobRad Loop Munich, Bavaria, Germany
-
Azure Data Engineer
Weekday AI Chennai, Tamil Nadu, India
-
M09 - Data Engineer
FPT Asia Pacific Pte Ltd Singapore, Singapore
-
Senior Data Engineer
CMSPI Manchester, England, United Kingdom