Sr Data Engineer
Capgemini · Aguascalientes City, Aguascalientes, Mexico
IT Services and IT Consulting · 10,001+ employees
About the role
Design, build, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark. Implement Lakehouse architecture and collaborate with data scientists to enable advanced analytics and machine learning workloads.
What they look for
Requirements
Requires experience with Delta Lake, Lakehouse architecture, and Azure Data Factory for orchestration. Proficiency in SQL, Spark SQL, and exposure to CI/CD pipelines and Azure data engineering certifications are expected.
Benefits
Full description
Sr- Data Engineer- Sr | Remote
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
YOUR ROLE
• Design, build, and maintain data pipelines and ETL processes using Databricks and Apache Spark.
• Optimize data workflows for performance, scalability, and cost efficiency.
• Implement data Lakehouse architecture and manage data ingestion from multiple sources.
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning workloads.
• Ensure data quality, governance, and security across all data assets.
• Monitor and troubleshoot Databricks clusters, jobs, and workflows.
• Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems.
• Document processes, standards, and best practices for data engineering.
YOUR PROFILE
• Experience with Delta Lake and Lakehouse architecture.
• Knowledge of Azure Data Factory (ADF) for orchestration.
• Exposure to CI/CD pipelines for data engineering.
• Experience with SQL and Spark SQL.
• Azure certifications related to data engineering.
WHAT YOU’LL LOVE ABOUT WORKING HERE?
- At Capgemini Engineering, we encourage flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment. They partner with their managers to find an arrangement that works best for their role and their circumstances.
- At Capgemini Engineering, we’re always looking ahead. We’re part of a team that creates opportunities to achieve valuable change. Change that makes a difference. New connections, new technologies, new ways to work. It’s so energizing.
- At Capgemini Engineering, we make it easy for you to deepen knowledge and learn new skills while you’re still doing the day job.
ABOUT CAPGEMINI
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 300,000 team members in nearly 50 countries. With its strong 50-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering, and platforms.
Get the future you want!
At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.