Atos

GCP Data Engineer

Atos · Chennai, Tamil Nadu, India

Business Consulting and Services · 10,001+ employees

20 h ago Closes in 3d
Senior (5-10 yrs) Full-time India
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using Python and PySpark on Google Cloud Platform. Lead DataOps activities including deployment automation, CI/CD, monitoring, and incident resolution to ensure platform stability.

What they look for

Python PySpark SQL Google Cloud Platform BigQuery Cloud Storage Dataflow Apache Airflow Cloud Composer Terraform Google Kubernetes Engine CI/CD DataOps ETL/ELT Data Engineering Infrastructure as Code

Requirements

Requires 6+ years of experience in Data Engineering with strong proficiency in Python, PySpark, and advanced SQL. Candidates must have hands-on experience with GCP services, CI/CD practices, and infrastructure provisioning tools like Terraform.

Full description

Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements.

With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core IT systems, accelerate cloud and data transformation, strengthen cybersecurity, and deliver secure digital workplace environments to support its clients, its employees and society. Atos also provides consulting and advisory services through its Atos Amplify brand. A trusted partner in operating complex and mission-critical environments, Atos supports organizations across highly regulated and sovereign contexts.

About Atos Group

Atos Group is a global leader in digital transformation with c. 56,000 employees and annual revenue of c. €7.2 billion (at the go-forward perimeter), operating in 54 countries under two brands - Atos for services and Eviden for products and systems. European number one in cybersecurity and a leader in cloud, Atos Group is committed to a secure and decarbonized future and provides tailored AI-powered, end-to-end solutions for all industries. Atos Group is listed on Euronext Paris.

Role Summary

We are looking for an experienced Data Engineer to join our Data Ops team. This is a hands-on engineering role responsible for delivering scalable data solutions while also supporting DataOps practices across the data platform.

The ideal candidate will have strong expertise in building cloud-native data pipelines, implementing ETL/ELT solutions, and driving operational excellence through automation, deployment, monitoring, and platform support.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using Python and PySpark.
  • Build and optimize data processing solutions on Google Cloud Platform (GCP).
  • Develop and maintain workflow orchestration using Apache Airflow (Cloud Composer) or Astronomer.
  • Design and optimize complex SQL queries for analytical workloads.
  • Lead and support DataOps activities, including deployment automation, CI/CD, monitoring, operational support, incident resolution, and continuous improvement of data pipelines.
  • Support infrastructure provisioning and configuration using Terraform.
  • Work with containerized environments and Google Kubernetes Engine (GKE) to support data platform deployments.
  • Monitor pipeline health, data quality, performance, and reliability, implementing proactive alerting and operational best practices.
  • Collaborate with Data Engineers, Analytics teams, Product Owners, and business stakeholders to deliver reliable and scalable data solutions.
  • Troubleshoot production issues and drive root cause analysis to improve platform stability and operational efficiency.
  • Contribute to engineering standards, code reviews, documentation, and adoption of Data Engineering and DataOps best practices.

Required Skills

  • 6+ years of experience in Data Engineering with hands-on development experience.
  • Strong proficiency in Python, PySpark, and advanced SQL.
  • Experience designing and implementing production-grade ETL/ELT pipelines.
  • Hands-on experience with Google Cloud Platform (GCP), including:
  • BigQuery
  • Cloud Storage
  • Dataflow
  • Cloud Composer (Apache Airflow)
  • Secret Manager
  • Experience with CI/CD pipelines and DataOps/DevOps practices.
  • Working knowledge of Terraform and Infrastructure as Code.
  • Familiarity with Google Kubernetes Engine (GKE) or containerized application deployments.
  • Experience monitoring, troubleshooting, and supporting production data platforms.
  • Strong analytical, debugging, and problem-solving skills.
  • Ability to independently own technical deliverables from development through production support.

Preferred Skills

  • Prior American Express experience.
  • Experience with enterprise-scale cloud data platforms.
  • Knowledge of Data Warehousing, Data Modeling, and Data Governance principles.
  • Experience implementing observability, monitoring, logging, and operational automation for data platforms.
  • Experience working in Agile delivery teams.

Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.

Atos is a recognized leader in its industry across Environment, Social and Governance (ESG) criteria. Find out more on our CSR commitment.

Choose your future. Choose Atos.