EXL

GCP Data Engineer

EXL Hyderabad, Telangana, India

Business Consulting and Services · 10,001+ employees

Oct 07
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Manage data engineering projects and provide strategic guidance to the team. Oversee the development and maintenance of cloud-based data pipelines and transformations while ensuring data quality and performance.

What they look for

GCP BigQuery SQL DBT Python Data Engineering Data Warehousing ETL ELT SAS Cloud Composer Airflow Data Modeling Git Data Migration Data Quality

Requirements

Requires hands-on experience in SQL, DBT, Python, BigQuery, and data warehousing concepts. Candidates must have exposure to SAS environments and experience supporting large-scale cloud migration projects.

Full description

Data Engineering

  • SQL
  • Data Warehousing Concepts
  • ETL/ELT Development
  • Data Validation and Reconciliation
  • Data Pipeline Development

Cloud Technologies

  • Google Cloud Platform (GCP)
  • BigQuery
  • Cloud Storage
  • Cloud Composer (Airflow)

Development Tools

  • DBT (Data Build Tool)
  • Git/GitHub
  • Python (Basic to Intermediate)

SAS Knowledge

  • Understanding of SAS datasets
  • PROC SQL
  • SAS ETL concepts
  • SAS code analysis

Data Modeling Understanding

  • Star Schema
  • Dimension and Fact Tables
  • Source-to-Target Mapping
  • Data Lineage Concepts

Responsibilities

Manage data engineering projects. Provide strategic guidance. Oversee data engineering team. Ensure continuous improvement of data processes.

Qualifications

SAS Migration Support

  • Analyze SAS programs, PROC SQL code, and SAS datasets.
  • Assist in converting SAS transformation logic into DBT models and SQL transformations.
  • Support migration of data from legacy SAS environments to GCP.
  • Participate in code conversion, testing, and reconciliation activities.

Data Pipeline Development

  • Develop and maintain ELT pipelines using DBT and BigQuery.
  • Build reusable transformation models following DBT best practices.
  • Implement data ingestion and processing workflows.
  • Support batch and incremental data processing requirements.

Data Transformation & Modeling

  • Develop SQL-based transformations for Bronze, Silver, and Gold layers.
  • Implement business rules and data quality validations.
  • Support dimensional models, fact tables, and dimension tables.
  • Assist Data Modelers and Architects in implementing target-state data models.

Data Quality & Testing

  • Perform source-to-target validation and reconciliation.
  • Support automated testing using DBT tests.
  • Investigate and resolve data quality issues.
  • Ensure completeness, accuracy, and consistency of migrated data.

GCP Development

  • Work with GCP services including:
  • BigQuery
  • Cloud Storage
  • Dataproc
  • Cloud Composer (Airflow)

Similar roles