GCP Data Engineer
EXL Hyderabad, Telangana, India
Business Consulting and Services · 10,001+ employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Manage data engineering projects and provide strategic guidance to the team. Oversee the development and maintenance of cloud-based data pipelines and transformations while ensuring data quality and performance.
What they look for
Requirements
Requires hands-on experience in SQL, DBT, Python, BigQuery, and data warehousing concepts. Candidates must have exposure to SAS environments and experience supporting large-scale cloud migration projects.
Full description
Data Engineering
- SQL
- Data Warehousing Concepts
- ETL/ELT Development
- Data Validation and Reconciliation
- Data Pipeline Development
Cloud Technologies
- Google Cloud Platform (GCP)
- BigQuery
- Cloud Storage
- Cloud Composer (Airflow)
Development Tools
- DBT (Data Build Tool)
- Git/GitHub
- Python (Basic to Intermediate)
SAS Knowledge
- Understanding of SAS datasets
- PROC SQL
- SAS ETL concepts
- SAS code analysis
Data Modeling Understanding
- Star Schema
- Dimension and Fact Tables
- Source-to-Target Mapping
- Data Lineage Concepts
Responsibilities
Manage data engineering projects. Provide strategic guidance. Oversee data engineering team. Ensure continuous improvement of data processes.
Qualifications
SAS Migration Support
- Analyze SAS programs, PROC SQL code, and SAS datasets.
- Assist in converting SAS transformation logic into DBT models and SQL transformations.
- Support migration of data from legacy SAS environments to GCP.
- Participate in code conversion, testing, and reconciliation activities.
Data Pipeline Development
- Develop and maintain ELT pipelines using DBT and BigQuery.
- Build reusable transformation models following DBT best practices.
- Implement data ingestion and processing workflows.
- Support batch and incremental data processing requirements.
Data Transformation & Modeling
- Develop SQL-based transformations for Bronze, Silver, and Gold layers.
- Implement business rules and data quality validations.
- Support dimensional models, fact tables, and dimension tables.
- Assist Data Modelers and Architects in implementing target-state data models.
Data Quality & Testing
- Perform source-to-target validation and reconciliation.
- Support automated testing using DBT tests.
- Investigate and resolve data quality issues.
- Ensure completeness, accuracy, and consistency of migrated data.
GCP Development
- Work with GCP services including:
- BigQuery
- Cloud Storage
- Dataproc
- Cloud Composer (Airflow)
Similar roles
-
AI & Synthetic Data Engineer
Lenovo Beijing, China
-
Senior Data Engineer
Qode Hà Nội, Vietnam
-
Senior Data Engineer
Fictiv Schaumburg, Illinois, United States · $167K–$202K/yr
-
Foundation Model Data Engineer
Sciforium San Francisco, California, United States · $155K–$210K/yr
-
Data Engineer_Red shift
XPT Software Australia Pty Ltd Victoria, Australia
-
Data Engineer
XPT Software Australia Pty Ltd Greater Brisbane, Queensland, Australia