Blend360

Lead Data Engineer - GCP

Blend360 Hyderabad, Telangana, India

Artificial Intelligence · 1,001-5,000 employees

20 h ago
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and develop scalable data pipelines using GCP services while transforming data with Python and SQL. Monitor and troubleshoot production pipelines to ensure data quality, security, and governance standards are met.

What they look for

Google Cloud Platform Python SQL Data Engineering BigQuery Cloud Storage Cloud Composer Airflow Dataflow Pub/Sub Dataproc Apache Spark PySpark ETL/ELT Data Modeling CI/CD

Requirements

Requires 6+ years of experience in data engineering with strong hands-on expertise in Google Cloud Platform. Candidates must possess advanced SQL skills and experience building ETL/ELT pipelines for large-volume datasets.

Full description

Company Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Job Description

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP). The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services.

Key Responsibilities

  • Design and develop scalable and reliable data pipelines using GCP services.
  • Develop data processing and transformation solutions using Python and SQL.
  • Build and optimize ETL/ELT pipelines for large-volume datasets.
  • Work with business and technical teams to understand data requirements and deliver robust solutions.
  • Perform data modeling, data validation, and performance optimization.
  • Monitor and troubleshoot data pipelines and resolve production issues.
  • Implement data quality, security, and governance best practices.
  • Participate in code reviews and contribute to technical design and architecture discussions.

Qualifications

  • 6+ years of experience in Data Engineering.
  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Strong programming experience in Python.
  • Strong expertise in SQL, including complex queries, joins, CTEs, window functions, and query optimization.
  • Experience developing ETL/ELT data pipelines.
  • Hands-on experience with one or more GCP services such as:• BigQuery
  • Cloud Storage (GCS)
  • Cloud Composer / Airflow
  • Dataflow
  • Pub/Sub
  • Dataproc
  • Experience with Apache Spark / PySpark is preferred.
  • Good understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Git and CI/CD practices.

Nice to Have

  • Experience with Terraform or Infrastructure as Code.
  • Exposure to GCP Dataform.
  • Experience with real-time/streaming data pipelines.
  • Knowledge of cloud security and IAM.
  • Experience working in Agile environments.

Additional Information

All your information will be kept confidential according to EEO guidelines.

Similar roles