Brillio

Senior Lead Data Engineer - R01573561

Brillio Bangalore, Karnataka, India

Artificial Intelligence · 5,001-10,000 employees

4 d ago
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery. Manage GCP infrastructure components, security protocols, and lead migration initiatives to transition legacy systems to cloud-based architectures.

What they look for

Google Cloud Platform IICS BigQuery Shell Scripting Python Advanced SQL GCP Infrastructure Data Engineering ETL Salesforce Integration IAM Data Encryption Cloud Migration Kubernetes Terraform

Requirements

Requires 5 to 8 years of hands-on experience in data engineering with significant expertise in GCP infrastructure and cloud-based ETL solutions. Candidates should possess a bachelor's degree in a relevant field and hold professional certifications in GCP or Informatica.

Full description

Senior Lead Data Engineer

\n

Primary Skills• Google Cloud Platform Administration, Google Cloud Platform (GCP), Gsuite, Apigee, GCP Security

Specialization• GCP Infrastructure Engineering: Engineer, Database & Middleware

Job requirements• Experience Range: With at least 5 to 8 years of hands-on experience in data engineering, including significant expertise in GCP infrastructure and cloud-based ETL solutions Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery 2. Implement, maintain, and troubleshoot GCP infrastructure components, ensuring high availability and security compliance 3. Automate data integration processes utilizing Python, SQL, and shell scripting to support business analytics and reporting 4. Configure and manage GCP security protocols, including IAM roles, audit logging, and data encryption to safeguard sensitive information 5. Integrate Salesforce data with cloud data warehouses, ensuring seamless data flow and accuracy 6. Monitor and tune BigQuery performance, optimizing queries and resource utilization for large-scale datasets 7. Lead migration and modernization initiatives, transitioning legacy systems to GCP-based architectures 8. Document technical solutions, workflow processes, and best practices for ongoing knowledge sharing and operational excellence Required Skills: 1. Google Cloud Platform (GCP) administration 2. IICS (Informatica Intelligent Cloud Services) 3. BigQuery 4. Shell scripting 5. Python 6. Advanced SQL Preferred Skills: 1. Experience with Salesforce data integration 2. Expertise in cloud migration strategies 3. Knowledge of data governance frameworks 4. Proficiency with Terraform or similar infrastructure-as-code tools 5. Familiarity with Kubernetes on GCP 6. Experience with real-time data streaming solutions Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline 2. Google Professional Data Engineer certification or equivalent relevant GCP certification 3. Informatica Cloud certification

\n

Similar roles