Senior Lead Data Engineer - R01573561
Brillio Bangalore, Karnataka, India
Artificial Intelligence · 5,001-10,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery. Manage GCP infrastructure components, security protocols, and lead migration initiatives to transition legacy systems to cloud-based architectures.
What they look for
Requirements
Requires 5 to 8 years of hands-on experience in data engineering with significant expertise in GCP infrastructure and cloud-based ETL solutions. Candidates should possess a bachelor's degree in a relevant field and hold professional certifications in GCP or Informatica.
Full description
Senior Lead Data Engineer
\n
Primary Skills• Google Cloud Platform Administration, Google Cloud Platform (GCP), Gsuite, Apigee, GCP Security
Specialization• GCP Infrastructure Engineering: Engineer, Database & Middleware
Job requirements• Experience Range: With at least 5 to 8 years of hands-on experience in data engineering, including significant expertise in GCP infrastructure and cloud-based ETL solutions Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery 2. Implement, maintain, and troubleshoot GCP infrastructure components, ensuring high availability and security compliance 3. Automate data integration processes utilizing Python, SQL, and shell scripting to support business analytics and reporting 4. Configure and manage GCP security protocols, including IAM roles, audit logging, and data encryption to safeguard sensitive information 5. Integrate Salesforce data with cloud data warehouses, ensuring seamless data flow and accuracy 6. Monitor and tune BigQuery performance, optimizing queries and resource utilization for large-scale datasets 7. Lead migration and modernization initiatives, transitioning legacy systems to GCP-based architectures 8. Document technical solutions, workflow processes, and best practices for ongoing knowledge sharing and operational excellence Required Skills: 1. Google Cloud Platform (GCP) administration 2. IICS (Informatica Intelligent Cloud Services) 3. BigQuery 4. Shell scripting 5. Python 6. Advanced SQL Preferred Skills: 1. Experience with Salesforce data integration 2. Expertise in cloud migration strategies 3. Knowledge of data governance frameworks 4. Proficiency with Terraform or similar infrastructure-as-code tools 5. Familiarity with Kubernetes on GCP 6. Experience with real-time data streaming solutions Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline 2. Google Professional Data Engineer certification or equivalent relevant GCP certification 3. Informatica Cloud certification
\n
Similar roles
-
Experienced - Data Engineer DATABRICKS - NextHub Bari
Deloitte Italia Bari, Apulia, Italy · €28K–€44K/yr
-
Senior Data Engineer - Databricks Specialist
University of Otago Otago, New Zealand
-
Senior Data Engineer
UBDS Group Manchester, England, United Kingdom
-
Data Engineer
UBDS Group London, England, United Kingdom · £40K–£48K/yr
-
Data Engineer II, AWS Analytics Engineering
Amazon Seattle, Washington, United States · $132K–$179K/yr
-
Data Engineer Intern
Munich Re Singapore, Singapore, Singapore