Data Engineer
Worklife Tech. · Bengaluru, Karnataka, India
About the role
The role involves building, optimizing, and supporting end-to-end data pipelines while managing cloud infrastructure on GCP. It requires collaborating with stakeholders to define data product visions and implementing data mesh principles for integration.
What they look for
Requirements
Candidates must hold GCP certifications and possess expertise in cloud infrastructure and DevOps principles. Experience with large-scale data processing frameworks, various data formats, and DBT is highly preferred.
Full description
Job Description
- Take
end-to-end responsibility for building, optimizing, and supporting existing and new data pipelines aligned with the defined target vision.
- Champion
a DevOps mindset and principles, managing CI/CD pipelines, Terraform, and Cloud infrastructure—primarily on Google Cloud Platform(GCP).
- Ensure
that data products are designed as independent deployment units and adhere to defined standards for security, scalability, observability, and performance.
- Collaborate
closely with the Product Manager and key stakeholders to define the vision for data products and identify new opportunities to support evolving business needs.
- Partner
with product teams across domains to enable data sharing and integration within a data mesh context.
- Drive
continuous improvement, enhance data engineering practices, and reduce technical debt.
- Maintain
up-to-date expertise in data engineering, analytics, and cloud technologies.
· Required cloud certification: GCP Certifications
Good to Have
- Experience
with GCP services such as Cloud Run
- Exposure
to large-scale data processing and orchestration frameworks (e.g., Spark, Beam, Hive).
- Experience
with various data formats (e.g., Avro, Parquet,Iceberg,Hudi).
- Experience
with DBT in production data transformation workflows.
- Knowledge
of modern data governance and cataloging practices.
- Experience
with data visualization tools and collaboration with analytical stakeholders.
