Guardian Life Insurance

Data Engineer - IT

Guardian Life Insurance Gurgaon, Haryana, India

Financial Services · 5,001-10,000 employees

Yesterday Closes in 1d
data-engineer Mid (2-5 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and build scalable data pipelines for structured and semi-structured data using Databricks and Spark. Implement data warehousing solutions and ensure high performance through optimized SQL and Spark configurations.

What they look for

Databricks PySpark Apache Spark SQL ETL Data Warehousing Data Modeling Data Pipelines Data Lake Delta Lake Git AWS Jenkins Unity Catalog Agile Scrum

Requirements

Requires strong hands-on experience with Databricks, PySpark, and advanced SQL techniques. Candidates should have a solid understanding of ETL concepts, data modeling, and version control practices.

Full description

Job Description:

Required Skills & Experience Strong hands-on experience in:

  • Databricks (Lakehouse platform, notebooks, jobs, clusters)
  • PySpark / Apache Spark
  • Advanced SQL (joins, window functions, performance tuning)
  • Solid understanding of ETL concepts, data warehousing, and data modeling
  • Experience building scalable data pipelines for structured and semi-structured data
  • Familiarity with data lake / delta lake architecture
  • Good understanding of performance optimization techniques in Spark and SQL
  • Experience with version control (Git) and deployment practices
  • Strong problem-solving and analytical skills

Good to Have

  • Experience with cloud platforms (AWS)
  • Exposure to CI/CD pipelines (Jenkins)
  • Knowledge of Delta Lake, Unity Catalog, or similar governance tools
  • Understanding of data quality frameworks / monitoring tools
  • Experience working in Agile / Scrum teams

Location:

This position can be based in any of the following locations:

Chennai, GurgaonCurrent Guardian Colleagues: Please apply through the internal Jobs Hub in Workday

Similar roles