JobCubby JobCubby
Sign up
CAL

Senior Data Engineer

CAL Colombo, Western Province, Sri Lanka

Banking · 1,001-5,000 עובדים

14 h ago
data-engineer Senior (5-10 yrs) Full-time Sri Lanka
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Build and optimize scalable batch and incremental ETL/ELT pipelines while designing medallion data layers. Monitor production pipelines, troubleshoot issues, and collaborate with analytics teams to deliver high-quality datasets.

What they look for

Data Engineering Snowflake Python Java PySpark Spark SQL SQL Airflow ETL ELT CDC SCD Medallion Architecture Git CI/CD Cloud Platforms

Requirements

Requires 5+ years of hands-on experience in big data or cloud platforms and a degree in Computer Science or a related field. Proficiency in Python or Java, advanced SQL, and experience with tools like Snowflake, Airflow, and Spark is essential.

Full description

We're looking for a Senior Data Engineer to build and optimize scalable data pipelines and cloud data platforms that power real-time analytics and decision-making. If you're passionate about modern data engineering, we'd love to hear from you.

What You'll Do

  • Build and optimize batch and incremental ETL/ELT pipelines
  • Design medallion (bronze/silver/gold) data layers with CDC and SCD
  • Monitor and troubleshoot production pipelines, and optimize compute and storage costs
  • Deliver high-quality, well-modeled datasets for analytics and data science teams
  • Document your work, review code and collaborate in an Agile team

Candidate Profile

  • Degree in Computer Science, IT, Big Data or a related field, or equivalent experience
  • 5+ years of hands-on data engineering on big data or cloud data platforms
  • Strong production experience with Snowflake (preferred), Hadoop (HDFS) or AWS (S3)
  • Strong Python or Java; hands-on with PySpark, Spark SQL or Snowpark
  • Advanced SQL (MySQL, SQL Server or Oracle), including query tuning and optimization
  • Production experience with Airflow (preferred), Oozie or Informatica
  • Proven experience implementing CDC, SCD and medallion architectures
  • Track record of troubleshooting production pipelines and reducing compute and storage costs
  • Git, CI/CD and code review experience

Similar roles