JobCubby JobCubby
Sign up
Unison Group

Data Engineer

Unison Group Singapore, Singapore

Business Consulting and Services · 11-50 employees

6 h ago
data-engineer Mid (2-5 yrs) Full-time Singapore
Log in to apply, save this posting, or score it against your profile with AI.

About the role

Design, develop, and maintain scalable ETL/ELT pipelines while optimizing SQL queries and PySpark jobs for efficiency. Collaborate with cross-functional teams to build data models and ensure data quality through rigorous cleansing and validation.

What they look for

Python PySpark SQL ETL ELT Data Modeling Data Pipelines Data Cleansing Data Validation Data Governance Performance Tuning Data Mapping Workflow Automation Analytics Machine Learning

Requirements

The role requires proficiency in Python, PySpark, and SQL for building robust data transformation logic. Candidates must be capable of managing data governance standards and troubleshooting complex pipeline issues in a production environment.

Full description

  • Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, and SQL.
  • Perform data extraction, transformation, and loading from multiple source systems into enterprise data platforms.
  • Develop reusable data transformation logic to support business reporting, analytics, and machine learning initiatives.
  • Optimize SQL queries and PySpark jobs to improve performance and processing efficiency.
  • Build and maintain data models, staging layers, and curated datasets for downstream consumption.
  • Perform data cleansing, validation, reconciliation, and quality checks to ensure data accuracy and consistency.
  • Troubleshoot and resolve data pipeline failures, performance bottlenecks, and data-related issues.
  • Collaborate with business analysts, data architects, and data scientists to understand data requirements and implement scalable solutions.
  • Participate in code reviews, testing, deployment, and production support activities.
  • Develop and maintain technical documentation, including data mappings, transformation logic, and ETL workflows.
  • Ensure compliance with data governance, security, and regulatory standards.
  • Monitor scheduled ETL jobs and proactively address operational issues.

Similar roles