XPT Software Australia Pty Ltd

Data Engineer Lead

XPT Software Australia Pty Ltd Victoria, Australia

IT Services and IT Consulting · 51-200 employees

8 h ago
data-engineer Senior (5-10 yrs) Contractor Australia
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design and maintain reusable data engineering frameworks to support batch, streaming, and near-real-time processing. Implement production-grade pipelines with robust error handling, logging, and performance optimization.

What they look for

Kafka API Implementation PostgreSQL AWS Data Pipeline Frameworks ETL/ELT Development SQL Distributed Data Processing SDLC Troubleshooting Data Quality Controls Orchestration Performance Optimization

Requirements

Requires strong experience in ETL/ELT development, SQL-based transformations, and distributed data processing. Must possess proficiency in Kafka, API implementation, PostgreSQL, and AWS cloud services.

Full description

Must Have Skills: Kafka, API implementation, PostgreSQL, AWS

Nice to Have Skills: AWS certified

Detailed Job Description

Good communication skills with knowledge on Kafka, API implementation, PostgreSQL, AWS

•Strong understanding of SDLC process.

•Should have Strong understanding and trouble shooting skills

Core requirements:

  • Must have strong experience in building,

enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‑real‑time processing.

  • Must be able to design

reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.

  • Must demonstrate proficiency in ETL/ELT

development, SQL-based transformations, and distributed data processing.

Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Similar roles