Data Engineer Lead
XPT Software Australia Pty Ltd Victoria, Australia
IT Services and IT Consulting · 51-200 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design and maintain reusable data engineering frameworks to support batch, streaming, and near-real-time processing. Implement production-grade pipelines with robust error handling, logging, and performance optimization.
What they look for
Requirements
Requires strong experience in ETL/ELT development, SQL-based transformations, and distributed data processing. Must possess proficiency in Kafka, API implementation, PostgreSQL, and AWS cloud services.
Full description
Must Have Skills: Kafka, API implementation, PostgreSQL, AWS
Nice to Have Skills: AWS certified
Detailed Job Description
Good communication skills with knowledge on Kafka, API implementation, PostgreSQL, AWS
•Strong understanding of SDLC process.
•Should have Strong understanding and trouble shooting skills
Core requirements:
- Must have strong experience in building,
enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‑real‑time processing.
- Must be able to design
reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
- Must demonstrate proficiency in ETL/ELT
development, SQL-based transformations, and distributed data processing.
Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
Similar roles
-
Data Engineer II, JVM
PlayStation Global Austin, Texas, United States · $150K–$225K/yr
-
Data Engineer - 12 month fixed term contract
BlueScope Sydney, New South Wales, Australia
-
Associate Data Engineer II
AbbVie Mettawa, Illinois, United States · $66K–$126K/yr
-
Lead Data Engineer
SS&C Technologies Bangkok, Thailand
-
Data Management Specialist - Data Engineer
Jobgether United States
-
Data Engineer
Benchling San Francisco, California, United States · $154K–$208K/yr