Data Node Engineer
XPT Software Australia Pty Ltd · Victoria, Australia
IT Services and IT Consulting · 51-200 employees
About the role
Develop and maintain scalable, automated ETL/ELT data pipelines using tools like Glue and Airflow. Ensure data quality, secure PII handling, and reliable data availability for BI and AI systems.
What they look for
Requirements
Requires 4-8 years of experience and proficiency in Python, SQL, and AWS data services. Candidates should have strong skills in pipeline orchestration and data transformation.
Full description
Must Have Skills: Python, SQL, Airflow, Terraform, Glue, Lambda, Step Functions, MWAA, S3, Athena
Nice to Have Skills: Any Data related skills
Role Summary: Build and maintain scalable, automated data pipelines for ingestion,
transformation, and processing. Ensures reliable and timely data availability for
analytics and AI use cases.
Key Responsibilities:
- Develop
ETL/ELT pipelines using Glue, Airflow, Step Functions
• Implement data transformations and orchestration
- Ensure
data quality, PII handling, and pipeline reliability
Business/Tech Impact: Drives data availability and freshness for downstream BI and AI
systems, directly impacting decision-making speed. Reduces manual intervention
through automation and standardized pipeline patterns.
