Mid / Senior Data Engineer or Analyst (Citizens with Baseline)
XPT Software Australia Pty Ltd Sydney, New South Wales, Australia
IT Services and IT Consulting · 51-200 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
The role involves building version-controlled pipelines for data profiling, cleansing, transformation, and migration. You will also automate reconciliation processes and provide masked test data for non-production environments.
What they look for
Requirements
Candidates must have experience in data engineering on modern platforms, along with proficiency in SQL and Python or Spark. Desirable qualifications include experience with Databricks, mainframe or Informix data extraction, and working with registry or financial data.
Full description
Purpose: provide data engineering and analysis skills to data heavy deliverables.
Seniority: Mid to senior.
Reports to: Data Architect.
Responsibilities
- Build version controlled pipelines for profiling,
cleansing, transformation and migration.
- Automate reconciliation between legacy and target
(counts, control totals, field comparisons).
- Provide masked test data for non production
environments.
- Document pipelines and pair with ASIC data staff.
Essential: data engineering on a modern platform; SQL and Python or Spark; data quality and reconciliation.
Desirable: Databricks; mainframe or Informix data extraction; registry or financial data.
Similar roles
-
Data Engineer
Ecolab Bangalore, Karnataka, India
-
Sr Data Engineer II
American Express Phoenix, Arizona, United States · $123K–$215K/yr
-
Data Engineer II
Boston Scientific Heredia, Costa Rica
-
Senior Data Engineer
Boston Scientific Arden Hills, Minnesota, United States · $85K–$162K/yr
-
Data Engineer
STMicroelectronics Calamba, Laguna, Philippines
-
Data Engineer
Strategic Innovation Group LLC Arlington County, Virginia, United States · $150–$185/yr