Data Engineer

About role: The Data Engineer is responsible for designing, building and supporting reliable data pipelines and data products across the data ecosystem. The role develops scalable ingestion, transformation and integration solutions using cloud data platforms and engineering standards. It works closely with data scientists, software engineers, product teams, platform operations and business stakeholders to make trusted data available for analytics, reporting, machine learning and operational use cases.

The role is accountable for engineering quality, data reliability, performance, security and production support across the data-product lifecycle.

Key Responsibilities

Data Pipeline Development

• Design, build and maintain batch and near-real-time data pipelines.
• Develop ingestion and transformation processes for structured and semi-structured data.
• Build reusable data components and curated datasets for reporting, analytics and machine learning.
• Develop solutions using SQL, Python, dbt, PySpark or equivalent technologies.
• Integrate data from enterprise applications, APIs, event streams and external sources.
• Optimise data pipelines for reliability, performance and cost.
• Support migration and modernisation of legacy data processes.

Data Modelling and Quality

• Develop logical and physical data models aligned to business requirements.
• Build dimensional, relational and analytical data structures.
• Implement data-quality rules, reconciliations and validation controls.
• Investigate data defects and coordinate remediation with source-system and product teams.
• Maintain data definitions, lineage, metadata and technical documentation.
• Apply appropriate handling for sensitive, customer and commercially restricted data.

Engineering and DevOps Practices

• Develop maintainable, tested and version-controlled data solutions.
• Implement automated testing across ingestion, transformation and data-quality processes.
• Support CI/CD pipelines and controlled deployment across development, test and production.
• Participate in code reviews and apply engineering standards.
• Implement monitoring, alerting and operational logging.
• Reduce manual deployment and support activities through automation.

Production Support and Operations

• Monitor production pipelines, schedules and data-processing workloads.
• Investigate and resolve failed jobs, delayed data and data-quality incidents.
• Participate in incident, problem and change-management processes.
• Perform root-cause analysis and implement permanent remediation.
• Maintain operational runbooks, support procedures and recovery steps.
• Work with Platform Operations to ensure data products meet availability and service-level requirements.

Collaboration and Delivery

• Work with product owners and stakeholders to define data requirements and acceptance criteria.
• Collaborate with data scientists to provide model-ready datasets and features.
• Work with software engineers to support application and API data requirements.
• Contribute to technical design, estimation and delivery planning.
• Communicate data risks, dependencies and design decisions clearly.

Required Skills and Experience

• Experience delivering enterprise data-engineering solutions.
• Advanced SQL skills and strong understanding of data structures and query performance.
• Experience with at least two of the following:
• Snowflake
• dbt
• Azure Data Factory
• Databricks and PySpark
• Python-based data engineering
• Experience building automated data-ingestion and transformation pipelines.
• Strong understanding of data modelling, warehousing and analytical data patterns.
• Experience implementing data-quality controls and reconciliation processes.
• Experience with Git, code reviews and CI/CD practices.
• Understanding of cloud security, access control and data-protection requirements.
• Experience supporting production data pipelines and resolving operational incidents.
• Strong technical documentation and stakeholder-communication skills.
• Tertiary qualification in computer science, engineering, information systems or a related discipline, or equivalent practical experience.

Key Deliverables and Success Measures

• Reliable and scalable data pipelines and data products.
• Achievement of agreed data availability and processing service levels.
• Reduction in pipeline failures and recurring data-quality issues.
• Accurate, traceable and well-documented datasets.
• Automated testing, deployment, monitoring and recovery processes.
• Improved pipeline performance and cloud-cost efficiency.
• Compliance with security, data-governance and engineering standards.
• Positive engagement with product, platform, analytics and business stakeholders.

Benefits of working at Accenture:

·       18 weeks paid parental leave

·       Long & short-term career break opportunities

·       Structured career development program

·       Local and international career opportunities.

·       Certified as a Family Inclusive Workplace™

·       Flexible Work Arrangements - centered around Accenture’s Truly Human ethos and our commitment to supporting the health and wellbeing of our people.

·       We are proud to be in the top 3 of last year’s Diversity & Inclusion Index!

We are a WORK180 Endorsed Employer, to see our benefits and policies click here

All our consulting professionals receive comprehensive training covering business acumen, technical and professional skills development. You’ll also have opportunities to hone your functional skills and expertise in an area of specialization. We offer a variety of formal and informal training programs at every level to help you acquire and build specialized skills faster. Learning takes place both on the job and through formal training conducted online, in the classroom, or in collaboration with teammates. The sheer variety of work we do, and the experience it offers, provide an unbeatable platform from which to build a career. 

Accenture is a an EEO and Affirmative Action Employee of Females/Minorities/Veterans/Individuals with Disabilities. 

Equal Employment Opportunity Statement for Australia:

At Accenture, we recognise that our people are multi-dimensional, and we create a work environment where all people feel like they can bring their authentic selves to work, every day.   

Our unwavering commitment to inclusion and diversity unleashes innovation and creates a culture where everyone feels they have equal opportunity. Our range of progressive policies support flexibility in ‘where’, ‘when’ and ‘how’ our people work to ensure that Accenture is an organisation where you can strive for more, achieve great things and maintain the balance and wellbeing you need. 

We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email exectalent@accenture.com and cite the relevant Job Number, or contact us on +61 2 9005 5000.   

To ensure our workplace is inclusive and diverse we are setting bold goals and taking comprehensive action. To achieve these goals, we collect information that allows us to track the effectiveness of our Inclusion and Diversity programs. Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.

#LI_GM

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com 

Equal Employment Opportunity Statement for Australia:

At Accenture, our intention is to foster a culture and a workplace in which all of our people feel a sense of belonging and are respected and empowered to do their best work. 

As part of our talent strategy, we hire and develop people who have different backgrounds, different perspectives and different lived experiences. These differences ensure that we have and attract the cognitive diversity to deliver a variety of perspectives, observations and insights which are essential to drive the innovation needed to reinvent, and we hold our leaders accountable for ensuring we have the most innovative and talented people in our industry.

  We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email exectalent@accenture.com and cite the relevant Job Number, or contact us on +61 2 9005 5000.

Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement