Senior Data Engineer
Sabenza IT & Recruitment City of Tshwane Metropolitan Municipality, Gauteng, South Africa
IT Services and IT Consulting · 11-50 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
You will design, build, and maintain robust data ingestion and transformation pipelines while setting technical standards for the team. Additionally, you will coach junior engineers and collaborate with analytics and BI teams to ensure data reliability and performance.
What they look for
Requirements
Candidates must hold a bachelor's degree in a relevant field and possess 4-7+ years of experience in data engineering with strong AWS architecture skills. Proficiency in Python, SQL, and data modeling is essential, along with experience in Agile delivery and CI/CD practices.
Full description
The reporting is only as good as the pipeline underneath it. This role owns that layer: the ingestion, the transformations, the checks, and the support when a number downstream does not match.
It is a permanent seat in Centurion, in a retail investments technology team, reporting to the Head of Application Development. You will build and run data pipelines and the platform they sit on, so analytics, BI and the business get data they can trust. You will also set technical direction in the team. That means design calls, engineering standards, and how AI is used in the work without breaking governance.
What you will do
- Deliver data engineering work inside an Agile team. Plan it,
estimate it, break features into tasks, and hit the quality bar you agreed with the product owner.
- Design and build ingestion and transformation pipelines across
systems and domains. Batch and incremental. Error handling, monitoring, alerting, validation and reconciliation included.
- Shape solutions that fit the target data platform. The
environment is cloud and AWS-aligned. You will be expected to call the cost, security, performance and support impact of a design before it is built.
- Coach less experienced data engineers. Give analytics, BI and
data science a clear view of structures, availability and how a pipeline actually behaves.
- Review code and configuration. Simplify what is already there.
Use Git, automated testing, CI/CD and structured releases. Document enough that someone else can support it.
- Use AI in the engineering workflow, on approved tools only. You
validate the output. You do not put client or proprietary data into a public model. You stay accountable for what goes to production.
- Join incident response and root-cause work when a pipeline fails,
and build privacy, access control and regulatory requirements in from the start.
Requirements
What you need
- A
bachelor’s degree in Computer Science, Information Systems, Engineering or a related field. A relevant certification helps.
- 4–7+ years
in data engineering, with production pipelines and platforms you can talk through.
- Strong AWS
data architecture experience.
- Advanced
Python and SQL.
- Data
modelling, analytics-oriented schema design and warehousing.
- Ingestion
from relational databases, cloud storage, APIs and files.
- Git, CI/CD
and automation. Agile or SAFe delivery.
- You have
used AI in engineering work and you know how to check it.
- Power BI
or a similar BI tool is useful.
- You can
explain a constraint to a business stakeholder and a design choice to another engineer.
Similar roles
-
Experienced - Data Engineer DATABRICKS - NextHub Bari
Deloitte Italia Bari, Apulia, Italy · €28K–€44K/yr
-
Senior Data Engineer - Databricks Specialist
University of Otago Otago, New Zealand
-
Senior Data Engineer
UBDS Group Manchester, England, United Kingdom
-
Data Engineer
UBDS Group London, England, United Kingdom · £40K–£48K/yr
-
Data Engineer II, AWS Analytics Engineering
Amazon Seattle, Washington, United States · $132K–$179K/yr
-
Data Engineer Intern
Munich Re Singapore, Singapore, Singapore