SENIOR CLOUD DATA ENGINEER
Liquid Thought Johannesburg, Gauteng, South Africa
IT Services and IT Consulting · 11-50 employees
About the role
You will work within a Google Cloud environment to transform raw data into actionable insights and stories for business decision-makers. This involves managing large-scale ETL processes and building high-scale RESTful services using tools like BigQuery and Kubernetes.
What they look for
Requirements
Candidates must hold a relevant software engineering degree at an Honours level or higher and possess at least 5 years of Python development experience. Strong proficiency in SQL, NoSQL, and cloud-based data engineering is essential for this role.
Benefits
Full description
SENIOR CLOUD DATA ENGINEER
Location: CT/JHB
Our client, a well-known South African media and technology company, is looking for a Senior Cloud Data Engineer to join their team. This organisation is behind some of the country's most recognisable digital news and information brands, and its in-house team of engineers, data scientists, product managers and UX/UI designers builds the digital products that keep millions of South Africans informed, entertained and inspired every day.
Why join this team?
You'll be joining a people-focused, innovation-driven engineering culture that uses a sophisticated, modern tech stack to deliver world-class digital solutions. This is a business with a strong societal mission, and the data engineering team plays a central role in turning raw data into the stories and insights that help decision-makers steer the business forward.
What will you do?
You'll work primarily within a Google Cloud environment, using tools across the Google stack, from BigQuery and Dataproc to Kubernetes and AI Hub. You should be comfortable thinking in Python and speaking fluent SQL, and you shouldn't be afraid to dive into messy, unstructured data and help the wider team make sense of it. Ultimately, you'll be helping transform data into the stories and visuals that drive real business decisions.
What you'll need
- A relevant software engineering degree, at least at Honours level (a Masters would be advantageous)
- 5+ years of development experience working with Python
- Strong data skills, including both traditional SQL and NoSQL
- Experience with large-scale ETL processes
- Experience building high-scale RESTful services
- Cloud experience, ideally with Google Cloud Platform
- Experience using source control (Git)
Beneficial skills:
You'll be exposed to the following in this environment, so prior experience is a bonus but not essential:
- Scheduling and orchestration (Airflow/Composer)
- Containerisation (Kubernetes, Docker)
- BigQuery
- Elasticsearch
- Data warehousing concepts
- Data governance concepts
- Apache Beam (Cloud Dataflow)
- Apache Spark (Dataproc)
What's in it for you?
- AI-forward culture: this organisation actively looks for ways to leverage AI to unlock new opportunities, and encourages its teams to explore and experiment with cutting-edge tools to boost productivity and results.
- Continuous learning and growth: benefit from a wealth of learning opportunities, including free access to platforms like Udemy, the chance to pursue nanodegrees, complimentary Microsoft certification training, and bursary opportunities, all backed by a major listed parent group.
- Stay ahead: attend leading tech events and expos to keep up with industry trends and innovation.
- Personalised benefits: choose from optional medical aid and customisable retirement funding options to suit your needs.
- Give back: take up to 3 days of paid volunteering leave each year to support causes you care about.
This role is being handled on an exclusive basis by our agency on behalf of our client, whose identity will be shared with shortlisted candidates. In line with our client's employment equity policy, preference will be given to suitable candidates from designated groups.
As we receive a high volume of applications, we are unfortunately not able to respond individually to every candidate. If you have not heard from us within one month, please take this as confirmation that your application was not successful on this occasion.
Similar roles
-
Senior Data Engineer
SimplePractice Ciudad de México, Mexico
-
Senior Data Engineer
MWDN Athens, Attica, Greece
-
AWS Data Engineer (Perú, Argentina, Chile)
Escala 24x7 Peru
-
Data Engineer (m/f/d)
Redcare Pharmacy Cologne, North Rhine-Westphalia, Germany
-
Data Engineer III - UI/Java/React/Agentic AI
JPMorgan Chase & Co. Plano, Texas, United States
-
Senior RAPA Data Engineer
NORTHEAST POWER COORDINATING New York, New York, United States · $120K–$130K/yr