Senior Big Data Engineer
MSP Staffing Pty Ltd · Cape Town
Job description
About the role
Our client is looking for a Senior Big Data Engineer to design, build, and optimise large‑scale data platforms that enable advanced analytics and machine learning. You will work in a cloud‑first environment, collaborating with architects, data scientists, and platform engineers to deliver high‑volume data solutions.
Key responsibilities
- Design, develop and maintain high‑volume data ingestion and transformation pipelines.
- Build scalable feature stores, analytical datasets and data processing frameworks.
- Optimise data workflows for performance, scalability and reliability.
- Create ETL/ELT solutions that support enterprise data products.
- Implement data quality, validation and governance processes.
- Support cloud‑native data engineering initiatives and platform optimisation.
- Produce technical documentation and contribute to operational excellence.
Required profile
- Bachelor’s degree in Computer Science, Engineering, Information Systems or related field.
- 10+ years of experience in data engineering or big data development.
- Strong analytical and problem‑solving abilities.
- Detail‑oriented with a passion for delivering high‑quality, scalable data solutions.
Required skills
- Expertise with Spark, Hadoop or similar distributed processing technologies.
- Proficiency in SQL and programming languages such as Python, Scala or Java.
- Experience building enterprise‑scale data pipelines.
- Hands‑on experience with cloud‑based data platforms (e.g., Azure Databricks).
- Familiarity with streaming technologies like Kafka.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in South Africa.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 1 month ago
Expires 1 week from now
25 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
MSP Staffing Pty Ltd
Cape Town
Related job offers
-
Business Intelligence and Automation Specialist - Food Industry
JSM Business Services and Recruitment Cape Town -
Research and Data Engineer (Remote, Cape Town)
Time Personnel Cape Town -
Scrum Master – 6‑Month Contract with Potential Permanent
Talent Sauce Cape Town -
Denodo Data Virtualization Engineer
The Dynamix Team (Pty) Ltd Johannesburg -
QA Specialist/Test Analyst – Employee Benefits
JMR Software (Pty) Ltd Gauteng