ICT Senior Data Engineer (Azure, Python & R)

About the role

Our client is seeking an ICT Senior Data Engineer to join the ICT Division on a six‑month fixed‑term contract. The role focuses on designing, building and optimizing data pipelines and architectures that enable advanced analytics and machine learning across the organisation.

Key responsibilities

• Design, build and optimise end‑to‑end data pipelines using Azure Data Factory, Synapse Analytics, Databricks and Data Lake Storage Gen2.
• Develop and maintain Python and R scripts for data processing, automation and statistical analysis.
• Collaborate with data scientists, analysts and engineering teams to integrate data solutions into production systems.
• Ensure data quality, governance and compliance through systematic testing, monitoring and documentation.
• Support CI/CD processes, automate data workflows and uphold data security best practices.
• Maintain the operational environment to guarantee high availability and performance of data platforms.

Required profile

• A Diploma or University Degree in Computer Science, Information Management, Data Science or a related field (NQF level 6).
• Minimum 8 years of experience as a Data Engineer or in a comparable role.
• Strong expertise in Microsoft Azure services such as Data Factory, Synapse Analytics, Databricks and Data Lake Storage Gen2.
• Proficiency in Python (NumPy, Pandas, Matplotlib, Seaborn) and R for data processing and statistical modelling.
• Advanced knowledge of SQL, data warehousing and data‑modelling principles.
• Experience with version control (Git) and CI/CD pipelines.

Required skills

• Azure Data Factory
• Azure Synapse Analytics
• Azure Databricks
• Azure Data Lake Storage Gen2
• Python (NumPy, Pandas, Matplotlib, Seaborn)
• R
• SQL
• Data warehousing & modelling
• Git & CI/CD pipelines