Cloud Engineer – Azure Data & Databricks (12‑month contract)

About the role

We are seeking an experienced Cloud Engineer to design, develop and optimise enterprise‑scale data solutions on Microsoft Azure for a regulated banking client in Johannesburg. The role is a 12‑month contract and offers the chance to work on large‑scale analytics, AI and reporting initiatives in a hybrid environment.

Key responsibilities

• Design, build and maintain scalable cloud data pipelines using Azure Data Factory, Microsoft Fabric and Azure Databricks.
• Develop ETL/ELT processes for batch and real‑time data, including streaming pipelines with Kafka or Azure Event Hub.
• Create high‑performance data transformation workflows with Python, PySpark and Apache Spark.
• Implement data quality checks, automated validation, monitoring and governance.
• Manage metadata, data lineage and enterprise data standards.
• Apply CI/CD, Infrastructure as Code and DataOps best practices.
• Collaborate with data scientists, business analysts, architects and stakeholders.
• Support production platforms and resolve L2/L3 incidents while ensuring security and compliance.

Required profile

• Bachelor’s degree in Computer Science, IT, Engineering or related field.
• 3–6 years of hands‑on cloud data engineering experience, preferably in banking or financial services.
• Strong analytical, problem‑solving and communication skills.

Required skills

• Microsoft Azure (ADF, Fabric, Databricks)
• Python, PySpark, SQL
• Apache Spark, Kafka, Azure Event Hub
• CI/CD, Git, Infrastructure as Code (IaC)
• Data modelling, data warehousing, data lake concepts
• Metadata management, data governance, data quality frameworks