Senior Databricks Data Engineer

About the role

We are seeking two Senior Data Engineers to join a high‑impact data team in Johannesburg. The role focuses on designing, building and optimising modern cloud‑based data pipelines using Databricks, AWS and DBT to support enterprise‑scale analytics.

Key responsibilities

• Design, develop and maintain scalable data pipelines on the Databricks Lakehouse platform.
• Build and optimise ETL/ELT processes for large, complex datasets using DBT and SQL.
• Implement Medallion Architecture (Bronze, Silver, Gold) and manage Delta Lake tables.
• Create and tune PySpark/Spark workloads and Databricks Workflows.
• Integrate data from multiple cloud and on‑premise sources, including AWS services.
• Ensure data quality, reliability and performance across the data estate.
• Collaborate with analysts, architects and business stakeholders to deliver data‑driven solutions.
• Apply best practices for testing, monitoring, CI/CD and data governance.

Required profile

• Strong commercial experience with Databricks and AWS services.
• Proven ability to deliver enterprise‑scale data engineering solutions.
• Excellent communication and stakeholder management skills.
• Experience working in Agile environments.

Required skills

• Databricks Lakehouse Platform, Delta Lake, Unity Catalog, Databricks Workflows, Databricks SQL.
• PySpark, Spark SQL.
• AWS S3, Glue, Lambda, IAM, Redshift.
• DBT (Data Build Tool).
• Advanced SQL, ETL/ELT pipeline development.
• Data modelling and data warehousing principles.