Lead Data Engineer
Overview
We're looking for an experienced Lead Data Engineer to lead the design, development, and evolution of enterprise-scale data platforms that enable data-driven decision-making across the Group. This role combines deep technical expertise with leadership responsibilities, overseeing advanced data engineering solutions, guiding engineering teams, and helping shape the future data strategy within a modern cloud and big data environment.
Requirements
- Degree or Diploma in Computer Science, Mathematics, Engineering, Information Systems, or a related field (NQF 6 or higher)
- 5+ years' experience in Data Engineering, Software Development, BI, or a related data discipline
- Demonstrated experience leading or mentoring Data Engineering teams
- Proven experience delivering enterprise-scale data solutions
- Advanced Python and PySpark development
- Strong SQL skills, particularly in large-scale data environments
- Experience with Big Data technologies including Hadoop and Spark
- Familiarity with AWS services such as EMR, S3, Athena, RDS, Lambda, API Gateway
- Experience with Azure, GCP, and Snowflake
- Knowledge of Data warehouse and Business Intelligence concepts
- Understanding of Software Development Life Cycle (SDLC) and DevOps practices
Responsibilities
- Design, build, and optimise complex data engineering solutions and platforms
- Define and maintain data architecture standards and technical roadmaps
- Develop scalable data pipelines and big data solutions using modern cloud technologies
- Provide technical guidance and mentorship across data engineering teams
- Establish and enforce engineering standards, development patterns, and best practices
- Facilitate planning, backlog grooming, sprint reviews, and team alignment activities
- Translate business requirements into scalable technical solutions
- Support performance management, development planning, and capability growth within the team
How to apply
Verify before you apply
SpanSam summarises opportunities for easier discovery. Always confirm the closing date, eligibility requirements and submission instructions on the original source before sending personal information or documents.
About this listing: SpanSam is an opportunity discovery service and is not the hiring employer unless explicitly stated. Application decisions and source-listing changes are controlled by the employer or institution.