Data Engineering Lead

3 weeks ago


Cape Town, Western Cape, South Africa Acuity Consultants Full time

About the Role

Acuity Consultants is seeking a highly skilled Data Engineer to join our team in Cape Town. As a Senior Data Engineer, you will play a key role in designing and building scalable data pipelines for our global music streaming services.

Key Responsibilities

  • Design and develop high-quality data pipelines using Apache Spark, Scala, and Java
  • Collaborate with cross-functional teams to modernize and enhance legacy pipelines
  • Develop and implement data engineering tools and processes to ensure smooth data management and configuration
  • Provide mentorship and code reviews to peers to foster a culture of technical excellence
  • Engage in CI/CD practices to streamline development processes

Requirements

  • 8+ years of experience as a Data Engineer
  • Minimum bachelor's degree in computer science or engineering
  • Proven experience in data engineering and platform development
  • Extensive experience with Apache Spark, Kafka, Airflow, AWS S3, Scala, and Java
  • Experience with Gradle build automation tools

What We Offer

R1,4 – R1,6 million per annum, a fantastic opportunity to work on a global leader in music streaming services, and a dynamic team of professionals.


  • Engineering Lead

    1 week ago


    Cape Town, Western Cape, South Africa NTT DATA Full time

    About the RoleWe are seeking an exceptional Engineering Lead to join our team at NTT DATA. As a Platform Engineering Lead, you will play a critical role in designing, implementing, and maintaining our organization's technology platforms.Key ResponsibilitiesTechnical Leadership and Strategy: Lead the development and execution of the organization's platform...

  • Data Engineering Lead

    2 weeks ago


    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    About the RoleAcuity Consultants is seeking a highly skilled Senior Data Engineer to lead the design and development of scalable data pipelines for our music streaming service algorithmic music recommendation feature.This is a Cape Town-based position with a CTC of R1.4 – R1.6 million per annum.As Senior Data Engineer, you will work with cutting-edge data...


  • Cape Town, Western Cape, South Africa Planet10 Full time

    Job SummaryWe are seeking an experienced Data Engineering Lead to join our team at Planet10. As a key member of our marketing technology and data solutions team, you will play a pivotal role in the development and delivery of innovative solutions for our clients.

  • Technical Lead

    2 weeks ago


    Cape Town, Western Cape, South Africa IOCO Full time

    **Job Title:** Technical Lead - Data Engineering**About IOCO:**iOCO is a consultancy that solves complex real-world problems with innovative software solutions. We believe that anything is possible with modern technology, software, and development expertise. We are continuously pushing the boundaries of innovative solutions across multiple industries using...


  • Cape Town, Western Cape, South Africa wePlace Full time

    About the Role We are seeking a seasoned Data Engineering Team Lead to oversee the direction and lead a data warehouse team responsible for the full product lifecycle of software components in our central warehouse. The successful candidate will ensure the successful delivery of required functionality and maintenance-related tasks within the Bank Data...


  • Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job DetailsCompany Group Technology is responsible for the provision of digitally enabled technology services as a group COE, driving business and transformation and providing group-wide digital and data architecture.We operate various technology platforms and shared services, ensuring cyber and information security resilience and acting as technology...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Senior DataOps EngineerWe are seeking a highly skilled Senior DataOps Engineer to lead the development of DataOps practices within our organisation. As a seasoned DevOps professional with a strong background in software and data, you will be responsible for setting the direction for DataOps within the team, building scalable data pipelines, and ensuring...

  • Lead Data Architect

    2 weeks ago


    Cape Town, Western Cape, South Africa IOCO Full time

    Data Engineering Leadership RoleWe are seeking an experienced Data Engineer to lead our data engineering team and drive data initiatives that align with our business objectives.Key Responsibilities:Lead Data Strategy: Develop and implement data engineering strategies that support data-driven decision-making.Design and Architecture: Design and architect...

  • Lead Data Scientist

    4 weeks ago


    Cape Town, Western Cape, South Africa ShopriteX Full time

    Job Title: Lead Data ScientistAt ShopriteX, we are seeking a highly skilled and experienced Lead Data Scientist to join our Data & Insights Monetisation team. As a key member of our team, you will be responsible for leading the delivery of complex data science and engineering solutions that drive business value and provide a competitive advantage for our...


  • Cape Town, Western Cape, South Africa Lula Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Lula. As a key member of our Data team, you will be responsible for implementing and maintaining data models, ensuring data reliability and quality, and developing scalable data pipelines.Key Responsibilities:Data Architecture: Design and develop data architecture...

  • Data Architect

    4 weeks ago


    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Data EngineerAs a Data Engineer at Dimension Data, you will play a crucial role in designing and building the data architecture of our products. Your technical expertise will help us develop new products by taking an idea from concept to reality. You will work on projects across multiple teams to achieve company goals and objectives.Key...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleAs an Electrical Engineer for Data Centers, you will play a critical role in ensuring the design, construction, and operation of Amazon's data centers meet the highest standards of safety, security, and efficiency. You will be responsible for providing technical expertise and guidance to internal teams, as well as collaborating with external...

  • Senior Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    Senior DataOps Engineer Role SummaryWe are seeking a talented Senior DataOps Engineer to lead the development of DataOps practices within our organisation. As a seasoned professional with a strong DevOps background and software and data experience, you will be responsible for setting the direction for DataOps within the team, building scalable data...

  • Lead Data Architect

    4 weeks ago


    Cape Town, Western Cape, South Africa IOCO Full time

    Job Title: Lead Data ArchitectWe are seeking a highly skilled and experienced Lead Data Architect to join our dynamic team at IOCO. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business.Key Responsibilities:Develop and implement data engineering...

  • Data Architect

    2 weeks ago


    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Dimension Data. As a Data Engineer, you will be responsible for designing and building the data architecture of our products.Key ResponsibilitiesAnalyzing business requirements to inform data architecture decisionsDesigning databases, reports, and tools to meet analytical...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the Role:As a Senior Data Center Electrical Engineer at Amazon Data Services South Africa (Pty) Ltd, you will play a critical role in ensuring the high availability and reliability of our data centers. Your expertise will be instrumental in designing, implementing, and maintaining electrical systems that meet the stringent requirements of our...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking an Avaya Engineer to join our Dimension Data team. In this role, you will provide IT technical support to all teams within the organization and ensure they have access to their devices and data worldwide.You will be responsible for building strong relationships with colleagues from other departments to share knowledge and solve...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to design and build the data architecture of our products. The Data Engineer will use technical knowledge to help develop new products by taking an idea from concept to reality. The role involves working on projects across multiple teams to achieve company goals and objectives. The Data Engineer will...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleAs a Senior Data Center Electrical Engineer at Amazon Data Services South Africa (Pty) Ltd, you will play a critical role in ensuring the design, construction, and operation of our data centers meet the highest standards of safety, security, and efficiency. You will be responsible for providing technical expertise and guidance to our teams,...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    About the Role:Network Recruitment is seeking a highly skilled Data Engineer to join our client, a leading banking company with over 40 years of experience. This is an exciting opportunity for a talented individual to contribute to data-driven innovations in the banking sector.Key Responsibilities:Collaborate with data scientists, analysts, and stakeholders...