Data Streaming Engineer

3 weeks ago


Cape Town, South Africa PBT Group Full time

Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to deliver efficient and scalable solutions.

Key Responsibilities:

  • Build and Maintain: Design, develop, and manage robust streaming pipelines using Kafka and Flink.
  • Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
  • Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
  • Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
  • Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.

Key Requirements:

  • Expertise in Kafka and Flink: Proven experience with these technologies is essential.
  • Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
  • Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
  • Java , or Scala.Programming Proficiency: Advanced knowledge of Python, Java , or Scala.
  • AWS , GCP, or Azure is a significant advantage.Cloud Platforms: Experience with AWS , GCP, or Azure is a significant advantage.
  • DevOps Familiarity: Understanding of DevOps tools and principles.

Additional Skills:

  • Problem-Solving: Analytical mindset with the ability to tackle complex challenges.
  • Independence: Ability to work autonomously while managing intricate projects.
  • Communication: Strong verbal and written communication skills for effective collaboration with cross-functional teams.

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent



  • Cape Town, South Africa PBT Group Full time

    Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to...

  • Data Engineering

    2 weeks ago


    Cape Town, South Africa PBT Group Full time

    **Duties & Responsibilities** **Operational Delivery** - Build, enhance, and maintain real-time data pipelines. - Work with infrastructure and operations teams to maintain data infrastructure. - Identify, document, and resolve feature gaps while implementing solutions. - Modernize and maintain services and tooling to ensure resilience, fix data...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    About the RoleThe Streaming Data Architect will be responsible for designing and developing real-time data pipelines. The ideal candidate will have strong experience with AWS technologies, including Kafka and Confluent.Key ResponsibilitiesDesign and develop real-time data streaming tools and platforms.Collaborate with infrastructure and operations teams to...

  • Data Engineering

    2 weeks ago


    Cape Town, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    2 weeks ago


    Cape Town, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    Streaming Data Engineer Job SummaryThis is an exciting opportunity to join our team as a Streaming Data Engineer. The ideal candidate will have strong experience with real-time data processing and streaming technologies.Key ResponsibilitiesDesign and develop real-time data streaming tools and platforms.Collaborate with infrastructure and operations teams to...


  • Cape Town, Western Cape, South Africa The Family Independence Initiative (FII) Full time

    Qualifications and ExperienceLeadership Experience:2+ years of experience leading teams, mentoring, and coaching, with a passion for leadership and team growth.Data Engineering Expertise:5+ years of experience building modern, cloud-native data platforms, with deep hands-on expertise in:Designing scalable and resilient pipelines for big data processing and...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    Data Engineer Lead Job DescriptionWe are seeking a highly experienced Data Engineer Lead to join our team. The successful candidate will have a strong background in real-time data processing and streaming technologies.Main ResponsibilitiesBuild, enhance, and maintain real-time data pipelines.Work closely with infrastructure and operations teams to maintain...

  • Data Engineering Lead

    2 weeks ago


    Cape Town, South Africa Progressive Edge Full time

    **Data Engineering Lead** **Permanent** **Cape Town** A large established enterprise is looking to employ a Technical Lead : Data Engineering with deep technical knowledge the ability to lead and mentor a team of Data engineers. You will require substantial expertise in a broad range of software development & programming fields. Your knowledge of data...

  • Data Engineer

    3 weeks ago


    Cape Town, South Africa Network Recruitment Full time

    As a Data Engineer at our client, youll play a pivotal role in expanding and optimizing their data architecture and data pipeline systems. Youll work with cutting-edge technology to build efficient data solutions that support cross-functional teams, improve processes, and unlock powerful insights for the business. If you enjoy tackling complex data...


  • Cape Town, Western Cape, South Africa DataEQ Full time

    Company OverviewAt DataEQ, we're passionate about using cutting-edge AI to turn unstructured customer and public feedback into actionable insights. Our goal is to help businesses improve customer experiences, manage risk, and streamline digital services.Our tech stack includes Java, Spring Boot, PostgreSQL, and Python. As a senior machine learning and java...

  • Data Engineer

    3 weeks ago


    Cape Town, South Africa Network Recruitment Full time

    As a Data Engineer at our client, youll play a pivotal role in expanding and optimizing their data architecture and data pipeline systems. Youll work with cutting-edge technology to build efficient data solutions that support cross-functional teams, improve processes, and unlock powerful insights for the business.If you enjoy tackling complex data...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...


  • Cape Town, Western Cape, South Africa Findojobs South Africa Full time

    Real-Time Data Engineering Team LeadWe are seeking a highly experienced Real-Time Data Engineering Team Lead to join our team. The successful candidate will have a strong background in real-time data processing and streaming technologies.Main ResponsibilitiesLead the development and maintenance of real-time data pipelines.Collaborate with infrastructure and...

  • Enterprise Engineer

    3 days ago


    Cape Town, Western Cape, South Africa TFG (The Foschini Group) Full time

    We are seeking a talented Senior Software Engineer to join our Information Technology team at TFG. As a key member of our team, you will play a critical role in driving business growth through the design and development of integration solutions.About the PositionThis is an exceptional opportunity for a software engineer with expertise in C# and .NET...


  • Cape Town, Western Cape, South Africa DataEQ Full time

    The RoleWe are seeking a skilled Full Stack Developer to join our small dev team. As a Full Stack Developer, you will be responsible for building web applications used by both our staff and clients. You will work on both front-end code as well as back-end development, processing real-time data streams and storing them for efficient querying.You will also be...


  • Cape Town, South Africa Unique Personnel Full time

    **Job Number** - 68607 **Job Type** - Permanent **Job Title** - Production Supervisor/Team Leader/Value Stream Leader **Computer Skills** - SPC,VSM,SMED,JIT,5S,TPM,MS Office Suite **Industry** - Manufacturing **City** - Cape Town **Province** - Western Cape - Reporting to the Operations Manager- Job Purpose: - Full responsibility for and leadership of...

  • Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer! ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ! ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data...