Data Streaming Engineer

4 weeks ago


Cape Town, Western Cape, South Africa PBT Group Full time

Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to deliver efficient and scalable solutions.

Key Responsibilities:

  • Build and Maintain: Design, develop, and manage robust streaming pipelines using Kafka and Flink.
  • Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
  • Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
  • Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
  • Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.

Key Requirements:

  • Expertise in Kafka and Flink: Proven experience with these technologies is essential.
  • Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
  • Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
  • Java, or Scala.Programming Proficiency: Advanced knowledge of Python, Java, or Scala.
  • AWS, GCP, or Azure is a significant advantage.Cloud Platforms: Experience with AWS, GCP, or Azure is a significant advantage.
  • DevOps Familiarity: Understanding of DevOps tools and principles.

Additional Skills:

  • Problem-Solving: Analytical mindset with the ability to tackle complex challenges.
  • Independence: Ability to work autonomously while managing intricate projects.
  • Communication: Strong verbal and written communication skills for effective collaboration with cross-functional teams.

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent



  • Cape Town, Western Cape, South Africa PBT Group Full time

    Be part of our team of Data Specialists and embark on a career of the futureAre you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and...


  • Cape Town, Western Cape, South Africa Amazon Full time

    The way businesses think about managing their information needs is changing rapidly in today's cloud-first world. As a Cloud Data Streams Architect on our AWS Kinesis team, you'll have the opportunity to shape this exciting new technology and help customers achieve their goals.About the JobYou'll be working closely with product managers to refine product...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is dedicated to pushing the boundaries of data streaming technology. We're seeking a seasoned Data Engineering Expert to lead our efforts in designing and developing efficient data pipelines.About the Role:The ideal candidate will possess extensive experience in designing, developing, and maintaining robust streaming pipelines using...

  • Data Engineer

    5 days ago


    Cape Town, Western Cape, South Africa proFound Faith Consulting Full time

    Job title : Data Engineer (Streaming)Job Location : Western Cape, Cape TownDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries What You'll DoDesign, develop, and maintain real-time streaming pipelines using tools like Apache Kafka, Apache Flink, and AWS Kinesis. Build scalable architectures for event-driven systems and ensure...


  • Cape Town, Western Cape, South Africa Amazon Full time

    Senior Software Development Engineer, AWS Kinesis Data StreamsLeading brands like Epic Games, Lyft, AirBnB, and Vanguard use Amazon Kinesis Data Streams as their foundation for real-time streaming data. With Amazon Kinesis Data Streams, customers process Gigabytes per second of real-time user engagement data for gaming and marketing analytics, build...

  • Data Engineering

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is a pioneer in data streaming technology. We're seeking an experienced Data Streaming Engineer to join our team of talented developers and data specialists.About the Role:The successful candidate will design, develop, and maintain robust streaming pipelines using Kafka and Flink. They will handle data integration, transformation, and processing in...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract,...

  • Senior Data Engineer

    21 hours ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    About the RoleIn this role, you will be responsible for designing and implementing scalable data architectures that meet the needs of our business. This includes building and maintaining data pipelines, working with big data batch and streaming tools, and ensuring the smooth operation of data infrastructures.The ideal candidate will have extensive experience...

  • Big Data Engineer

    5 days ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is a leading provider of innovative data streaming solutions. We're seeking an experienced Real-Time Data Architect to join our team and contribute to the development of cutting-edge data processing systems.About the Position:The successful candidate will design and implement robust streaming pipelines using Kafka and Flink, ensuring seamless data...

  • Data Engineer Lead

    2 days ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Company OverviewWe are Network Recruitment, a leading provider of specialized staffing solutions. Our mission is to connect exceptional talent with innovative companies.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and...

  • Data Engineer

    24 hours ago


    Cape Town, Western Cape, South Africa Bookboost AB Full time

    Welcome to Bookboost AB, a pioneering B2B SaaS provider in the hospitality engagement space. We empower hotels to design personalized guest journeys, automate communications, and gain full visibility over their customer touchpoints.About the roleWe're seeking an experienced Cloud Data Engineer to join our team and play a key role in designing and...


  • Cape Town, Western Cape, South Africa The Parent Centre Empowering parents through Positive Parenting Full time

    About You and the Key Skills We're Looking ForOur ideal candidate has a proven track record as an AWS Cloud Data Engineer, showcasing expertise in designing scalable and secure data solutions.Achieving proficiency in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, and Spark / SparkSQL enables you to handle massive amounts of data...


  • Cape Town, Western Cape, South Africa Flash Group Full time

    **Job Purpose**The purpose of this role is to manage virtual revenue streams and their related cost of sales, ensuring accurate financial information is presented to management.Liaise with suppliers and customers to receive, reconcile and capture invoicesSet up remittances for paying creditorsManage day-to-day queries from customers and suppliersLiaise with...


  • Cape Town, Western Cape, South Africa Bookboost AB Full time

    We're excited to announce a new opportunity for an Engineering Lead to join our team at Bookboost AB! As a fast-growing company in the hospitality tech space, we're redefining what's possible with innovative solutions that transform the way hotels connect with their guests.About the roleThis is an exciting chance to lead our data engineering efforts and...