Kafka Engineer

6 months ago


Cape Town, South Africa PBT Group Full time

Kafka Engineer Job Description 

As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.

Kafka Engineer Job Profile

Kafka engineer is a big data engineer who specializes in developing and managing Kafka-based data pipelines. Kafka is a distributed streaming platform that can be used to build real-time data pipelines and streaming applications. As a Kafka engineer, you will be responsible for developing and managing Kafka-based data pipelines. You will also be required to work with other big data technologies such as Hadoop, Spark, and Storm.

Reports To

  • Head of Data Engineering

Kafka Engineer Responsibilities

  • Design, develop, and manage Kafka-based data pipelines
  • Work with other big data technologies such as Hadoop, Spark, and Storm
  • Monitor and optimize Kafka clusters
  • Troubleshoot Kafka related issues
  • Handle customer queries and support

Kafka Engineer Requirements & Skills

  • Tech/BE/M.Tech in Computer Science or related field
  • 3+ years of experience in big data or related field
  • Strong knowledge of Kafka and other big data technologies
  • Good programming skills in Python
  • Good understanding of distributed systems
  • Good communication and interpersonal skills

 

 


  • Kafka Engineer

    5 months ago


    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...

  • Kafka Engineer

    5 months ago


    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description  As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka Engineer Job Profile Kafka engineer is a big data...

  • Kafka Developer

    1 month ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionWe are seeking a highly skilled Kafka Engineer to join our team at PBT Group. As a key member of our data engineering team, you will be responsible for designing, developing, and managing our streaming data platform using Apache Kafka.Key Responsibilities:Design and develop scalable and efficient Kafka-based data...


  • Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer RoleWe are seeking a skilled Kafka Engineer to join our team at PBT Group. In this role, you will design, develop, and manage Kafka-based data pipelines to scale our streaming data platform.Key Responsibilities:Develop and manage Kafka-based data pipelines to ensure high performance and scalability.Collaborate with other big data technologies...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group's Kafka Big Data Engineer OpportunityPBT Group is seeking a highly skilled Kafka Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and managing our streaming data platform using Kafka.Main Responsibilities:Design and Develop Data Pipelines: Design, develop, and...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job OverviewThe PBT Group is seeking a skilled Big Data Streaming Engineer to build, improve, and scale our real-time data platform using Kafka.Responsibilities:We are looking for a Big Data Streaming Engineer with expertise in developing and managing Kafka-based data pipelines.This role involves working with other big data technologies such...

  • DevOps Data Engineer

    6 months ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake,...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionAt PBT Group, we are seeking an experienced Kafka Engineer to join our team. As a key member of our data engineering team, you will play a critical role in the design, development, and scaling of our streaming data platform.About the Role:Detailed Responsibilities:As a Kafka engineer, you will be responsible for designing,...

  • Data Engineer

    1 month ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group: Kafka Data EngineerKafka Data Engineer at PBT Group is a critical role that requires a strong understanding of distributed systems and big data technologies. The successful candidate will design, develop, and manage Kafka-based data pipelines, ensuring seamless integration with other big data technologies such as Hadoop, Spark, and...

  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group Seeking Intermediate DevOps Data EngineerPBT Group is looking for an intermediate DevOps Data Engineer to join our team.Job DescriptionWe require an experienced data engineer to design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties -...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionWe are seeking a highly skilled Kafka Engineer to join our team at the PBT Group. As a Kafka Engineer, you will be responsible for designing, developing, and managing our streaming data platform.About the RoleThe ideal candidate will have a strong technical background in distributed systems, with experience in building and...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka , Flink...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Data Engineer RoleWe are looking for skilled professionals to fill a Data Engineer position at PBT Group. The ideal candidate will have experience in designing and implementing data pipelines using modern data platforms.Key ResponsibilitiesDesign and build data pipelines using Fabric tools like Delta Lake, Synapse, and Databricks.Develop and manage streaming...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is seeking a highly skilled Real Time Data Processing Expert to join our team. As a key member of our data engineering team, you will be responsible for the design, development, and management of our streaming data platform using Kafka.Kafka is a distributed streaming platform that enables real-time data processing and analytics. As a Real Time...

  • Data Engineering Lead

    3 weeks ago


    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    About the RoleAcuity Consultants is seeking a highly skilled Senior Data Engineer to lead the design and development of scalable data pipelines for our music streaming service algorithmic music recommendation feature.This is a Cape Town-based position with a CTC of R1.4 – R1.6 million per annum.As Senior Data Engineer, you will work with cutting-edge data...

  • Data Engineer

    1 month ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    We are seeking a highly skilled Data Engineer to join our team at PBT Group. As a key member of our data architecture team, you will design, implement, and optimize data pipelines that drive our business forward.Key Responsibilities:Design and build data pipelines using Fabric tools such as Delta Lake, Synapse, Databricks, and Azure Data Factory.Develop and...