Kafka Big Data Engineer

6 months ago


Cape Town, South Africa PBT Group Full time

PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.

 

Kafka engineer is a big data engineer who specializes in developing and managing Kafka-based data pipelines. Kafka is a distributed streaming platform that can be used to build real-time data pipelines and streaming applications. As a Kafka engineer, you will be responsible for developing and managing Kafka-based data pipelines. You will also be required to work with other big data technologies such as Hadoop, Spark, and Storm.

 

Duties:

  • Design, develop, and manage Kafka-based data pipelines.
  • Work with other big data technologies such as Hadoop, Spark, and Storm.
  • Monitor and optimize Kafka clusters.
  • Troubleshoot Kafka related issues.
  • Handle customer queries and support.

 

Skills and Experience Required:

  • 3+ years of experience in big data or related field.
  • Strong knowledge of Kafka and other big data technologies.
  • Good programming skills in Python.
  • Good understanding of distributed systems.
  • Good communication and interpersonal skills.

 

Qualifications/ Certification:

  • Tech/BE/M.Tech in Computer Science or related field

 

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent



  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group's Kafka Big Data Engineer OpportunityPBT Group is seeking a highly skilled Kafka Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and managing our streaming data platform using Kafka.Main Responsibilities:Design and Develop Data Pipelines: Design, develop, and...

  • Kafka Engineer

    5 months ago


    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...

  • Kafka Engineer

    5 months ago


    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description  As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka Engineer Job Profile Kafka engineer is a big data...

  • Kafka Engineer

    6 months ago


    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job OverviewThe PBT Group is seeking a skilled Big Data Streaming Engineer to build, improve, and scale our real-time data platform using Kafka.Responsibilities:We are looking for a Big Data Streaming Engineer with expertise in developing and managing Kafka-based data pipelines.This role involves working with other big data technologies such...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group: Kafka Data EngineerKafka Data Engineer at PBT Group is a critical role that requires a strong understanding of distributed systems and big data technologies. The successful candidate will design, develop, and manage Kafka-based data pipelines, ensuring seamless integration with other big data technologies such as Hadoop, Spark, and...

  • Kafka Developer

    1 month ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionWe are seeking a highly skilled Kafka Engineer to join our team at PBT Group. As a key member of our data engineering team, you will be responsible for designing, developing, and managing our streaming data platform using Apache Kafka.Key Responsibilities:Design and develop scalable and efficient Kafka-based data...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionAt PBT Group, we are seeking an experienced Kafka Engineer to join our team. As a key member of our data engineering team, you will play a critical role in the design, development, and scaling of our streaming data platform.About the Role:Detailed Responsibilities:As a Kafka engineer, you will be responsible for designing,...

  • Big Data Specialist

    1 week ago


    Cape Town, Western Cape, South Africa OfferZen Ltd Full time

    We are seeking a highly skilled Big Data Specialist to join our team at OfferZen Ltd. As a key member of our organization, you will play a critical role in shaping the future of our company.About UsOfferZen Ltd is a leading developer jobs marketplace that reverses the traditional job search process. We connect talented developers with top tech companies in...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer RoleWe are seeking a skilled Kafka Engineer to join our team at PBT Group. In this role, you will design, develop, and manage Kafka-based data pipelines to scale our streaming data platform.Key Responsibilities:Develop and manage Kafka-based data pipelines to ensure high performance and scalability.Collaborate with other big data technologies...

  • DevOps Data Engineer

    6 months ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake,...

  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group Seeking Intermediate DevOps Data EngineerPBT Group is looking for an intermediate DevOps Data Engineer to join our team.Job DescriptionWe require an experienced data engineer to design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties -...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is seeking a highly skilled Real Time Data Processing Expert to join our team. As a key member of our data engineering team, you will be responsible for the design, development, and management of our streaming data platform using Kafka.Kafka is a distributed streaming platform that enables real-time data processing and analytics. As a Real Time...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job DescriptionWe are seeking a highly skilled Kafka Engineer to join our team at the PBT Group. As a Kafka Engineer, you will be responsible for designing, developing, and managing our streaming data platform.About the RoleThe ideal candidate will have a strong technical background in distributed systems, with experience in building and...

  • Data Engineer

    1 month ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Data Engineer RoleWe are looking for skilled professionals to fill a Data Engineer position at PBT Group. The ideal candidate will have experience in designing and implementing data pipelines using modern data platforms.Key ResponsibilitiesDesign and build data pipelines using Fabric tools like Delta Lake, Synapse, and Databricks.Develop and manage streaming...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is seeking a skilled Cloud Data Architecture Specialist to lead the design, development, and operationalization of large-scale enterprise data solutions and applications on AWS.Key Responsibilities:Design and implement scalable, secure, and efficient cloud-based data architectures using AWS services such as Glue, Step-functions, Kafka CC, PySpark,...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka, Flink, or...

  • Data Engineer

    1 month ago


    Cape Town, South Africa PBT Group Full time

    We are looking for Intermediate to Senior Data Engineers with strong experience in modern data platforms and streaming services to join our growing team. The ideal candidate will have in-depth expertise in Microsoft Fabric tools (including Delta Lake, Synapse, Databricks, and Data Factory) and hands-on experience with streaming services like Kafka , Flink...