Kafka Engineer

4 weeks ago


Cape Town, South Africa PBT Group Full time

Kafka Engineer Job Description 

As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.

Kafka Engineer Job Profile

Kafka engineer is a big data engineer who specializes in developing and managing Kafka-based data pipelines. Kafka is a distributed streaming platform that can be used to build real-time data pipelines and streaming applications. As a Kafka engineer, you will be responsible for developing and managing Kafka-based data pipelines. You will also be required to work with other big data technologies such as Hadoop, Spark, and Storm.

Reports To

  • Head of Data Engineering

Kafka Engineer Responsibilities

  • Design, develop, and manage Kafka-based data pipelines
  • Work with other big data technologies such as Hadoop, Spark, and Storm
  • Monitor and optimize Kafka clusters
  • Troubleshoot Kafka related issues
  • Handle customer queries and support

Kafka Engineer Requirements & Skills

  • Tech/BE/M.Tech in Computer Science or related field
  • 3+ years of experience in big data or related field
  • Strong knowledge of Kafka and other big data technologies
  • Good programming skills in Python
  • Good understanding of distributed systems
  • Good communication and interpersonal skills

 

 



  • Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...


  • Cape Town, South Africa Level-Up Full time

    Details:12 Month ContractRemote (JHB or CT)Position Overview:Apply platform engineering expertise, critical thinking, design thinking and problem solving skills in an agile team environment to produce well-organised, optimised and documented source code that successfully delivers platform features & components of the service & solves complex technical...


  • Cape Town, South Africa Adzuna ZA B C2 Full time

    Role:This is a technical Kafka Event Management support job. This is for an Individual with Linux Certification and Integration and DEVSECOPS experience and some Coding background. Operational support is key and Standby and after-hours support will be expected. Manage and maintain Kafka Event Management platforms to ensure stability and continued high...


  • Cape Town, South Africa Progressive IT Resourcing Full time

    Our Client Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. They operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology...


  • Cape Town, South Africa Progressive IT Resourcing Full time

    Our ClientCompany Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. They operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology...


  • Cape Town, South Africa Recru-it Full time

    Role: This is a technical Kafka Event Management support job. This is for an Individual with Linux Certification and Integration and DEVSECOPS experience and some Coding background. Operational support is key and Standby and after-hours support will be expected. Manage and maintain Kafka Event Management platforms to ensure stability and continued high...


  • Cape Town, South Africa Sanlam Full time

    Who are we? Sanlam Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology...

  • DevOps Data Engineer

    4 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake,...

  • DevOps Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer.   Duties: Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake, Python,....

  • DevOps Data Engineer

    4 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Strong experience with AWS, Terraform, CI/CD, GitDesign, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • DevOps Data Engineer

    4 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Strong experience with AWS, Terraform, CI/CD, GitDesign, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • DevOps Data Engineer

    3 weeks ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer.   Duties: Strong experience with AWS, Terraform, CI/CD, Git Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB,...

  • AWS Cloud Engineer

    4 weeks ago


    Cape Town, South Africa Parvana Full time

    Client Details: Our client works with multiple organisations to find a better way to transact. They bring together committed people dedicated to delivering innovative enterprise solutions that help their customers contribute to economic growth. As a vibrant and innovative SaaS company, they deliver industry-leading expertise and technology to solve real...


  • Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the...


  • Cape Town, South Africa BP3 Global, Inc. Full time

    BP3 are looking for an experienced Senior Software Engineer. We are looking for an individual with strong Java fundamental knowledge. For this role we are seeking a passionate Software Engineer who has more than 9 years experience working on enterprise software applications, cross functional teams and has a basic understanding of cloud based...

  • Java Developer

    6 days ago


    Cape Town, South Africa Adzuna ZA B C2 Full time

    Develop high-quality web and mobile applications Improve the quality of the product, using containerization and continuous integrationTaking part in the entire SDLCUse tools such as: Spring, Spring Boot, Angular, React, Vue, JPA, Spring Data, Hibernate, Oracle, MS SQL, PostgreSQL, MySQL, MongoDB, Cosmos DB, Maven and Gradle, Azure, AWS, Terraform, Bicep, AWS...

  • Java Developer

    6 days ago


    Cape Town, South Africa Communicate Recruitment Full time

    Develop high-quality web and mobile applications Improve the quality of the product, using containerization and continuous integrationTaking part in the entire SDLCUse tools such as: Spring, Spring Boot, Angular, React, Vue, JPA, Spring Data, Hibernate, Oracle, MS SQL, PostgreSQL, MySQL, MongoDB, Cosmos DB, Maven and Gradle, Azure, AWS, Terraform, Bicep, AWS...

  • Java Developer

    6 days ago


    Cape Town, South Africa Communicate Recruitment Full time

    Develop high-quality web and mobile applications Improve the quality of the product, using containerization and continuous integrationTaking part in the entire SDLCUse tools such as: Spring, Spring Boot, Angular, React, Vue, JPA, Spring Data, Hibernate, Oracle, MS SQL, PostgreSQL, MySQL, MongoDB, Cosmos DB, Maven and Gradle, Azure, AWS, Terraform, Bicep, AWS...


  • Cape Town, South Africa THE SKILLS MINE (PTY) LTD Full time

    **Requirements**: - 8+ years software engineering experience - Degree in Computer Science or a related discipline - Experience using technologies and frameworks like (but not limited to) some of our most-used languages - Typescript, JavaScript, Python, Java - Experience with modern JavaScript frameworks and libraries (NodeJs, NestJs) - Experience with AWS...


  • Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Back-End Java Software Engineer. The Back-End Java Software Engineer plays an integral part in a cross-functional team dedicated to the full software development lifecycle, from concept, to development to deployment and ultimately operating of each product. At this level, Software Engineers are responsible to design,...