Data Engineer

3 days ago

Johannesburg South Africa Mi-C3 International Full time R900 000 - R1 200 000 per year

Data Engineer 

We are seeking a Data Integrations / Big Data Engineer with experience in Apache NiFi, Kafka, and enterprise systems, to design and implement secure, scalable, and real-time data pipelines for a high-profile client implementation project. The ideal candidate will have expertise in managing structured and semi-structured data, integrating legacy and modern systems, and automating data flows across cloud and on-prem environments.

Key Responsibilities:

  • Design, develop, and maintain data pipelines for ingesting and transforming data from various sources (including APIs, flat files, DBs).
  • Integrate messaging systems like Kafka and RabbitMQ into the pipeline for event streaming and system decoupling.
  • Work closely with Business Analysts and BPEs to translate client requirements into technical data flows.
  • Implement and manage connectors for REST APIs, and file-based batch processes.
  • Ensure data lineage, auditability, and performance tuning of NiFi flows.
  • Deploy and monitor data flows in distributed environments using Zookeeper, Kafka, and ElasticSearch for logging and observability.
  • Strong experience in designing and implementing data integration solutions for real-time streaming data.

Required Skills:

  • 3–5+ years of experience in data integration/engineering roles.
  • Experience with Apache NiFi (flow design, templates, version control, custom processors).
  • Proficient in Kafka, RabbitMQ, and event-driven architectures.
  • Experience integrating with legacy systems ((BAPIs, IDocs, OData).
  • Scripting and transformation in Python, Groovy, or Java.
  • Familiarity with distributed systems (Zookeeper, ElasticSearch, etc.).
  • Experience with CI/CD for NiFi or container-based deployments (Docker, Kubernetes).

Nice to Have:

  • Knowledge of security practices (TLS, role-based access in NiFi).
  • Hands-on with monitoring tools (Prometheus, Grafana).
  • Familiarity with cloud platforms (AWS/GCP/Azure) for data storage or processing.

Other Requirements:

  • Eligibility for Top-Level Security Clearance:
    • Candidates must be eligible to obtain and maintain security clearance at the highest level, in accordance with applicable national security regulations.
  • On-Site Work Requirement:
    • This role requires full-time, on-site presence at the client's premises located in Pretoria. Remote or hybrid work arrangements are not applicable.

  • Data Scientist

    3 days ago

    South Africa Palindrome Data Full time R500 000 - R1 000 000 per year

    Palindrome Data uses contemporary machine learning to revolutionise traditional public health approaches. We currently focus on HIV and Maternal and Child Health programmes, and our work thus far has been in South Africa and the nearby region.We're growing the team and are opening a Data Science position to add new talent to our team and provide an...

  • Data Science Manager

    3 days ago

    South Africa Palindrome Data Full time R100 000 - R200 000 per year

    Palindrome Data uses contemporary machine learning to revolutionise traditional public health approaches. We currently have a focus on HIV and Maternal and Child Health programmes, and our work thus far has focused on South Africa and the surrounding region.We're growing the team and need a sharp Data Science Manager to lead our design, management and...

  • Data Engineer

    2 weeks ago

    South Africa b29e6a5b-e27b-490f-a5e1-e163acf00d2b Full time R1 200 000 - R2 400 000 per year

    Job Advert SummaryEduvos is looking to employ the services of a Data EngineerPurpose of the roleThe Data Engineer role at Eduvos reports to the National Manager: Data and BI, and is responsible for designing, building, and maintaining scalable data pipelines and architecture. The role includes supporting both batch and real-time data processing to ensure...

  • Data Engineer

    1 week ago

    South Africa Nedbank Private Wealth Full time R250 000 - R600 000 per year

    Job Classification Data Engineer TA: Luthando BowerClosing date: 1 December 2025 Job Family Information Technology Career Stream Data  Leadership Pipeline Manager of Self Professional Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap,...

  • Data Engineer

    1 week ago

    South Africa Kaleidocode Full time R600 000 - R1 200 000 per year

    Data EngineerRole PurposeWe are seeking an experienced and passionate Data Engineer to design and build robust data infrastructure that facilitates large data volumes. The role requires a blend of data engineering skills (taking data from various datasets and collections to clean, store, transform and analyse) and database administration skills (working...

  • Data Engineer

    1 week ago

    South Africa Nedbank Private Wealth Full time R250 000 - R500 000 per year

    Requisition Details & Talent Acquisition Consultant REQ Keabetswe Modise Job Family Information Technology Career Stream Data  Leadership Pipeline Manager of Self Professional Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to...

  • Data Engineer

    4 days ago

    Johannesburg, South Africa PBT Group Full time

    PBT Group is seeking an experienced Data Engineer to join our client’s dynamic data team. The successful candidate will work closely with senior stakeholders to design, develop, and maintain robust data pipelines and cloud-based solutions. This role requires a strong understanding of data engineering principles, data lake management, and cloud technologies...

  • Senior Data Engineer

    1 week ago

    Johannesburg, South Africa iDbase Software Full time

    About the Role We are seeking a highly skilled Senior Data Engineer to join our dynamic data team. You will be responsible for designing, building, and maintaining robust and scalable data pipelines and architectures that enable analytics and business intelligence at enterprise scale. This role is ideal for professionals who thrive in complex data...

  • Data Engineer

    3 days ago

    Johannesburg, South Africa, Mi-C3 International Full time R250 000 - R500 000 per year

    About MI-C3Established in 2014 by CEO and founder Glen Scott, MI-C3 International Limited is a Malta-based company specializing in delivering trusted software solutions tailored for mission-critical environments. Our flagship product, AFFECTLI, empowers organizations to make informed, data-driven decisions by providing a consolidated, real-time view of...

  • Data Engineer

    3 days ago

    Remote | South Africa Sand Tech Holdings Limited Full time R250 000 - R500 000 per year

    ABOUT SANDSand Technologies is a global leader in digital transformation, empowering leading organisations and governments worldwide to achieve their digital aspirations. We offer a comprehensive suite of services, including enterprise AI solutions, data science, software engineering, and IoT, delivered from our centres in the Americas, Europe, and...