Software Engineer: Data Lake

4 months ago


Johannesburg, South Africa People Source Full time

Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the IoT Platform Solution.

  • Experience with wireless and network communication technologies such as Wi-Fi, GSM, LoRaWAN, Bluetooth, TCP/IP.
  • 2-5 years experience with data lake and warehousing solutions.
  • 2-5 years experience with either Python, Java, C++, C#, Sparql , SQL databases.
  • 2-5 years experience with either Apache Kafka (producers/consumers/connectors), Apache NiFi, Apache Spark, Apache ActiveMQ, MQTT, Modbus, REST API.


  • Johannesburg, South Africa BASHR Consulting Full time

    As a Senior Cloudera Data Lake Consultant, you will be required to provide technical expertise and advice to our clients in relation to their data lake projects. You will also be responsible in moving data from the SQL database and SAP database and then transfer it to a Cloudera Data Lake. **Requirements**: - Bachelor’s degree or Diploma in Computer...


  • Johannesburg, Gauteng, South Africa People Source Full time

    About the RoleAs a Data Lake Engineer Specialist, you will be responsible for ensuring the seamless integration of data from various sources into our IoT Platform Solution. This role requires strong technical skills, attention to detail, and excellent problem-solving abilities.You will collaborate with cross-functional teams to design and develop data...


  • Johannesburg, Gauteng, South Africa People Source Full time

    We are looking for a highly skilled Data Lake Solutions Developer to join our team at People Source. The successful candidate will be responsible for designing, developing, testing and documenting new and legacy data ingestion, integration, processing and storage software to meet the requirements of the IoT Platform Solution.The ideal candidate will have 2-5...

  • Data Lake Architect

    3 weeks ago


    Johannesburg, Gauteng, South Africa People Source Full time

    We are seeking a highly skilled Data Lake Architect to join our team at People Source. This is an exciting opportunity for the right candidate to work on designing, developing, and implementing cutting-edge data lake solutions.Job SummaryThe successful candidate will have 2-5 years of experience in data lake and warehousing solutions, as well as expertise in...

  • Software Engineer

    2 months ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution. This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing,...

  • Software Engineer

    2 months ago


    Johannesburg, South Africa MECS Africa Full time

    Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution.This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing,...

  • Software Engineer

    2 months ago


    Johannesburg, South Africa MECS Africa Full time

    Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution.This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing,...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job Title: Lead Software EngineerWe are seeking an experienced and skilled Lead Software Engineer to join our team at Data Centrix. About the Role:As a Lead Software Engineer, you will be responsible for researching, designing, implementing, and maintaining software programs and services.You will create and maintain database tables, functions, and stored...

  • Data Engineer

    3 days ago


    Johannesburg, South Africa E-Merge Full time

    A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements...


  • Johannesburg, Gauteng, South Africa People Source Full time

    A Software Engineer: Data Lake role has become available at People Source. We're looking for someone to help us shape the future of IoT data management and analytics.About the JobThis position requires strong knowledge of data lake architecture, design, development, and testing. The ideal candidate will possess 2-5 years of experience working with big data...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    As a Data Engineering Specialist at E-Merge, you will work with our team of experts to design and implement robust data engineering solutions. We are looking for a skilled professional with a strong background in Azure Cloud.You will be responsible for analyzing and organizing raw data, designing scalable data pipelines, and building clean, transformed, and...


  • Johannesburg, South Africa E-Merge Full time

    A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for a Senior Azure Data Engineer. Are you ready to empower businesses through...


  • Johannesburg, South Africa E-Merge Full time

    A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for a Senior Azure Data Engineer. Are you ready to empower businesses through...

  • Data Engineer

    4 days ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    Data Architecture and Design - Data Modeling: o Create normalized and denormalized schemas (3NF, star, snowflake). o Design data lakes, warehouses, and marts optimized for analytical or transactional workloads. o Incorporate modern paradigms like data mesh, lakehouse, and delta architecture. - ETL/ELT Pipelines: o Develop end-to-end pipelines for extracting,...

  • Data Engineer

    4 days ago


    Johannesburg, South Africa Discovery Full time

    Achieve more than YOU BELIEVE Discovery Corporate & Employee Benefits Data Engineer (Junior) About Discovery Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery....


  • Johannesburg, South Africa PBT Group Full time

    Define and lead the execution of the data engineering strategy with the intent to significantly evolve the enterprise data warehouse, ensuring seamless data pipelines and maintain data for availability and usability by the insights division. Lead the transformation of the data human capital to de-risk the environment and ensure adaptability to the changing...

  • Data Engineer

    4 days ago


    Johannesburg, South Africa Recru-it Full time

    Data Architecture and Design- Data Modeling:o Create normalized and denormalized schemas (3NF, star, snowflake).o Design data lakes, warehouses, and marts optimized for analytical or transactional workloads.o Incorporate modern paradigms like data mesh, lakehouse, and delta architecture.- ETL/ELT Pipelines:o Develop end-to-end pipelines for extracting,...

  • Data Engineer

    4 days ago


    Johannesburg, South Africa Recru-it Full time

    Data Architecture and Design- Data Modeling:o Create normalized and denormalized schemas (3NF, star, snowflake).o Design data lakes, warehouses, and marts optimized for analytical or transactional workloads.o Incorporate modern paradigms like data mesh, lakehouse, and delta architecture.- ETL/ELT Pipelines:o Develop end-to-end pipelines for extracting,...

  • Data Manager

    2 months ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    Key Responsibilities: Leadership & Strategy Development: - Design, develop, and implement a group-wide Rewards and Loyalty Programme. - Define a cohesive data strategy that aligns with business objectives and coalition partner requirements. Data Architecture & Cloud Solutions: - Build and manage a cloud-based data infrastructure using modern platforms...


  • Johannesburg, South Africa Entelect Software Ltd Full time

    Exciting Opportunity for an Intermediate Mobile Software Engineer at Entelect Elevate your career at Entelect, where we prioritise people and nurture a culture of growth, collaboration, and innovation. Join a dynamic, multidisciplinary environment that encourages versatility, and provides individual attention to career development, including direct access to...