Intermediate Data Engineer

2 weeks ago

Johannesburg, Gauteng, South Africa Dariel Full time R250 000 - R600 000 per year

Data Engineer / Streaming Engineer


Johannesburg, Gauteng, South Africa
(Hybrid)


Employment Type
: Full-Time

About the Role

We are looking for a highly skilled and motivated
Data Engineer / Streaming Engineer
to join our team. This role is central to building and supporting scalable, secure, and repeatable data pipelines that power intelligent decision-making. You'll work in an agile environment, integrating diverse data sources and leveraging emerging technologies across big data and cloud platforms to deliver innovative solutions.

Key Responsibilities

  • Architect and implement scalable data analytics frameworks.
  • Translate complex functional and technical requirements into high-performing software solutions.
  • Lead the development of batch and real-time data pipelines using transformational technologies.
  • Create and support data feeds from on-premise systems to AWS Cloud.
  • Build data marts using Talend or similar ETL tools.
  • Manipulate and process data using Python and PySpark/Spark.
  • Leverage AWS services such as EMR, EC2, and S3 for big data processing.
  • Support production data feeds and troubleshoot issues on a break-fix basis.
  • Contribute to the research, evaluation, and implementation of new tools and technologies.
  • Ensure compliance with policies, standards, and disaster recovery protocols.
  • Collaborate across teams to deliver robust data solutions aligned with business needs.

Required Experience & Skills

  • Bachelor's degree in Computer Science, Computer Engineering, or equivalent.
  • AWS Certification (preferred).
  • 5+ years of experience in data engineering or software engineering.
  • 2+ years of experience with big data technologies.
  • 2+ years of experience with ETL processes and tools (e.g., Talend).
  • 2+ years of hands-on experience with AWS services.
  • Strong programming skills in Python and scripting languages.
  • Experience with PySpark or Spark for distributed data processing.
  • Deep understanding of data modeling and various data structures.
  • Proven ability to architect scalable distributed systems using open-source tools.
  • Familiarity with Hadoop and AWS EMR.
  • Knowledge of automated testing and deployment practices.

Technologies You'll Work With

  • Big Data Tools
    : Hadoop, Spark, PySpark
  • ETL Tools
    : Talend
  • Cloud Platforms
    : AWS (EMR, EC2, S3)
  • Languages
    : Python, scripting languages
  • Data Processing
    : Batch and streaming pipelines

Why Join Dariel?

  • Work on impactful, data-driven projects using the latest technologies.
  • Be part of a collaborative and innovative team.
  • Opportunities for continuous learning and professional growth.
  • Competitive compensation and benefits.

  • Intermediate Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa The Nippon Telegraph and Telephone Corporation (NTT) Full time R900 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.Your day at NTT DATAAs an Intermediate...

  • Intermediate Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R250 000 - R500 000 per year

    Minimum requirements:Post Graduate Degree: Information TechnologyPost Graduate Degree: Information StudiesMasters Degree: Information TechnologyMasters Degree: Information StudiesExperienceMinimum 3 years experienceIT ArchitectureData IntegrityIT ApplicationsData AnalysisKnowledge ClassificationC++.Amazon Web Services.Amazon S3.DatabricksSkills:Database...

  • Intermediate Chemical Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R1 200 000 - R2 400 000 per year

    Power & Energy Sector Onsite About the RoleWe are looking for an Intermediate Chemical Engineer to support a range of engineering initiatives within the power and energy sector, including electricity generation, transmission, distribution, and trading. This  role is ideal for an engineer with 8+ years of relevant experience, ready to contribute to...

  • Intermediate Industrial Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R600 000 - R1 200 000 per year

    About the RoleWe are looking for an Intermediate Industrial Engineer to support a range of engineering and operational improvement initiatives. The role is ideal for an engineer with 5+ years of relevant experience, ready to take on responsibilities that drive efficiency, process optimization, and cost reduction within our operations.This role presents an...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Hyperclear Tech Full time R500 000 - R750 000 per year

    JOB TITLE: Intermediate Data EngineerLOCATION: Stellenbosch / Johannesburg (Hybrid)ABOUT CYBERLOGIC: Cyberlogic is a trusted Managed Solutions Provider with offices in South Africa, Mauritius, and the UK. Serving a diverse range of clients, spanning numerous industries, including the international maritime sector, Cyberlogic specialises in IT leadership,...

  • Data Engineer Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Praesignis Full time R900 000 - R1 200 000 per year

    We are looking for an experienced intermediate Data Engineer. Candidate must have strong SQL & SSIS capabilities, good production support with experience for being on call on a 7-day rotation cycle. AWS cloud skills would be a massive benefit as well.Skills & Experience Required:Technical Stack:Strong proficiency in  SSIS (SQL Server Integration Services) ...

  • Senior Data Management Security Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Intermediate Data Capturer

    3 days ago

    Johannesburg, Gauteng, South Africa SavageOne Pty Full time R120 000 - R180 000 per year

    Job SummaryWe are seeking a detail-oriented and efficient Intermediate Data Capturer to support our data operations. The ideal candidate will have strong typing accuracy, data management skills, and a proactive attitude toward maintaining data integrity. You will be responsible for accurately inputting, updating, and verifying data into internal systems...

  • Intermediate Full Stack Software Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R400 000 - R800 000 per year

    Hire Resolve's client is seeking a skilled Intermediate Full Stack Software Engineer to join their team. As a Full Stack Software Engineer, you will be responsible for developing and maintaining software applications, collaborating with cross-functional teams, and ensuring the scalability and reliability of the applications.ResponsibilitiesCode development...

  • Data Engineers

    5 days ago

    Johannesburg, Gauteng, South Africa InfyStrat Full time R900 000 - R1 200 000 per year

    InfyStrat is on the lookout for skilled and driven Data Engineers with expertise in Denodo to join our innovative data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data integration solutions that leverage Denodo's data virtualization platform. Your role will be pivotal in transforming complex data into actionable...