Data Engineer
1 day ago
Data Engineer / Streaming Engineer
Johannesburg, Gauteng, South Africa
(Hybrid)
Employment Type
: Full-Time
About the Role
We are looking for a highly skilled and motivated
Data Engineer / Streaming Engineer
to join our team. This role is central to building and supporting scalable, secure, and repeatable data pipelines that power intelligent decision-making. You'll work in an agile environment, integrating diverse data sources and leveraging emerging technologies across big data and cloud platforms to deliver innovative solutions. A Software development is essential for this role
Key Responsibilities
- Architect and implement scalable data analytics frameworks.
- Translate complex functional and technical requirements into high-performing software solutions.
- Lead the development of batch and real-time data pipelines using transformational technologies.
- Create and support data feeds from on-premise systems to Google Cloud Platform.
- Build data marts using Talend or similar ETL tools.
- Manipulate and process data using Python and PySpark/Spark.
- Leverage AWS services such as EMR, EC2, and S3 for big data processing.
- Support production data feeds and troubleshoot issues on a break-fix basis.
- Contribute to the research, evaluation, and implementation of new tools and technologies.
- Ensure compliance with policies, standards, and disaster recovery protocols.
- Collaborate across teams to deliver robust data solutions aligned with business needs.
Required Experience & Skills
- Bachelor's degree in Computer Science, Computer Engineering, or equivalent.
- AWS Certification (preferred).
- 5+ years of experience in data engineering and software engineering.
- 2+ years of experience with big data technologies.
- 2+ years of experience with ETL processes and tools (e.g., Talend).
- 2+ years of hands on experience with GCP - Google Cloud Platform is ESSENTIAL
- Strong programming skills in Python and scripting languages.
- Experience with PySpark or Spark for distributed data processing.
- Deep understanding of data modeling and various data structures.
- Proven ability to architect scalable distributed systems using open-source tools.
- Familiarity with Hadoop and AWS EMR.
- Knowledge of automated testing and deployment practices.
Technologies You'll Work With
- Big Data Tools
: Hadoop, Spark, PySpark - ETL Tools
: Talend - Cloud Platforms
: AWS (EMR, EC2, S3) - Languages
: Python, scripting languages - Data Processing
: Batch and streaming pipelines
Why join us?
- Work on impactful, data-driven projects using the latest technologies.
- Be part of a collaborative and innovative team.
- Opportunities for continuous learning and professional growth.
- Competitive compensation and benefits.
-
Senior Data Management Security Engineer
5 days ago
Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...
-
Lead Forward Deployed Engineer
1 day ago
Johannesburg, Gauteng, South Africa RANGR Data Full time R1 200 000 - R2 400 000 per yearRANGR Data is an advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir FoundryRole OverviewAs Lead Engineer, you are responsible for driving the technical success of client solutions by leading a team of engineers in designing,...
-
Data Engineers
7 days ago
Johannesburg, Gauteng, South Africa InfyStrat Full time R900 000 - R1 200 000 per yearInfyStrat is on the lookout for skilled and driven Data Engineers with expertise in Denodo to join our innovative data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data integration solutions that leverage Denodo's data virtualization platform. Your role will be pivotal in transforming complex data into actionable...
-
Data Engineer
1 day ago
Johannesburg, Gauteng, South Africa Betway Africa Full time R250 000 - R500 000 per yearKick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline DevelopmentData Engineers design and develop data pipelines to extract, transform, and load (ETL) data from various sources into a data warehouse, data lake, or data mart. They use technologies such as Apache Spark, Apache Kafka, or...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa PBT Group Full time R600 000 - R1 200 000 per yearPBT Group is seeking a skilled Data Engineer to join a growing Data Science team responsible for designing, developing, and optimising data pipelines and integration frameworks to support advanced analytics and machine learning initiatives. The successful candidate will play a key role in ensuring seamless data flow, scalability, and reliability across cloud...
-
Associate Director Advisory Group: Water
7 days ago
Johannesburg, Gauteng, South Africa Gig Engineer Full time R2 000 000 - R2 500 000 per yearLocation:Woodmead, Johannesburg, Gauteng, South AfricaEmployment Type:PermanentOverviewThe Associate Director (AD) plays a critical role within the Water Advisory Group (AG) management team, driving performance, growth, and a positive culture. This position provides strategic, operational, client, and people leadership, supporting the delivery of the AG's...
-
Data Engineer
5 days ago
Johannesburg, Gauteng, South Africa PBT Group Full time R250 000 - R500 000 per yearPBT Group is seeking an experienced Data Engineer to join our client's dynamic data team. The successful candidate will work closely with senior stakeholders to design, develop, and maintain robust data pipelines and cloud-based solutions.This role requires a strong understanding of data engineering principles, data lake management, and cloud technologies...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Pbt Group Full time R500 000 - R1 200 000 per year? Data Engineer – Azure Data Factory & DatabricksJoin PBT Group and help us build the future of data-driven innovationPBT Group is looking for an experienced Data Engineer with deep expertise in Azure Data Factory (ADF) and Databricks to design, develop, and optimise scalable data solutions. This role is perfect for a proactive problem-solver who thrives...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa PBT Group Full time R1 200 000 - R3 600 000 per yearEmployment TypeContractExperience5 to 20 yearsSalaryNegotiableJob Published04 November 2025Job Reference No. Job DescriptionPBT Group is seeking a skilled Data Engineer to join a growing Data Science team responsible for designing, developing, and optimising data pipelines and integration frameworks to support advanced analytics and machine learning...
-
Data Engineer
5 days ago
Johannesburg, Gauteng, South Africa Calibrate People Full time R1 200 000 - R3 600 000 per yearData Engineer"Join Us as a Data Alchemist: Turn Raw Data into Golden Insights"Location: Johannesburg, SA - Hybrid | Salary:Competitive (Cause you're worth it)Are you a data virtuoso with a flair for crafting seamless data highways? We're on the hunt for a Data Engineer extraordinaire to join our client's dynamic Technology Team. This role offers the...