Data Pipeline Engineer
2 days ago
We are a collaborative and dynamic team of professionals who are passionate about delivering high-quality solutions.
About the RoleWe are looking for a highly skilled Data Engineer to join our team.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes on GCP.
- Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services.
- Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine learning models into production environments.
- Develop and maintain custom deployment solutions for machine learning models using tools such as Kubeflow, AI Platform, and Docker.
- Write clean, efficient, and maintainable code in Python and PySpark for data processing and transformation tasks.
- Ensure data quality, integrity, and consistency through data validation and monitoring processes.
- Deep understanding of Medallion architecture.
- Develop metadata driven pipelines and ensure optimal processing of data.
- Use Terraform to manage and provision cloud infrastructure resources on GCP.
- Troubleshoot and resolve production issues related to data pipelines and machine learning models.
- Stay up-to-date with the latest industry trends and best practices in data engineering, machine learning, and cloud technologies.
- Understand data lifecycle management, data pruning, model drift, and model optimizations.
-
Data Pipeline Specialist
7 days ago
Johannesburg, Gauteng, South Africa Nagarro Inc Full timeWe're a dynamic and non-hierarchical company that builds innovative products, services, and experiences. Our work culture is employee-centric, and we're looking for great new colleagues to join our team.Job OverviewWe're seeking a senior big data expert to lead our cloud data pipeline efforts on Google Cloud Platform (GCP). The ideal candidate will have a...
-
Data Pipeline Architect
2 days ago
Johannesburg, Gauteng, South Africa Standard Bank Group Full timeJob DescriptionTo design and implement data pipelines and data stores according to agreed architecture and standards. Monitor progress and identify issues related to data engineering activities.Collaborate with others in reviews of work where appropriate. To build data visualization solutions like reports, regulatory reports, reconciliatory reports, and...
-
Pipeline Design and Engineering Expert
7 days ago
Johannesburg, Gauteng, South Africa Rand Water Recruitment Full timeJob DescriptionThe role of the Senior Pipeline Engineer at Rand Water Recruitment is to lead the design and development of large diameter steel pipelines for the organization's vast distribution network.The incumbent will work as part of the Pipeline Design Team to execute the pipeline engineering design function, assisting in route selection, hydraulic...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeA leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business. Key Responsibilities: Implement...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeA leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for youQualifications: BSc in Computer Science, Information Systems, Engineering, or a related...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Edge Executives Full timeWe are seeking a skilled Data Engineer to design and optimize scalable data infrastructure for AI, machine learning, and generative AI initiatives. This role involves building ETL/ELT pipelines, managing AWS-based data systems, and collaborating with cross-functional teams to develop cutting-edge solutions. Ideal candidates will have experience in AWS...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...
-
Analytical Data Solutions Provider
1 day ago
Johannesburg, Gauteng, South Africa Data Bene Full timeAbout the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...
-
Data Streaming Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa PRR Recruitment Full timeData Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...
-
Data Streaming Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa PRR Recruitment Full timeData Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Nedbank Full timeJob title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended LinksJobs by Location Job by industries Job PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the...
-
Data Engineering Lead
1 day ago
Johannesburg, Gauteng, South Africa Betway Group Full timeAbout the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to...
-
Data Engineer Specialist
7 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob Description:We are seeking a highly skilled and experienced Data Engineer to develop and maintain scalable, secure, and repeatable data pipelines. Key responsibilities include implementing and maintaining scalable data pipelines, ensuring data quality and accuracy for reporting and analysis, and developing prototypes and solutions for data science...
-
Data Streaming Engineer
1 week ago
Johannesburg, Gauteng, South Africa Golden Rule Full timeBuild, enhance, and maintain our real-time data pipeline. Work with various infrastructure and operations teams to maintain our data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the continued growth of the bank. You will collaborate with many...
-
Cloud Data Engineer
2 days ago
Johannesburg, Gauteng, South Africa Standard Bank of South Africa Limited Full timeWe are seeking an experienced Cloud Data Engineer to join our team at Standard Bank of South Africa Limited. In this role, you will be responsible for designing and implementing cloud-based data pipelines and data stores, ensuring they meet the required standards and governance requirements.Responsibilities:To design, code, verify, test, document, amend, and...
-
Cloud Data Engineer
7 days ago
Johannesburg, Gauteng, South Africa Nagarro Inc Full timeWe are a digital product engineering company that scales big. We build products, services, and experiences that inspire and delight. Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues to join our team.Job OverviewWe're seeking an experienced data engineer to lead our cloud data pipeline efforts on Google Cloud Platform...
-
Senior Data Engineer
1 day ago
Johannesburg, Gauteng, South Africa Indsafri Full timeIndsafri City of Johannesburg, Gauteng, South AfricaExp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob & Company Description An industry requiring specialist skills, deserves specialist recruitment.I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority.This will allow me to enhance your current skills...