GCP Data Engineer
4 days ago
- Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP).
- Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services.
- Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine learning models into production environments.
- Develop and maintain custom deployment solutions for machine learning models using tools such as Kubeflow, AI Platform, and Docker.
- Write clean, efficient, and maintainable code in Python and PySpark for data processing and transformation tasks.
- Ensure data quality, integrity, and consistency through data validation and monitoring processes.
- Deep understanding of Medallion architecture.
- Develop metadata-driven pipelines and ensure optimal processing of data.
- Use Terraform to manage and provision cloud infrastructure resources on GCP.
- Troubleshoot and resolve production issues related to data pipelines and machine learning models.
- Stay up-to-date with the latest industry trends and best practices in data engineering, machine learning, and cloud technologies, including data lifecycle management, data pruning, model drift, and model optimizations.
- Bachelors or Masters degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer with a focus on Google Cloud Platform (GCP).
- Strong proficiency in Python and PySpark for data processing and transformation.
- Hands-on experience with machine learning model deployment and integration on GCP.
- Familiarity with GCP services such as BigQuery, Cloud Storage, Dataflow, and AI Platform.
- Experience with Terraform for infrastructure as code.
- Experience with containerization and orchestration tools like Docker and Kubernetes.
- Strong problem-solving skills with the ability to troubleshoot complex issues.
- Excellent communication and collaboration skills
-
GCP Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Nagarro Full timeCompany DescriptionWe are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic...
-
Johannesburg, Gauteng, South Africa Nagarro Inc Full timeWe are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical....
-
GCP Data Specialist
4 days ago
Johannesburg, Gauteng, South Africa MECS Africa Full timeAbout the Role:We are looking for a talented individual to fill the position of GCP Data Specialist at MECS Africa. The successful candidate will have extensive knowledge of GCP services and experience in designing and implementing scalable data pipelines and ETL processes.Key Responsibilities:Implement and optimize data storage solutions using BigQuery,...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeA leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for youQualifications: BSc in Computer Science, Information Systems, Engineering, or a related...
-
Scalable Data Solutions Developer
4 days ago
Johannesburg, Gauteng, South Africa MECS Africa Full timeScalable Data Solutions Developer:MECS Africa is seeking a skilled developer to join our data engineering team. As a Scalable Data Solutions Developer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key Responsibilities:Design and implement efficient data storage...
-
Cloud Infrastructure Engineer
4 days ago
Johannesburg, Gauteng, South Africa MECS Africa Full timeJob Overview:MECS Africa is seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Responsibilities:Design and implement efficient data storage solutions...
-
Data Engineer
5 days ago
Johannesburg, Gauteng, South Africa PBT Group Full timeWe are seeking an experienced Data Engineer with strong expertise in T-SQL to develop, optimise and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage.Key Responsibilities:Develop, enhance, and maintain robust data...
-
Data Engineer
10 hours ago
Johannesburg, Gauteng, South Africa Planet10 Full timeA leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team.The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company's Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Nedbank Full timeJob title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended LinksJobs by Location Job by industries Job PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the...
-
Senior Data Engineer
5 days ago
Johannesburg, Gauteng, South Africa Nintex Full timeJob title : Senior Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries About the role: You are responsible for ensuring the development of high-quality data engineering products and services, delivered on time and to acceptance criteria. You are a respected technical leader...
-
Data Engineer
2 days ago
Johannesburg, Gauteng, South Africa Nedbank Full timeREQ Keabetswe ModiseClosing Date: 02 January 2024Job FamilyInformation TechnologyDataManager of Self ProfessionalJob PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose...
-
Data Engineer III
2 days ago
Johannesburg, Gauteng, South Africa LexisNexis Full timeAre you a strategic planner and problem-solver?Do you enjoy collaborating cross-functionally to deliver on common goals?Join us in shaping a more just world.About UsLexisNexis, a part of RELX, is a leading global provider of legal, regulatory, and business information. We help customers increase productivity and improve decision-making and outcomes. Our...
-
Lead Data Center Engineer
1 day ago
Johannesburg, Gauteng, South Africa Vantage Data Centers Full timeKey Responsibilities:Ensure that all assets receive the necessary life cycle and enhancement services.Ensure that assets are controlled, operated and to the necessary operational specifications.Ensure that all engineering services are always efficiently, effectively maintained, and controlled according to the client's specifications as stated in the...
-
Senior Data Engineering Position
5 days ago
Johannesburg, Gauteng, South Africa Promapp Full timeAbout Nintex:We strive to revolutionize the way businesses operate by leveraging cutting-edge technology. Our platform empowers organizations to streamline and optimize their processes, reducing complexity and improving efficiency. We serve over 10,000 public and private sector organizations globally, including industry leaders like Amazon, Coca-Cola, and...
-
Data Engineer – T-SQL
2 weeks ago
Johannesburg, Gauteng, South Africa PBT Group Full timePBT Group is seeking an experienced Data Engineer with strong expertise in T-SQL & Power BI to develop, optimise, and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage.Key Responsibilities:Develop, enhance, and maintain...
-
Data Engineer – T-SQL
3 days ago
Johannesburg, Gauteng, South Africa PBT Group Full timePBT Group is seeking an experienced Data Engineer with strong expertise in T-SQL & Power BI to develop, optimise, and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage. Key Responsibilities: Develop, enhance, and...
-
Senior Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Indsafri Full timeIndsafri City of Johannesburg, Gauteng, South AfricaExp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...
-
Johannesburg, Gauteng, South Africa Promapp Full timeAbout Nintex:At Nintex, we are committed to transforming the way businesses work. As a global leader in process intelligence and automation, we're trusted by thousands of organizations across the world. Our customers rely on our platform to accelerate their digital transformation journeys, managing, automating, and optimizing business processes...
-
Data Analyst
1 week ago
Johannesburg, Gauteng, South Africa Data Bene Full timeA vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...
-
Johannesburg, Gauteng, South Africa Ellison Institute of Technology Oxford Full timeDirector of Cloud Architecture and Engineering:We are seeking a highly skilled Director of Cloud Architecture and Engineering to lead the design, implementation, and oversight of a secure, scalable, and interoperable Cloud Health Information System (HIS). The ideal candidate will have a strong background in cloud-based health systems architecture,...