GCP Data Engineer

6 days ago

Johannesburg, Gauteng, South Africa Nagarro Full time

Company Description

We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in

Job Description
  • Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP).
  • Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services.
  • Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine learning models into production environments.
  • Develop and maintain custom deployment solutions for machine learning models using tools such as Kubeflow, AI Platform, and Docker.
  • Write clean, efficient, and maintainable code in Python and PySpark for data processing and transformation tasks.
  • Ensure data quality, integrity, and consistency through data validation and monitoring processes.
  • Deep understanding of Medallion architecture.
  • Develop metadata-driven pipelines and ensure optimal processing of data.
  • Use Terraform to manage and provision cloud infrastructure resources on GCP.
  • Troubleshoot and resolve production issues related to data pipelines and machine learning models.
  • Stay up-to-date with the latest industry trends and best practices in data engineering, machine learning, and cloud technologies.
  • Understand data lifecycle management, data pruning, model drift, and model optimizations.
Qualifications

Must have Skills: Machine Learning - General Experience, Visualization, Google Cloud Platform, PySpark.

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer with a focus on GCP.
  • Strong proficiency in Python and PySpark for data processing and transformation.
  • Hands-on experience with machine learning model deployment and integration on GCP.
  • Familiarity with GCP services such as BigQuery, Cloud Storage, Dataflow, and AI Platform.
  • Experience with Terraform for infrastructure as code.
  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Strong problem-solving skills and the ability to troubleshoot complex issues.
  • Excellent communication and collaboration skills.
Additional Information

Preferred Qualifications:

  • Experience with custom deployment solutions and MLOps.
  • Knowledge of other cloud platforms (AWS, Azure) is a plus.
  • Familiarity with CI/CD pipelines and tools like Jenkins or GitLab CI.
  • Visualization experience is nice to have but not mandatory.
  • Certification in GCP Data Engineering or related fields.
#J-18808-Ljbffr

  • GCP Data Engineer

    2 days ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP). Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services. Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine...

  • GCP Data Engineering Specialist

    1 week ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    About NagarroWe are a Digital Product Engineering company that is scaling rapidly. Our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical.About the RoleWe are looking for a highly skilled Data Engineer to join our team.You will be responsible for designing, developing, and...

  • Cloud Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Job OverviewNagarro is a Digital Product Engineering company that is scaling rapidly. We build products, services, and experiences that inspire, excite, and delight.About the RoleWe are looking for a highly skilled Data Engineer to join our team.You will design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform...

  • GCP Data Specialist

    1 day ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    About the Role:We are looking for a talented individual to fill the position of GCP Data Specialist at MECS Africa. The successful candidate will have extensive knowledge of GCP services and experience in designing and implementing scalable data pipelines and ETL processes.Key Responsibilities:Implement and optimize data storage solutions using BigQuery,...

  • GCP Cloud Data Solutions Expert

    6 days ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Job OverviewNagarro is a leading Digital Product Engineering company that offers innovative solutions to businesses. We are seeking a skilled GCP Data Engineer to join our team.

  • Data Pipeline Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Our TeamWe are a collaborative and dynamic team of professionals who are passionate about delivering high-quality solutions.About the RoleWe are looking for a highly skilled Data Engineer to join our team.Key Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes on GCP.Implement and optimize data storage solutions using...

  • Data Engineering and Machine Learning Professional

    6 days ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Data Engineer RoleWe design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Our team implements and optimizes data storage solutions using BigQuery, Cloud Storage, and other GCP services.Collaboration with data scientists, machine learning engineers, and other stakeholders to integrate and deploy machine...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    About the JobThis is an exciting opportunity to join our team as a Data Engineer and contribute to the design, development, and maintenance of scalable data pipelines and ETL processes on GCP.Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes on GCP.Implement and optimize data storage solutions using BigQuery, Cloud...

  • Data Engineer Position

    7 days ago

    Johannesburg, Gauteng, South Africa Indsafri Full time

    Job OverviewThe company, Indsafri, is seeking a skilled Data Engineer to join its team. This permanent, full-time role requires a professional with expertise in data engineering, including experience with cloud computing platforms such as AWS, Azure, and GCP.This position involves designing, building, and maintaining scalable and optimized data...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for youQualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Scalable Data Solutions Developer

    1 day ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Scalable Data Solutions Developer:MECS Africa is seeking a skilled developer to join our data engineering team. As a Scalable Data Solutions Developer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key Responsibilities:Design and implement efficient data storage...

  • Cloud Infrastructure Engineer

    2 days ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job Overview:MECS Africa is seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Responsibilities:Design and implement efficient data storage solutions...

  • Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    We are seeking an experienced Data Engineer with strong expertise in T-SQL to develop, optimise and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage.Key Responsibilities:Develop, enhance, and maintain robust data...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nedbank Full time

    Job title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended LinksJobs by Location Job by industries Job PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the...

  • Senior Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Nintex Full time

    Job title : Senior Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries About the role: You are responsible for ensuring the development of high-quality data engineering products and services, delivered on time and to acceptance criteria.  You are a respected technical leader...

  • Senior Data Engineering Position

    2 days ago

    Johannesburg, Gauteng, South Africa Promapp Full time

    About Nintex:We strive to revolutionize the way businesses operate by leveraging cutting-edge technology. Our platform empowers organizations to streamline and optimize their processes, reducing complexity and improving efficiency. We serve over 10,000 public and private sector organizations globally, including industry leaders like Amazon, Coca-Cola, and...

  • Data Engineer – T-SQL

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is seeking an experienced Data Engineer with strong expertise in T-SQL & Power BI to develop, optimise, and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage.Key Responsibilities:Develop, enhance, and maintain...

  • Data Engineer – T-SQL

    1 day ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is seeking an experienced Data Engineer with strong expertise in T-SQL & Power BI to develop, optimise, and maintain data solutions. The ideal candidate will have a solid background in SQL-based ETL development, data modelling, and reporting, with exposure to Ab Initio being a beneficial advantage. Key Responsibilities: Develop, enhance, and...

  • Senior Data Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa Indsafri Full time

    Indsafri City of Johannesburg, Gauteng, South AfricaExp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...