GCP Data Engineer

3 weeks ago


Johannesburg, Gauteng, South Africa Nagarro Full time

Company Description

We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in

Job Description
  • Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP).
  • Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services.
  • Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine learning models into production environments.
  • Develop and maintain custom deployment solutions for machine learning models using tools such as Kubeflow, AI Platform, and Docker.
  • Write clean, efficient, and maintainable code in Python and PySpark for data processing and transformation tasks.
  • Ensure data quality, integrity, and consistency through data validation and monitoring processes.
  • Deep understanding of Medallion architecture.
  • Develop metadata-driven pipelines and ensure optimal processing of data.
  • Use Terraform to manage and provision cloud infrastructure resources on GCP.
  • Troubleshoot and resolve production issues related to data pipelines and machine learning models.
  • Stay up-to-date with the latest industry trends and best practices in data engineering, machine learning, and cloud technologies.
  • Understand data lifecycle management, data pruning, model drift, and model optimizations.
Qualifications

Must have Skills: Machine Learning - General Experience, Visualization, Google Cloud Platform, PySpark.

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer with a focus on GCP.
  • Strong proficiency in Python and PySpark for data processing and transformation.
  • Hands-on experience with machine learning model deployment and integration on GCP.
  • Familiarity with GCP services such as BigQuery, Cloud Storage, Dataflow, and AI Platform.
  • Experience with Terraform for infrastructure as code.
  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Strong problem-solving skills and the ability to troubleshoot complex issues.
  • Excellent communication and collaboration skills.
Additional Information

Preferred Qualifications:

  • Experience with custom deployment solutions and MLOps.
  • Knowledge of other cloud platforms (AWS, Azure) is a plus.
  • Familiarity with CI/CD pipelines and tools like Jenkins or GitLab CI.
  • Visualization experience is nice to have but not mandatory.
  • Certification in GCP Data Engineering or related fields.
#J-18808-Ljbffr
  • GCP Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP). Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services. Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine...

  • GCP Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    GCP Data Engineer required in Johannesburg.Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP.This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for...

  • GCP Data Engineer

    7 days ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    Be part of our team of Data Specialists and embark on a career of the futureOur team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure...

  • GCP Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Nagarro Full time

    Nagarro Johannesburg, Gauteng, South AfricaCompany DescriptionWe are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries,...

  • GCP Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning...


  • Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job OverviewMECS Africa is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and Development: Design and develop efficient data pipelines...

  • Senior GCP Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is looking for an experienced Senior GCP Engineer to join our team. As a Senior GCP Engineer, you will be responsible for implementing and managing data infrastructure on GCP.About the RoleImplement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.Conduct regular...


  • Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    Join our team at Nagarro Inc, a leading Digital Product Engineering company, and be part of shaping the future of digital product engineering. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key ResponsibilitiesDevelop and maintain custom...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    The Cloud Data Architect will be responsible for designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureEnsure data quality, integrity, and security across all data processing workflows.Implement data governance,...

  • Senior GCP Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Nagarro Full time

    Nagarro Johannesburg, Gauteng, South AfricaAbout UsWe build products, services, and experiences that inspire, excite, and delight. Our work culture is dynamic and non-hierarchical, and we are looking for great new colleagues to join our team.This role requires designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud...

  • GCP Engineer Role

    7 days ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    About the Role:PBT Group is seeking a highly skilled GCP Engineer to play a key role in shaping our data strategy.The successful candidate will be responsible for designing and implementing robust data pipelines and architectures that meet business needs.Responsibilities:Develop and maintain comprehensive documentation on data architecture, data models, and...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data engineering, analytics, and cloud-based...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year contractHybrid RoleJohannesburgJob Summary We are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a talented Cloud Data Architect to lead our cloud-based data solutions. The successful candidate will have experience in designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureCollaborate with Data...


  • Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    Nagarro Inc is a leading Digital Product Engineering company that is changing the way businesses interact with their customers. We are looking for a skilled Data Engineer to join our team and help us build innovative products and services that meet the evolving needs of our clients.Job ResponsibilitiesYou will design, develop, and maintain scalable data...


  • Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical....


  • Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job DescriptionAs a Data Engineer at MECS Africa, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP). You will also collaborate with data scientists, machine learning engineers, and other stakeholders to integrate and deploy machine learning models into production...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group seeks a dedicated GCP Solutions Developer to collaborate with cross-functional teams and develop comprehensive documentation on data architecture, data models, and processes.Main ResponsibilitiesCollaborate with cross-functional teams to understand business needs and provide data access solutions tailored to specific use cases.Develop and maintain...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year ContractHybrid RoleJohannesburgJob Summary:We are seeking an experienced Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models. The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer seeks a highly skilled Senior Data Engineer/Analyst to join our dynamic team.Job DescriptionThis role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable and efficient ETL pipelines...