GCP Data Engineer

2 weeks ago

Johannesburg, Gauteng, South Africa PBT Group Full time

Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning initiatives.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL processes on GCP to support a variety of data applications, including analytics, reporting, and machine learning.
  • Implement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.
  • Develop, maintain, and enhance data models in line with business requirements, optimising for performance and scalability.
  • Collaborate with cross-functional teams to understand business needs, translate them into technical solutions, and provide data access solutions tailored to specific use cases.
  • Conduct regular performance tuning, capacity management, and data quality checks to ensure the efficiency, security, and reliability of data infrastructure.
  • Implement security best practices, including data encryption, access control, and compliance with organisational and regulatory standards.
  • Develop and maintain comprehensive documentation on data architecture, data models, and processes.

Qualifications:

  • Bachelor's Degree in Computer Science, Information Systems, Engineering, or a related field.
  • 3+ years of experience as a Data Engineer with hands-on expertise in designing, building, and optimising data architectures on GCP.
  • Proficiency in SQL and Python for data transformation, automation, and integration.
  • Strong knowledge of GCP tools: BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Functions.
  • Experience with data modelling, ETL processes, and data warehousing concepts.
  • Experience with Apache Kafka or other streaming platforms is beneficial.
  • Familiarity with CI/CD tools and DevOps practices for data pipelines, such as Docker, Terraform, or Kubernetes, is advantageous.

Skills:

  • Analytical and problem-solving skills: Ability to diagnose complex data issues, recommend and implement solutions efficiently.
  • Attention to detail and commitment to data quality: Ensures that data is accurate, reliable, and adheres to company standards.
  • Communication and collaboration skills: Strong written and verbal communication abilities, capable of working well with both technical and non-technical stakeholders.
  • Self-motivated and adaptable: Able to work independently in a fast-paced environment, with a proactive approach to learning and adopting new technologies.

Preferred Competencies:

  • Certifications in Google Cloud (e.g., Professional Data Engineer) are a plus.
  • Experience with machine learning workflows and integration with data pipelines.
  • Knowledge of data governance principles and experience implementing data quality frameworks.

Why Join Us: This role offers the opportunity to work with cutting-edge cloud technology within a dynamic and collaborative environment. You'll have the chance to make a significant impact on our data strategy and contribute to innovative projects that push the boundaries of data engineering on GCP. If you're a dedicated GCP Data Engineer with a vision for data-driven success, we'd love to hear from you

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.

  • GCP Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform (GCP). Implement and optimize data storage solutions using BigQuery, Cloud Storage, and other GCP services. Collaborate with data scientists, machine learning engineers, data engineers, and other stakeholders to integrate and deploy machine...

  • GCP Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    GCP Data Engineer required in Johannesburg.Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP.This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for...

  • GCP Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Company DescriptionWe are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic...

  • GCP Data Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    Be part of our team of Data Specialists and embark on a career of the futureOur team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure...

  • GCP Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Nagarro Johannesburg, Gauteng, South AfricaCompany DescriptionWe are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries,...

  • GCP Data Engineering Expert

    4 days ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job OverviewMECS Africa is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and Development: Design and develop efficient data pipelines...

  • Senior GCP Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is looking for an experienced Senior GCP Engineer to join our team. As a Senior GCP Engineer, you will be responsible for implementing and managing data infrastructure on GCP.About the RoleImplement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.Conduct regular...

  • Big Data Engineering Lead on GCP

    4 days ago

    Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    Join our team at Nagarro Inc, a leading Digital Product Engineering company, and be part of shaping the future of digital product engineering. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP).Key ResponsibilitiesDevelop and maintain custom...

  • Data Engineering and Analytics Lead

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    The Cloud Data Architect will be responsible for designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureEnsure data quality, integrity, and security across all data processing workflows.Implement data governance,...

  • Senior GCP Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nagarro Full time

    Nagarro Johannesburg, Gauteng, South AfricaAbout UsWe build products, services, and experiences that inspire, excite, and delight. Our work culture is dynamic and non-hierarchical, and we are looking for great new colleagues to join our team.This role requires designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud...

  • GCP Engineer Role

    7 days ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    About the Role:PBT Group is seeking a highly skilled GCP Engineer to play a key role in shaping our data strategy.The successful candidate will be responsible for designing and implementing robust data pipelines and architectures that meet business needs.Responsibilities:Develop and maintain comprehensive documentation on data architecture, data models, and...

  • Senior Data Engineer/Analyst

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data engineering, analytics, and cloud-based...

  • Senior Data Engineer/Analyst

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year contractHybrid RoleJohannesburgJob Summary We are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data...

  • Big Data and AI Developer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a talented Cloud Data Architect to lead our cloud-based data solutions. The successful candidate will have experience in designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureCollaborate with Data...

  • GCP Professional Data Solutions Specialist

    4 days ago

    Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    Nagarro Inc is a leading Digital Product Engineering company that is changing the way businesses interact with their customers. We are looking for a skilled Data Engineer to join our team and help us build innovative products and services that meet the evolving needs of our clients.Job ResponsibilitiesYou will design, develop, and maintain scalable data...

  • GCP Data Engineer South Africa, Johannesburg Employee

    2 weeks ago

    Johannesburg, Gauteng, South Africa Nagarro Inc Full time

    We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical....

  • Data Pipeline Developer

    4 days ago

    Johannesburg, Gauteng, South Africa MECS Africa Full time

    Job DescriptionAs a Data Engineer at MECS Africa, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform (GCP). You will also collaborate with data scientists, machine learning engineers, and other stakeholders to integrate and deploy machine learning models into production...

  • GCP Solutions Developer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group seeks a dedicated GCP Solutions Developer to collaborate with cross-functional teams and develop comprehensive documentation on data architecture, data models, and processes.Main ResponsibilitiesCollaborate with cross-functional teams to understand business needs and provide data access solutions tailored to specific use cases.Develop and maintain...

  • Senior Machine Learning Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year ContractHybrid RoleJohannesburgJob Summary:We are seeking an experienced Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models. The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing...

  • Data Engineer/Analyst Position

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer seeks a highly skilled Senior Data Engineer/Analyst to join our dynamic team.Job DescriptionThis role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable and efficient ETL pipelines...