Senior Cloud Data Engineer

1 week ago


Cape Town, Western Cape, South Africa CapitalH Full time

Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa's top digital, print, and ecommerce platforms.

The client's team of engineers, data scientists, product managers and UX/UI design specialists develop exceptional digital products for renowned brands. By harnessing cutting-edge technology and a sophisticated tech stack, they deliver world-class solutions. Our vibrant, people-focused culture, commitment to innovation, and strong societal mission are at the heart of everything we do.

What will you do?

  • You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernetes and AI Hub.
  • You should ideally dream in Python and speak SQL.
  • You should not be afraid to dive into dirty data and help the team make sense of it.
  • We are in the game of taking data and turning it into amazing stories and pretty pictures that helps the decision makers drive the business forward.

What should you have?

  • Bachelor's degree in Computer Science or Software Engineering
  • 5+ years development experience working with Python
  • Data skills (Traditional SQL and No-SQL)
  • Large scale ETL
  • High scale Restful Services
  • Cloud experience (Google cloud platform preferred)
  • Experience with source control (Git)

Beneficial Skills

You will be exposed to these in our environment, so it would be great if you had prior experience, but it's not a problem if you don't.

  • Scheduling and Orchestration (Airflow/Composer)
  • Containerization (Kubernetes, Docker)
  • BigQuery
  • Elastic search
  • Data Warehousing concepts
  • Data governance Concepts.
  • Apache beam (Cloud Dataflow)
  • Apache Spark (Dataproc)

General:

  • Only shortlisted candidates will be contacted. Should you not hear from us after 30 days you may consider your application unsuccessful
  • Given the employment equity policy of the client, preference will be given to suitable candidates from the designated groups.
  • Please include your current salary and salary expectations.


  • Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    **Job Overview**We are seeking an experienced Senior Cloud Data Architect to lead the data engineering efforts for a financial data migration project at Datonomy Solutions.The role focuses on designing, building, and optimizing cloud-based data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud.The ideal...


  • Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview:We are seeking an experienced Senior Cloud Data Architect to lead our data engineering efforts for a financial data migration project at Datonomy Solutions. The ideal candidate will have deep expertise in designing, building, and optimizing data pipelines to support the transition from on-premise systems to cloud-based platforms.Key...

  • Cloud Data Engineer

    6 days ago


    Cape Town, Western Cape, South Africa Skill Smiths Full time

    About the JobSkill Smiths is looking for a Cloud Data Engineer to join our team. As a key member of our Central Data Team, you will contribute to the development of our next-generation data platform.Key Responsibilities:Lead the design, orchestration, and implementation of robust data pipelines for batch and real-time processing.Ensure best practices in data...

  • Cloud Data Engineer

    1 week ago


    Cape Town, Western Cape, South Africa Vito Solutions Full time

    Job title : Cloud Data Engineer (Mid-Level)Job Location : Western Cape, Cape TownDeadline : March 28, 2025Quick Recommended LinksJobs by Location Job by industries JOB OVERVIEW:We are looking for an experienced and driven Cloud Data Engineer to become part of a vibrant data engineering unit. The successful candidate's responsibility will involve utilising...


  • Cape Town, Western Cape, South Africa 5th Dimension Consulting Full time

    Empowering Autonomous Value CreationOur newly created engineering organisation at 5th Dimension Consulting aims to accelerate insights and machine learning across our group. We're seeking a talented Data Engineer to join our Ingestions Squad and contribute to designing and deploying high-performance data ingestion platforms.The ideal candidate will be...


  • Cape Town, Western Cape, South Africa DVT Full time

    DVT is a leading provider of software development, technology consulting, and services with a presence in several countries. We are seeking an experienced Senior Data Engineer to join our team and contribute to the design, development, and maintenance of scalable data solutions and infrastructure for our clients.This position requires a deep understanding of...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...


  • Cape Town, Western Cape, South Africa Skill Smiths Full time

    About the PositionWe are seeking a Senior Technical Lead - Data Engineering to join our team at Skill Smiths. As a key member of our Central Data Team, you will lead the technical direction of our data platform and collaborate with leaders, senior engineers, and architects of the broader Engineering team.Key Responsibilities:Drive the technical data platform...


  • Cape Town, Western Cape, South Africa Amazon Full time

    Are you passionate about cloud computing and big data? Do you want to work with cutting-edge technologies like Hadoop and Spark? Look no further! As a Cloud Support Engineer at Amazon, you will be responsible for supporting customers who are running ETL workloads or analyzing large amounts of data using AWS services.You will work on various services...

  • Data Engineer

    7 days ago


    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview:We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...


  • Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    The successful candidate will be responsible for building, optimizing, and maintaining complex data pipelines and databases. They will collaborate with data scientists and analysts to ensure seamless data accessibility and quality while developing ETL processes and scalable storage solutions. The role involves implementing best practices for data security,...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    An innovative retail media solutions provider is looking for a Data Engineer to join their team. This company specializes in dynamic digital display networks and strategic in-store advertising, empowering brands to maximize visibility and customer engagement through cutting-edge technology and impactful campaigns. Skills Required · BSc in Computer Science,...

  • Data Engineer

    6 days ago


    Cape Town, Western Cape, South Africa Amazon Full time

    As a Cloud Support Engineer at Amazon, you will be working on the Data in Transit domains supporting customers running ETL workloads or analyzing large amounts of data using AWS services. You will work on various services like Glue (ETL service), Athena (interactive query service), Managed Workflows of Apache Airflow, etc.Key responsibilities include...


  • Cape Town, Western Cape, South Africa Intellinexus Full time

    Role DescriptionAs a Data Engineer at Intellinexus, you will be responsible for designing, building, and maintaining the data infrastructure that supports our organisation's data needs. This involves working closely with various teams to gather requirements, design, and develop data pipelines, and ensure data quality and availability for analysis and...


  • Cape Town, Western Cape, South Africa Morae Global Corporation Full time

    Job OverviewAbout Morae Global CorporationWe are a leading corporation specializing in innovative data solutions. Our team is dedicated to delivering cutting-edge technology that drives business growth.We are currently seeking an experienced Azure DevOps Engineer to join our team. This role involves leading the design and implementation of our data...


  • Cape Town, Western Cape, South Africa MSP Staffing LTD Full time

    Role SummaryWe are looking for a skilled Data Engineer to join our team in Cape Town.This is a dynamic and challenging role that requires a strong background in SQL, Python, and cloud platforms such as Azure/AWS/GCP.The successful candidate will be responsible for designing, developing, and maintaining data pipelines, ensuring seamless integration with APIs...


  • Cape Town, Western Cape, South Africa Morae Global Corporation Full time

    Job DetailsAbout the JobWe are seeking an experienced Azure DevOps Engineer to join our team. The successful candidate will lead the design and implementation of our data infrastructure, with a focus on solution design, automating data pipelines from diverse sources, and Azure environment setup and optimization.This is an exciting opportunity for a hands-on...


  • Cape Town, Western Cape, South Africa Amazon Full time

    As a Senior ETL Developer and Cloud Support Engineer at Amazon, you will be responsible for designing and implementing ETL pipelines that extract and ingest data into data lakes and warehouses. You will also support customers who are running ETL workloads or analyzing large amounts of data using AWS services.You will have the opportunity to work with various...


  • Cape Town, Western Cape, South Africa DVT Full time

    DVT is a leading software development, technology consulting, and services company with a presence in several countries. We employ highly skilled professionals in various fields, including software development, business intelligence, business analysis, agile consulting, solution architecture, and project management.We are currently seeking an experienced...