AWS Data Engineer

1 week ago


Cape Town, Western Cape, South Africa PBT Group Full time

The Data Engineer will be responsible for designing, implementing, and optimising data pipelines and data solutions using AWS and Snowflake. The successful candidate will work closely with Data Analysts, Data Scientists, and other stakeholders to ensure efficient data storage, processing, and accessibility in a cloud environment.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using AWS services (e.g., S3, Glue, Lambda, Redshift) and Snowflake.
  • Implement best practices for data storage, transformation, and optimisation in a cloud environment.
  • Develop data models to support business intelligence and analytics needs.
  • Ensure data integrity, consistency, and reliability through data validation and quality assurance processes.
  • Optimise data performance and cost efficiency in Snowflake and AWS.
  • Collaborate with cross-functional teams to define data architecture and infrastructure requirements.
  • Automate data workflows and monitor performance for continuous improvements.
  • Troubleshoot and resolve data-related issues.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • 5+ years of experience in Data Engineering.
  • Strong proficiency in AWS cloud services, particularly S3, Glue, Lambda, Redshift, and IAM.
  • Hands-on experience with Snowflake, including data warehousing concepts, performance tuning, and optimisation.
  • Expertise in SQL for data modelling, transformation, and querying.
  • Experience with ETL/ELT processes and tools.
  • Understanding of data governance, security, and compliance in a cloud environment.
  • Proficiency in Python or another scripting language for automation.
    • Preferred Skills & Experience:
      • Experience with data orchestration tools like Apache Airflow.
      • Knowledge of DevOps practices and CI/CD pipelines for data workflows.
      • Familiarity with Big Data technologies such as Spark or Kafka.
      • Exposure to machine learning workflows and MLOps.
      • Experience in financial, banking, or insurance sectors.

Key Competencies:

  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Ability to work independently and collaboratively within a team.
  • Detail-oriented with a strong focus on data quality and integrity.
  • Ability to adapt to a fast-paced and evolving technology landscape.

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.


  • AWS Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Minimum Experience: 5 years of experience in Python/C# development 3 years of experience in AWS Data Engineering Education Requirements: Bachelors degree in Computer Science, Information Systems, or a related field Advantageous: AWS Certified Machine Learning Specialty Certificate Responsibilities: Design and create data models that can extract information...


  • Cape Town, Western Cape, South Africa Ampstek Full time

    AWS Data Engineer Position at Ampstek:About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesImplement data security, governance and compliance best...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    We are looking for an experienced AWS Data Solutions Expert to join our team at PBT Group. As an AWS Data Solutions Expert, you will be responsible for designing, building, and maintaining cloud-based data infrastructure to ensure scalability, security, and high performance.About the Role:You will work closely with the development team and business...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview:We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    1 week ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineer

    15 hours ago


    Cape Town, Western Cape, South Africa proFound Faith Consulting Full time

    Job title : Data Engineer (Streaming)Job Location : Western Cape, Cape TownDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries What You'll DoDesign, develop, and maintain real-time streaming pipelines using tools like Apache Kafka, Apache Flink, and AWS Kinesis. Build scalable architectures for event-driven systems and ensure...


  • Cape Town, Western Cape, South Africa Ampstek Full time

    Ampstek is seeking a highly skilled AWS Data Engineer to design, develop and maintain scalable data solutions on AWS Cloud.Job DescriptionWe are looking for an experienced professional who can work with data pipelines, ETL processes and data lake/warehouse solutions using AWS services.Design and build data pipelines using AWS Glue, AWS Lambda and AWS Step...

  • Cloud Data Engineer

    6 days ago


    Cape Town, Western Cape, South Africa Ampstek Full time

    Ampstek is seeking a highly skilled Data Engineer to join our team in Cape Town.About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesDesign and build data...


  • Cape Town, Western Cape, South Africa Ananzi Full time

    AWS Trust and Safety (T&S) Risk & Response (R&R) is seeking a motivated Security Engineer with a strong background in incident response, threat investigation, and developing solutions to security issues.As a Security Engineer in R&R, you will employ your technical skills to develop solutions to complex and ambiguous security-related events originating from...


  • Cape Town, Western Cape, South Africa Amazon Full time

    Software Development Engineer, AWS AlamedaAWS Alameda is shaping the future of how Control Planes for AWS Services will be offered. The Alameda team builds innovative and secure technologies on a massive scale that manage the control planes for AWS services and keep them secure and scalable for their customers. As a software development engineer on this...

  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...


  • Cape Town, Western Cape, South Africa BADRI Management Consultancy Full time

    Woolworths Financial Services | Full timePRINCIPAL LEAD: DATA ENGINEERINGCape Town, South Africa | Posted on 02/14/2025Woolworths Financial Services, or WFS as it is better known, is a Joint Venture with Absa Bank, that supports the Woolworths retail business by providing in-store credit in the form of the Woolworths StoreCard and offering value-added...


  • Cape Town, Western Cape, South Africa Theodo Full time

    Theodo is a company that helps businesses create innovative digital solutions. Our core stack is AWS Serverless & TypeScript, but you'll gain exposure to different technologies and ways of working.Job Description:As an AWS Serverless Engineer Lead, you will be hands-on coding while also engaging in client-facing discussions, bridging technical and business...


  • Cape Town, Western Cape, South Africa Penta Consulting Full time

    Penta Consulting provides professional and managed solutions across EMEA, focusing on technology-driven business growth.We are recruiting an AWS Data Model Design Lead to join one of our clients on a 6-month contract, based in Cape Town. The ideal candidate has experience in the banking sector and a strong background in AWS.Data Modelling TasksThe successful...


  • Cape Town, Western Cape, South Africa BigTalent Full time

    BigTalent City of Cape Town, Western Cape, South AfricaPrincipal Lead: Data EngineerOur financial services client is looking for a Principal Lead Data Engineer to drive the Technical Vision, Strategy and Execution of their data engineering capability.The role will lead the design and implementation of scalable, high-performance data pipelines, data...