AWS Data Engineer

3 weeks ago

Cape Town, Western Cape, South Africa Network Recruitment Full time

Minimum Experience: 5 years of experience in Python/C# development 3 years of experience in AWS Data Engineering Education Requirements: Bachelors degree in Computer Science, Information Systems, or a related field Advantageous: AWS Certified Machine Learning Specialty Certificate Responsibilities: Design and create data models that can extract information from various sources and store it in a usable format Lead the design, implementation, and successful delivery of large-scale, complex data solutions Utilize expertise in SQL, ETL, and data modeling to create robust data pipelines Ingest data into AWS S3 and perform ETL into RDS or Redshift Use AWS Lambda (C# or Python) for event-driven data transformations Design and implement security measures to protect data from unauthorized access or misuse Ensure data integrity by designing backup and recovery procedures Automate the migration process in AWS from development to production Deliver actionable and digestible data content to support business decisions Be involved in the full spectrum of data engineering, from planning and estimation to architecture, pipeline design, delivery, and production implementation Design and implement complex data solutions, from batch to streaming and event-driven architectures across cloud, on-premise, and hybrid technology landscapes Optimize cloud workloads for cost, scalability, availability, governance, and compliance Qualifications and Competencies: Experience with AWS Glue Jobs using PySpark or AWS Glue Spark Real-time ingestion using KAFKA is an added advantage Strong SQL and C# or Python programming skills Object-oriented principles in C# or Python: classes, inheritance Expert knowledge of data engineering packages and libraries in C# or Python AWS technical certifications (Developer Associate or Solutions Architect) Experience with the development and delivery of microservices using serverless AWS services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM) Ability to articulate technical and non-technical requirements to different audiences Experience with RDBMS databases such as Postgres, SQL Server, and MySQL Proficiency in scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl, etc. Strong stakeholder management and communication skills, including problem-solving and relationship-building Ability to troubleshoot data issues efficiently and effectively Extensive experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies Experience in implementing and delivering data solutions and pipelines on the AWS Cloud Platform Strong understanding of data modeling, data structures, databases, and ETL processes In-depth understanding of large-scale data sets, including both structured and unstructured data Experience in delivering CI/CD and DevOps capabilities in a data environment Ability to communicate complex technical ideas clearly Experience in the financial industry is a plus AWS Certified Machine Learning Specialty Certificate is an advantage Apply now For more IT jobs, please visit If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles/positions. For more information contact: Reinie Du Preez Senior Specialist Recruitment Consultant E-mail: rdpreeznetworkrecruitment.co.za

  • Data Pipeline Engineer AWS

    5 days ago

    Cape Town, Western Cape, South Africa Ampstek Full time

    AWS Data Engineer Position at Ampstek:About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesImplement data security, governance and compliance best...

  • AWS Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineer will be responsible for designing, implementing, and optimising data pipelines and data solutions using AWS and Snowflake. The successful candidate will work closely with Data Analysts, Data Scientists, and other stakeholders to ensure efficient data storage, processing, and accessibility in a cloud environment.Key Responsibilities:Design,...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview:We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...

  • Data Engineering

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    7 days ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • AWS Cloud Solutions Architect

    5 days ago

    Cape Town, Western Cape, South Africa Ampstek Full time

    Ampstek is seeking a highly skilled AWS Data Engineer to design, develop and maintain scalable data solutions on AWS Cloud.Job DescriptionWe are looking for an experienced professional who can work with data pipelines, ETL processes and data lake/warehouse solutions using AWS services.Design and build data pipelines using AWS Glue, AWS Lambda and AWS Step...

  • Cloud Data Engineer

    5 days ago

    Cape Town, Western Cape, South Africa Ampstek Full time

    Ampstek is seeking a highly skilled Data Engineer to join our team in Cape Town.About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesDesign and build data...

  • Security Engineer, Aws Trust

    4 days ago

    Cape Town, Western Cape, South Africa Ananzi Full time

    AWS Trust and Safety (T&S) Risk & Response (R&R) is seeking a motivated Security Engineer with a strong background in incident response, threat investigation, and developing solutions to security issues.As a Security Engineer in R&R, you will employ your technical skills to develop solutions to complex and ambiguous security-related events originating from...

  • Software Development Engineer, AWS Alameda

    4 weeks ago

    Cape Town, Western Cape, South Africa Amazon Full time

    Software Development Engineer, AWS AlamedaAWS Alameda is shaping the future of how Control Planes for AWS Services will be offered. The Alameda team builds innovative and secure technologies on a massive scale that manage the control planes for AWS services and keep them secure and scalable for their customers. As a software development engineer on this...

  • Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Principal Lead: Data Engineering

    2 days ago

    Cape Town, Western Cape, South Africa BADRI Management Consultancy Full time

    Woolworths Financial Services | Full timePRINCIPAL LEAD: DATA ENGINEERINGCape Town, South Africa | Posted on 02/14/2025Woolworths Financial Services, or WFS as it is better known, is a Joint Venture with Absa Bank, that supports the Woolworths retail business by providing in-store credit in the form of the Woolworths StoreCard and offering value-added...

  • AWS Data Model Design Lead

    18 hours ago

    Cape Town, Western Cape, South Africa Penta Consulting Full time

    Penta Consulting provides professional and managed solutions across EMEA, focusing on technology-driven business growth.We are recruiting an AWS Data Model Design Lead to join one of our clients on a 6-month contract, based in Cape Town. The ideal candidate has experience in the banking sector and a strong background in AWS.Data Modelling TasksThe successful...

  • Principal Lead: Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa BigTalent Full time

    BigTalent City of Cape Town, Western Cape, South AfricaPrincipal Lead: Data EngineerOur financial services client is looking for a Principal Lead Data Engineer to drive the Technical Vision, Strategy and Execution of their data engineering capability.The role will lead the design and implementation of scalable, high-performance data pipelines, data...

  • Senior Data Engineer Amazon Web Services

    5 days ago

    Cape Town, Western Cape, South Africa Ampstek Full time

    Ampstek is seeking a talented Data Engineer to join our team in Cape Town.About the JobThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.Candidates should be able to design and build data...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    The successful candidate will be responsible for building, optimizing, and maintaining complex data pipelines and databases. They will collaborate with data scientists and analysts to ensure seamless data accessibility and quality while developing ETL processes and scalable storage solutions. The role involves implementing best practices for data security,...

  • Data Streaming Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to...