AWS Data Engineer

1 month ago


Cape Town, Western Cape, South Africa PBT Group Full time
PBT Group Data Engineer Opportunity

We are seeking a highly skilled Data Engineer to join our agile team at PBT Group. As a Data Engineer, you will play a pivotal role in constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security.

Key Responsibilities:
  • Design and implement data analytics frameworks.
  • Translate complex functional and technical requirements into detailed architecture and high-performance software.
  • Lead the development of data and batch/real-time analytical solutions using transformative technologies.
  • Oversee user story analysis, design, software development, testing, and automation tool creation.
Requirements:
  • Minimum 5 years of experience in Data Engineering or Software Engineering.
  • Demonstrated leadership experience, managing teams of engineers for 3-5 years.
  • Minimum 2 years of experience in Big Data.
  • At least 5 years of experience with Extract, Transform, and Load (ETL) processes.
  • Minimum 2 years of experience with AWS (Amazon Web Services).
  • Demonstrated experience with agile or other rapid application development methodologies for at least 2 years.
  • 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
  • Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
  • Support experience for data feeds in production on a break-fix basis (2 years).
  • Minimum 4 years of experience in creating data marts using Talend or similar ETL development tools.
  • Proficiency in data manipulation using Python and PySpark (2 years).
  • Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS's distribution of Hadoop (2 years).
  • DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
  • Extensive knowledge of various programming or scripting languages.
  • Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases.
Additional Technical Skills:
  • Ability to design highly scalable distributed systems using various open-source tools.
  • Proficiency in both batch and streaming Big Data tools.
  • Experience with Talend for at least 1 year.
  • Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
  • Proficiency in Python for at least 1 year.
  • Familiarity with PySpark or Spark (desirable for at least 1 year).
  • Experience in Business Intelligence data modeling for 3 years.
  • Proficiency in SQL for 3 years.
Desirable:
  • 5+ years of experience in Retail Operations.
Qualifications/Certifications:
  • Bachelor's degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
  • AWS Certification, at least at the associate level.

  • AWS Cloud Engineer

    1 month ago


    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at Dimension Data. As a key member of our cloud engineering team, you will be responsible for designing, implementing, and managing cloud-based infrastructure and applications.Key Responsibilities:Design and implement cloud-based infrastructure and applications...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking a highly skilled Data Center Engineering Operations Technician to join our team at Amazon Data Services South Africa (Pty) Ltd. As a key member of our Infrastructure Operations team, you will be responsible for ensuring the smooth operation of our data centers, including electrical and mechanical equipment maintenance and...

  • AWS Data Architect

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    About the RolePBT Group is seeking a highly skilled AWS Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data pipelines and systems on Amazon Web Services (AWS).Key ResponsibilitiesData EngineeringDesign and develop scalable data architectures using AWS services such as S3,...

  • AWS Systems Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: AWS Systems Engineer - Cloud InfrastructureAbout the Role:As an AWS Systems Engineer - Cloud Infrastructure, you will be responsible for designing, deploying, and managing scalable and secure cloud infrastructure on AWS. You will work closely with cross-functional teams to ensure the smooth operation of our cloud infrastructure and services.Key...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionWe are seeking an experienced AWS Architect to join our team at Dimension Data. As an AWS Architect, you will be responsible for designing and architecting the services that will power our cloud-based applications.Key responsibilities include:Providing guidance and leading architecture for the entire AWS cloud environmentLeading the team in...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    As an AWS Architect at Dimension Data, you will be responsible for designing and architecting cloud based applications. The ideal candidate will have experience in cloud computing, including Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as a Service (SaaS), and/or Infrastructure as a Network Service (IANS).You will lead the...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the Role:We are seeking a Data Center Engineering Operations Technician to join our expanding Infrastructure Operations team. This role is a hands-on electrical and mechanical equipment troubleshooting and operation responder.As a Data Center Engineering Operations Technician, you will be responsible for:Safety:Following and maintaining the highest...


  • Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    Company OverviewAmazon Data Services South Africa (Pty) Ltd is a leading provider of cloud computing services. We empower businesses to innovate and grow by providing a robust suite of products and services.Job SummaryWe are seeking an experienced Data Center Electrical Engineer Expert to join our team. As a key member of our AWS Infrastructure Services, you...

  • AWS DevOps Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa DataTech Recruitment Full time

    Job Title: AWS DevOps EngineerJob Summary:We are seeking a skilled DevOps/SysOps Engineer to build and manage the infrastructure, automate deployment processes, and maintain the production systems. The ideal candidate will have 5+ years of experience in DevOps or a related role and proficiency with AWS services (EC2, S3, RDS, Lambda, CloudFormation,...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking a highly skilled Senior Cloud Infrastructure Engineer to join our team at Dimension Data. As a key member of our engineering team, you will be responsible for designing, deploying, and managing scalable cloud infrastructure on AWS.Key ResponsibilitiesDesign and implement efficient and reliable automated scripts to automate...


  • Cape Town, Western Cape, South Africa Black Swan Data Full time

    Job Summary:We are seeking an experienced DevOps Engineer with a strong background in Kubernetes, AWS, and Linux to join our team. As a Cloud Infrastructure Specialist, you will play a critical role in designing, implementing, and maintaining our cloud infrastructure, with a focus on Kubernetes-based container orchestration, AWS services, and Linux...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is seeking a highly skilled Data Streaming Engineer to join our team. As a senior engineer on the Data Streaming Platform team, you will be responsible for designing, developing, and maintaining real-time data pipelines that drive business growth. You will collaborate with various teams to understand data needs and turn them into scalable platforms...

  • Senior Cloud Engineer

    12 hours ago


    Cape Town, Western Cape, South Africa The Legends Agency Full time

    Role OverviewThe Legends Agency is seeking a highly skilled Senior Cloud Engineer with expertise in designing and implementing cloud-based solutions on the Amazon Web Services (AWS) platform. This role will play a pivotal part in shaping our cloud infrastructure, ensuring scalability, security, and high performance.About The RoleThis exciting opportunity...

  • Senior Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Job Title: Senior Data Engineer - Data ArchitectJob Summary:We are seeking a highly skilled Senior Data Engineer - Data Architect to join our team at Network Recruitment. As a Senior Data Engineer - Data Architect, you will be responsible for designing and implementing efficient data systems, ensuring data quality, and maintaining data infrastructure...


  • Cape Town, Western Cape, South Africa Black Swan Data Full time

    Job Summary:We are seeking a highly skilled DevOps Engineer to join our team at Black Swan Data. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure, with a focus on Kubernetes-based container orchestration, AWS services, and Linux systems.Key Responsibilities:Design and...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group Seeking Intermediate DevOps Data EngineerPBT Group is looking for an intermediate DevOps Data Engineer to join our team.Job DescriptionWe require an experienced data engineer to design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties -...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group's Data Streaming Engineer OpportunityPBT Group is seeking a seasoned Data Streaming Engineer to build, enhance, and maintain real-time data pipelines that drive business growth. As a key member of the Data Streaming Platform team, you will collaborate with various infrastructure and operations teams to ensure seamless data infrastructure...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    Senior DataOps EngineerWe are seeking a highly skilled Senior DataOps Engineer to lead the development of DataOps practices within our organisation. As a seasoned DevOps professional with a strong background in software and data, you will be responsible for setting the direction for DataOps within the team, building scalable data pipelines, and ensuring...

  • Senior Data Engineer

    1 month ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities:Process Optimization: Identify and implement process improvements, automating tasks, and enhancing data system efficiency.Feature Development: Develop new features and optimize existing ones across the data ecosystem to improve scalability and performance.Data Assembly: Assemble complex data sets to support functional and analytical...


  • Cape Town, Western Cape, South Africa NTT DATA Full time

    Job DescriptionAbout the RoleThis is a high-level technical leadership position that involves providing strategic direction and technical guidance to our platform engineering team. The ideal candidate will have a strong background in cloud infrastructure, containerization, and automation, as well as excellent leadership and collaboration skills.Key...