Data Engineer for Cloud Solutions

3 weeks ago


Cape Town, Western Cape, South Africa PBT Group Full time

PBT Group is a leading IT company in the financial services sector, seeking an experienced Data Engineer to join our team and contribute to the development of scalable, secure, and efficient cloud-based data platforms on AWS.

As a Data Engineer, you will be responsible for designing, developing, and maintaining our cloud infrastructure, ensuring high-performance, security, scalability, and reliability. This role presents an excellent opportunity for individuals passionate about data engineering and cloud technologies to advance their careers in a forward-thinking environment.

Key Responsibilities:

  • Data Pipeline Development:
    • Design and implement data pipelines to support the ingestion, transformation, and storage of large datasets from diverse sources, ensuring data cleanliness, reliability, and readiness for analysis.
    • Collaborate with data engineers, analysts, and stakeholders to integrate new data sources effectively.
  • Automation & Optimization:
    • Develop and maintain automation scripts (e.g., Python) to streamline data workflows and platform management tasks.
    • Monitor data platform performance, troubleshoot issues, and implement improvements for efficiency and cost optimisation.
  • Cloud Infrastructure & Platform Management:
    • Design and implement scalable, high-performance infrastructure solutions, utilising containerisation and automation tools.
    • Use infrastructure as code (Terraform) to provision and manage AWS resources, ensuring high performance, security, scalability, and reliability.
    • Resolve problems across multiple domains using troubleshooting and problem-solving techniques.
  • Continuous Integration/Continuous Deployment (CI/CD):
    • Drive CI/CD implementation and improvements by incorporating best practices and automation tools.
    • Conduct code reviews and contribute to team knowledge sharing for consistency and high-quality output.
  • Documentation & Knowledge Sharing:
    • Maintain comprehensive documentation of data processes, platform configurations, and best practices.
    • Stay current with the latest AWS services, data engineering tools, and industry trends, integrating new knowledge to enhance the data platforms.

The ideal candidate should have a strong understanding of AWS services, proficiency in programming languages such as Python or Java, and experience with infrastructure as code tools like Terraform. A Bachelor's degree in Computer Science, Informatics, Data Science, Mathematics, Statistics, or Engineering is also required. We offer a competitive salary of £60,000 - £80,000 per annum, depending on experience, as well as opportunities for professional growth and development.


  • Data Engineering Lead

    16 hours ago


    Cape Town, Western Cape, South Africa Recru-it Full time

    As a Data Engineering Lead - Cloud Solutions at Recru-it, you will play a key role in shaping the future of our data platform. With a focus on cloud technologies, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines that drive business success.We are looking for an experienced Data Engineer with a strong...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is an industry-leading IT company specialising in financial services, looking for a talented Cloud Data Engineer to provide scalable, secure, and efficient data-driven solutions on AWS.This role presents an excellent opportunity for individuals passionate about data engineering and cloud technologies to advance their careers in a forward-thinking...


  • Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    We are seeking a skilled Cloud Data Engineer to join our team at Goldman Tech Resourcing.About the CompanyGoldman Tech Resourcing is a well-established company looking for talented individuals to contribute to our success.Salary and BenefitsThe estimated salary for this position is R 1,200,000 - R 1,500,000 per annum, depending on experience.Job...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is a leading IT company specialising in financial services, focusing on AWS.We are seeking an experienced Cloud Data Engineer to join our team and contribute to designing, developing, and maintaining scalable, secure, and efficient data-driven solutions on AWS.About the Role:Data Pipeline Development:Design and implement data pipelines for large...


  • Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job SummaryWe are seeking an experienced Enterprise Data Solutions Manager to lead our data engineering team at Datonomy Solutions. As a key member of our leadership team, you will be responsible for driving the development of our data strategy and implementing data solutions that drive business growth and decision-making.Main ResponsibilitiesDevelop and...


  • Cape Town, Western Cape, South Africa CodeConnect Staffing (Pty) Ltd Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our client's team and contribute to their innovative journey in shaping the future of technology in Africa.About the RoleIn this role, you will be instrumental in designing and implementing robust data pipelines and infrastructure that power high-performance applications and analytics. Your...

  • Data Engineer Lead

    3 weeks ago


    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Lead to join our team at Datonomy Solutions. As a key member of our business intelligence team, you will be responsible for designing and implementing data solutions that drive business growth and decision-making.ResponsibilitiesDesign and Implement Data Solutions: Develop and deploy data...


  • Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job DescriptionWe are seeking a highly skilled Lead Cloud Data Engineer to join our innovative team at Progressive IT Resourcing. As a key member of our engineering organization, you will play a critical role in empowering and accelerating autonomous value creation through insights and ML across the group.The successful candidate will have experience as a...


  • Cape Town, Western Cape, South Africa Hire Resolve Full time

    Company OverviewHire Resolve is a leading recruitment agency specializing in placing top talent in the technology sector. Our mission is to connect innovative companies with exceptional professionals who drive growth and success.Job DescriptionWe are seeking an experienced Cloud Engineer to join our client's team, working primarily within the Google Cloud...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is seeking a skilled Cloud Data Platform Specialist to join our team and help us develop innovative cloud-based solutions for the financial services sector. As a Cloud Data Platform Specialist, you will be responsible for designing, building, and maintaining secure, scalable, and efficient cloud data platforms on AWS.Key Responsibilities:Cloud Data...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    The Network Recruitment team is seeking an experienced Data Solutions Engineer to join our global organization. With a strong presence in various industries, we are known for our customer-centric approach and expertise in leveraging technology to address complex business challenges.Job SummaryWe are looking for a highly skilled Data Solutions Engineer to...

  • Lead Data Engineer

    1 month ago


    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer - Cloud Expert to join our progressive team at Progressive IT Resourcing.This is a fantastic opportunity for an experienced data engineer looking to take on a leadership role in designing, building, and maintaining large-scale cloud-based data systems.


  • Cape Town, Western Cape, South Africa PartnerUp (Pty) Ltd Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at PartnerUp (Pty) Ltd. As a key member of our data engineering team, you will play a vital role in designing and developing new applications and systems that meet the business requirements of our product line environment.Key Responsibilities:Analyse business or system requirements...

  • Cloud Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa E-Merge Full time

    E-Merge, a Fintech department, is seeking an experienced Cloud Data Engineer to join its team. This role involves designing and developing robust data frameworks and creating data services that deliver actionable insights.The ideal candidate will have strong understanding of DevOps principles and experience with relevant tools such as Azure DevOps for CI/CD,...


  • Cape Town, Western Cape, South Africa Network Recruitment Full time

    Job DescriptionAt Network Recruitment, we are seeking a skilled Data Engineer to join our team. As a key member of our data infrastructure group, you will be responsible for designing, building, and maintaining scalable data pipelines that support data integration, processing, and analytics.The ideal candidate will have strong experience with SQL, Python, or...


  • Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    **Job Title:** Data Engineering ManagerWe are seeking a highly skilled and experienced Data Engineering Manager to join our team at Progressive IT Resourcing. As a key member of our organization, you will be responsible for leading the development and implementation of data engineering solutions that drive business value.The ideal candidate will have a...


  • Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    We are seeking a highly skilled Database Developer to join our team at Goldman Tech Resourcing.As a key member of our organization, you will play a crucial role in designing and implementing cloud-based data solutions that drive business growth and success.Key Responsibilities:Design, develop, and maintain scalable and efficient database systems on the...


  • Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    We are seeking a highly skilled Database Developer to join our team at Goldman Tech Resourcing. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale cloud-based data solutions.About UsWe are a well-established company committed to providing innovative data solutions to our clients. Our...


  • Cape Town, Western Cape, South Africa iLaunch Full time

    Job OverviewiLaunch, a leading Financial Services Client, seeks an experienced Cloud Engineer to join their dynamic team on a permanent basis.Estimated SalaryRanging from $120,000 - $180,000 per annum, depending on qualifications and experience.Key ResponsibilitiesCollaborate with DevOps teams to migrate existing applications to the Cloud and develop new...

  • Cloud Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PartnerUp (Pty) Ltd Full time

    Job Description:The successful candidate will be responsible for designing and developing new applications and systems to meet the business requirements of the data platform environment. This includes analyzing business or system requirements, building and enhancing data platforms, and participating in solution design documentation.Required Skills and...