AWS Cloud Data Engineer

8 months ago


Johannesburg, South Africa PBT Group Full time

PBT Group has an opportunity for an AWS Cloud Data Engineer.

 

Duties:

  • Coordinate/Prioritise the work that the Developers and Product Owner
  • Assist with cross-team projects that involve development.
  • AWS practices are followed with sound security and governance.
  • Coordinate with the cloud Center of Excellence team for any AWS account level security and access.
  • Resolve any security findings on your responsible AWS accounts given by group security.
  • Manage the CI/CD pipeline as per architecture approved.
  • Ensure good gates are in place for review for deployment and ensure good practices and patterns are followed in this regard.
  • Code quality will be monitored through peer code reviews.
  • The Quality Assurance Team will conduct exploratory testing to identify defects.
  • Must meet and pass the criteria as specified in the Definition of done as documented on the Feature Team's instance.
  • Strong conceptual understanding of the context and business requirements. Should be able to understand the business needs, High Level design and produce Low level design documents, implement code in accordance with the best practice.
  • Ability to perform data quality checks in a methodical manner to understand how to accurately utilize client data.
  • Expert level programming skills using AWS to meet the challenges of advanced data manipulation, complicated programming logic, and large data volumes is required.
  • Ability to communicate results and methodology with the project team and clients.
  • Ability to meet deadlines and thrive in an insurance environment.
  • Provides solutions for data driven applications involving large and complex data and providing reconciliation and test cases.
  • Understand customer's Business processes and pain areas which need attention.
  • Source system understanding and analysis.
  • Solution Architecture for the entire flow from source to end reporting data marts.
  • Design Conceptual and physical data model for a global Data warehouse in AWS (ETL versus ELT)
  • High Level & Low-Level design for ETL Components in AWS
  • Test prototypes and oversee handover to operational teams.
  • Propose best practices/standards.
  • Build monitoring and testing mechanisms on data transformations.
  • Continuous improvements on AWS in terms of scalability, reliability, and monitoring.
  • Analyse and enhance the architecture of the current implementation.
  • Manage personal delivery on projects and enhancements.
  • Ensure personal service level agreement standards are met.
  • Implement initiatives to improve application performance.
  • Ensure quality of programming code.
  • Translate business requirements into system requirements.
  • Design and document robust, scalable solutions according to set standards.
  • Ensure accuracy of code and adherence to requirements.
  • Ensure all production changes are managed within the release cycle.
  • Participate in the development of key standards.
  • Seek new ways to optimize or innovate as it relates to the use of technology.
  • Ensure personal adherence to agreed governance procedures.
  • Proactively identify and manage risks.
  • Responsible for the design and implementation of effective cross functional business intelligence systems and processes.
  • Analytical with an even mix of business acumen and technical capability.
  • Responsible for working with analysts, managers, and executives to understand business needs and working with source owners to understand the data sources.
  • An innate curiosity and some analytical capability with a passion for learning.
  • Translate business and technical requirements into efficient sustainable solutions.
  • Be able to do gap and impact analysis on the requirement.
  • Accept coaching and mentoring from senior developers/architects.
  • Do QA on designs and development and completed projects as required.
  • Complete documentation of requirements and development according to defined standards.
  • Deliver necessary documentations where require

 

Skills and Experience Required:

  • High knowledge in AWS – security groups, permissions, VPC, roles, services.
  • Experience developing engineering applications in corporate companies.
  • Demonstrated project development and leadership skills.
  • Current understanding of best practices regarding system security measures
  • Advanced education and application of business analysis techniques and strategy
  • Experience with software engineering, customer experience and civil engineering preferred.
  • Experience working together with teams from several departments to facilitate the orderly execution of a proposed project plan.
  • Professional experience and a high-level understanding of working with various operating systems and their implications.
  • Professional work experience in team building and project organization.

 

 

Qualifications/ Certification:

  • A degree in Computer Science / Information Systems / Business Administration / Commerce or equivalent
  • Master's degree in Computer Science or Software Engineering is preferred

 

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By applying for the vacancy via this job ad, you give PBT your consent.

 

 

 


  • Cloud Data Engineer

    7 months ago


    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...

  • AWS Cloud Engineers

    5 days ago


    Johannesburg,, South Africa Jobted ZA C2 Full time

    Join our talent database! Paracon is building a talent database of skilled AWS Cloud Engineers to support our clients’ continuous growth needs. Our clients want Cloud Engineers – AWS to build, manage, and secure cloud infrastructure solutions. You will collaborate with cross-functional teams to ensure seamless delivery of AWS services. Key...

  • AWS Data Engineer

    2 months ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide.We are currently looking for a skilled AWS Data Engineer to join our fast-paced and dynamic team.ResponsibilitiesDevelop and Operationalize Large-Scale Data...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineer Job DescriptionE-Merge, a leading financial services group, seeks an experienced AWS data engineer to join their team in Johannesburg. The ideal candidate will be responsible for designing and implementing optimal data models, working with large data sources, and creating robust data solutions.Key Responsibilities:Designing and Implementing...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is seeking an exceptional AWS Cloud Data Engineer to join our team. About the Role:Lead the design and implementation of scalable and secure cloud-based data architectures using AWS services.Collaborate with cross-functional teams to ensure data quality, integrity, and compliance with company standards.Develop and maintain ETL processes, data...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a leading African Corporate Investment Bank offering innovative advisory, funding, trading, corporate banking and principal investing solutions. We are passionate Solutionists who deliver real business value across various industries.About the RoleWe have a vacant position for an AWS Data Engineer to work within our team solving complex data...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide are looking for a seasoned AWS Data Engineer to join their fast-paced team at E-Merge.Job SummaryWe seek a highly skilled professional with expertise in designing, building, and operationalising large-scale...

  • AWS Data Engineer

    3 weeks ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineer - Cloud Platform Specialist Job DescriptionWe are seeking a highly skilled Data Engineer - Cloud Platform Specialist to join our team at E-Merge. As a key member of our development team, you will be responsible for building and enhancing our cloud-based platform, focusing on data systems and pipelines.The ideal candidate will have experience...


  • Johannesburg, Gauteng, South Africa IndSAfri Full time

    About the RoleWe are seeking an experienced AWS Cloud Solutions Engineer to join our team at IndSAfri. This is a fantastic opportunity for someone who wants to work on challenging projects and contribute to the growth of our organization.Job DescriptionThe ideal candidate will have a strong background in designing and implementing cloud solutions using AWS...

  • AWS Data Engineer

    2 months ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse...

  • AWS Data Engineer

    2 months ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse...

  • AWS Data Engineer

    2 months ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.   The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse...

  • Senior Cloud Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa MSP Staffing LTD Full time

    Are you a skilled developer looking for a challenging role that combines your passion for cloud computing with your expertise in NodeJS? We are seeking a Senior Cloud Engineer to join our team at MSP Staffing LTD.About the RoleThis is an exceptional opportunity for a seasoned professional to leverage their experience with AWS services, including Lambda,...


  • Johannesburg, South Africa NTT Data Full time

    **Job Requirements **NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we...

  • AWS Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    AWS Data Engineer RoleWe are seeking an experienced AWS Data Engineer to join our team at E-Merge in Johannesburg, South Africa.About the Role:As an AWS Data Engineer, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality. You will also be involved in identifying key performance...

  • Aws Cloud Specialist

    7 months ago


    Johannesburg, South Africa Unique Personnel Full time

    **Job Number** - 71277 **Job Type** - Permanent **Job Title** - AWS Cloud Specialist **Computer Skills** - MS Office **Industry** - Transportation - Logistics **City** - Johannesburg **Province** - Gauteng - Possess a deep understanding of Amazon Web Services and cloud architecture principles. As an AWS Solutions Architect, you will collaborate with...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    Job DescriptionWe are seeking an experienced AWS Data Engineer to join our team at PBT Group. The ideal candidate will have a strong background in designing and implementing scalable data pipelines using Amazon Web Services (AWS).The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability,...

  • AWS Data Scientist

    2 days ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is a leading provider of innovative data solutions. We are currently seeking an experienced AWS Data Engineer to join our team.The role involves designing and developing scalable data pipelines, utilizing cloud-based technologies such as AWS and Databricks. This position requires strong expertise in data engineering, including experience with ETL...