AWS Data Engineer

3 days ago


Johannesburg, South Africa E-Merge Full time

Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently looking for an AWS Data Engineer to join their fast-paced and dynamic team

Responsibilities

  • Design, build and operationalise large scale enterprise data solutions and applications
  • Analyse, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka CC.
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
  • Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena and Kafka CC.
  • Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.

Qualifications and experience:

  • Bachelor''s Degree in Computer Science, Information Technology, or other relevant fields
  • 5 8 years experience
  • Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
  • Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
  • Knowledge of software engineering best practices across the development lifecycle
  • Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

The Reference Number for this position is NG59270 which is a Contract, Hybrid position based in Braamfontein, Johannesburg offering a salary of R900k to R1.1mil cost to company per annum


  • AWS Data Engineer

    3 months ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.   The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse...

  • AWS Data Engineer

    3 months ago


    Johannesburg, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    Job DescriptionWe are seeking an experienced AWS Data Engineer to join our team at PBT Group. The ideal candidate will have a strong background in designing and implementing scalable data pipelines using Amazon Web Services (AWS).The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability,...

  • AWS Data Scientist

    3 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is a leading provider of innovative data solutions. We are currently seeking an experienced AWS Data Engineer to join our team.The role involves designing and developing scalable data pipelines, utilizing cloud-based technologies such as AWS and Databricks. This position requires strong expertise in data engineering, including experience with ETL...


  • Johannesburg, South Africa NTT Data Full time

    **Job Requirements **NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we...


  • Johannesburg, South Africa NTT Data Full time

    **Job Requirements **NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we...

  • AWS Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    AWS Data Engineer RoleWe are seeking an experienced AWS Data Engineer to join our team at E-Merge in Johannesburg, South Africa.About the Role:As an AWS Data Engineer, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality. You will also be involved in identifying key performance...


  • Johannesburg, South Africa Africonology Full time

    AWS Infrastructure Engineer Location: Gauteng, Johannesburg Metro, Johannesburg Job Type: Contract, expected to work Full-Time hours Primary Industry: IT and Internet Salary: ZAR0 - ZAR0 Per hour Job Duties: - Designing, implementing, and maintaining AWS infrastructure solutions. - Managing and supporting AWS services, including EC2, S3, RDS, and...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    We are seeking a highly skilled AWS Data Engineer to join our team at the PBT Group. This role involves designing and implementing scalable data systems, ensuring seamless integration of data from various sources, and empowering business solutions through efficient data management.The ideal candidate will possess a strong grasp of software development and...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineering ExpertiseDesign and implement complex data solutions using AWS services such as Lambda, S3, RDS, and Redshift.Deliver high-quality, scalable, and secure data solutions that meet business requirements.Collaborate with cross-functional teams to drive best practices and improvements in data engineering across the organization.About the RoleThis...

  • AWS Cloud Engineers

    3 weeks ago


    Johannesburg,, South Africa Jobted ZA C2 Full time

    Join our talent database! Paracon is building a talent database of skilled AWS Cloud Engineers to support our clients’ continuous growth needs. Our clients want Cloud Engineers – AWS to build, manage, and secure cloud infrastructure solutions. You will collaborate with cross-functional teams to ensure seamless delivery of AWS services. Key...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a pioneering company harnessing AI to deliver actionable insights and drive transformative change globally. Our vision is to provide next-generation insights to every business worldwide by leveraging data using high-performance, interoperable, and simplified solutions.**Job Overview**We are currently looking for an experienced AWS Data Engineer to...

  • AWS Data Engineer

    3 days ago


    Johannesburg, South Africa E-Merge Full time

    Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team. This role offers an exciting opportunity to tackle complex challenges and make a substantial impact...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    A leading African Corporate Investment Bank, E-Merge, is passionate about offering innovative advisory and financial services solutions to clients across various industries. We have a vacant role for a Senior AWS Data Engineer to work within a team delivering real business value through complex data solutions.Responsibilities:Designing and implementing...


  • Johannesburg, South Africa TotalEnergies Full time

    **Pays** Afrique du Sud **Lieu** South Africa **Lieu de travail** JOHANNESBURG-BIERMANN AV(ZAF) **Société employeur** TotalEnergies Marketing Services **Domaine** Systèmes d'Information **Type de contrat** CDD **Durée du contrat** 12 **Expérience** Minimum 6 ans Ideally, a Senior AWS Administrator would possess the...


  • Johannesburg, Gauteng, South Africa African Ambition Full time

    We are looking for a skilled AWS professional to help drive our business forward. As a cloud engineer with African Ambition, you can expect a salary of R900,000 per year, plus opportunities for career growth and professional development.Your key responsibilities will include developing and implementing technical efforts to design, build, and deploy AWS...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    Job OverviewWe are seeking an experienced AWS Data Engineer to join our team at PBT Group. The ideal candidate will have a strong background in designing and implementing scalable data pipelines using Amazon Web Services (AWS).This Data Engineer will be responsible for establishing the infrastructure required to derive insights from raw data, integrating...

  • Data Engineer

    1 month ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...

  • Data Engineer

    2 months ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    As a Data Engineer, you will: - Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment. - Collaborate with clients to understand their requirements and translate them into scalable data solutions. - Aggregate, store, and manage data from various sources, ensuring...


  • Johannesburg, South Africa E-Merge Full time

    A diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africas leading direct distributors of financial service products. Has an opening for an AWS data engineer you will be responsible for various tasks related to the ingestion, management, serving of data and working with large data sources. ...