AWS Data Engineer

2 weeks ago


Johannesburg, Gauteng, South Africa E-Merge Full time
AWS Data Engineer

E-Merge is seeking a highly skilled AWS Data Engineer to join their team. As a pioneer in harnessing the power of Artificial Intelligence (AI), we aim to deliver actionable insights and drive transformative change for businesses worldwide.

Key Responsibilities:
  • Design, build, and operationalize large-scale enterprise data solutions and applications.
  • Analyze, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka.
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka.
  • Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies, and Kafka.
  • Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka.
Qualifications and Experience:
  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields.
  • 5-8 years of experience.
  • Experience in any of the following AWS services: Athena, Glue, PySpark, DynamoDB, Redshift, Lambda, Step Functions, and Kafka.
  • Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka, and Delta.io.
  • Knowledge of software engineering best practices across the development lifecycle.
  • Experience with big data tools: Delta.io, PySpark, Kafka, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

E-Merge offers a competitive salary of R900k to R1.1mil cost to company per annum for this Contract, Hybrid position based in Braamfontein, Johannesburg.


  • AWS Data Engineer

    7 days ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group Job OpportunityWe are seeking a highly skilled AWS Data Engineer to join our team at PBT Group. As a key member of our agile team, you will play a pivotal role in constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security.Key Responsibilities:Architecting Data Analytics FrameworksDesigning and...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Job Title: AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team at E-Merge. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.Responsibilities:Design and implement data models that meet business...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and simplified...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    Job Title: AWS Data Engineer with DataBricksPBT Group is seeking an experienced AWS Data Engineer with expertise in DataBricks to join our team.About the RoleWe are looking for a highly skilled Data Engineer to design, build, and operationalize large-scale enterprise data solutions and applications using AWS data and analytics services in combination with...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    Job Title: AWS Data Cloud EngineerWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key Responsibilities:Design and implement data processing pipelines using AWS services...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesDesign and implement data processing pipelines using AWS services such as S3, Lambda,...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesLeadership and CollaborationLead cross-functional teams to develop and implement...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.ResponsibilitiesData Ingestion and Management: Design and implement efficient...

  • AWS Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    Job Title: Intermediate/Senior AWS Data EngineerThe role involves working with advanced AWS technologies to design, build, and maintain scalable data pipelines and architectures. The ideal candidate will have strong expertise in SQL, Python/PySpark, and key AWS services including Glue, Step Functions, EMR (EC2), S3, Lambda, and Athena. The position is...

  • AWS Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    Job Title: Intermediate/Senior AWS Data EngineerThe role involves working with advanced AWS technologies to design, build, and maintain scalable data pipelines and architectures. The ideal candidate will have strong expertise in SQL, Python/PySpark, and key AWS services including Glue, Step Functions, EMR (EC2), S3, Lambda, and Athena. The position is...

  • AWS Data Engineer

    4 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to lead the design and implementation of large-scale enterprise data solutions and applications. As a key member of our team, you will be responsible for analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...

  • AWS Data Engineer

    4 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to lead the design and implementation of large-scale enterprise data solutions and applications. As a key member of our team, you will be responsible for analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group Job OpportunityWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at PBT Group.Job SummaryThe successful candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems on the AWS cloud platform. This includes coordinating with cross-functional teams, ensuring data security and...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group Seeks AWS Data Engineer with DataBricks ExpertisePBT Group is seeking an experienced AWS Data Engineer with DataBricks expertise to join our team. As a key member of our data engineering team, you will design, build, and operationalize large-scale enterprise data solutions and applications using AWS data and analytics services in combination with...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    About the RolePBT Group is seeking an experienced AWS Cloud Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesCoordinate and prioritize the work of developers and product owners to ensure timely delivery...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africa's leading direct distributors of financial service products.Job SummaryWe are seeking an experienced AWS Data Engineer to join our team. The successful candidate will be responsible for designing and implementing optimal data...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    About the RolePBT Group is seeking an experienced AWS Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data solutions that meet the needs of our business.Key ResponsibilitiesData Engineering: Design and implement data pipelines, data warehouses, and data lakes using AWS...

  • Cloud Data Architect

    3 weeks ago


    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging AWS services and...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that enhance our clients' businesses.Key ResponsibilitiesDesign and develop mission-critical information extraction, analysis, and management...