AWS Cloud Data Engineer

3 weeks ago


Johannesburg, Gauteng, South Africa E-Merge Full time

E-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and simplified solutions.

Job Summary

We are currently looking for an AWS Cloud Data Engineer to join our fast-paced and dynamic team As a key member of our data engineering team, you will be responsible for designing, building, and operationalizing large-scale enterprise data solutions and applications.

Key Responsibilities

  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, and Kafka.
  • Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies, and Kafka.
  • Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka.
  • Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.

Requirements and Qualifications

  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields.
  • 5-8 years of experience.
  • Experience in any of the following AWS services: Athena, Glue, PySpark, DynamoDB, Redshift, Lambda, Step Functions, and Kafka.
  • Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka, and Delta.io.
  • Knowledge of software engineering best practices across the development lifecycle.
  • Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

What We Offer

E-Merge offers a competitive salary of R900k to R1.1mil cost to company per annum, as well as a dynamic and fast-paced work environment.



  • Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesLeadership and CollaborationLead cross-functional teams to develop and implement...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesDesign and implement data processing pipelines using AWS services such as S3, Lambda,...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging AWS services and...

  • AWS Data Engineer

    5 days ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    Job Title: Intermediate/Senior AWS Data EngineerThe role involves working with advanced AWS technologies to design, build, and maintain scalable data pipelines and architectures. The ideal candidate will have strong expertise in SQL, Python/PySpark, and key AWS services including Glue, Step Functions, EMR (EC2), S3, Lambda, and Athena. The position is...

  • AWS Cloud Engineer

    16 hours ago


    Johannesburg, Gauteng, South Africa Edge Executives Full time

    AWS DevOps Engineer OpportunityWe are seeking an experienced AWS DevOps Engineer to join our team at Edge Executives. This is a unique opportunity to work with one of our international clients and contribute to the development of their cloud infrastructure.Key Responsibilities:Design and implement scalable and secure cloud infrastructure using AWS services...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    About the RolePBT Group is seeking an experienced AWS Cloud Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesCoordinate and prioritize the work of developers and product owners to ensure timely delivery...

  • AWS Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to lead the design and implementation of large-scale enterprise data solutions and applications. As a key member of our team, you will be responsible for analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...

  • AWS Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to lead the design and implementation of large-scale enterprise data solutions and applications. As a key member of our team, you will be responsible for analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    Job Title: AWS Data Engineer with DataBricksPBT Group is seeking an experienced AWS Data Engineer with expertise in DataBricks to join our team.About the RoleWe are looking for a highly skilled Data Engineer to design, build, and operationalize large-scale enterprise data solutions and applications using AWS data and analytics services in combination with...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    About the RolePBT Group is seeking an experienced AWS Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data solutions that meet the needs of our business.Key ResponsibilitiesData Engineering: Design and implement data pipelines, data warehouses, and data lakes using AWS...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.ResponsibilitiesData Ingestion and Management: Design and implement efficient...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africa's leading direct distributors of financial service products.Job SummaryWe are seeking an experienced AWS Data Engineer to join our team. The successful candidate will be responsible for designing and implementing optimal data...

  • Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa Salt Employee Benefits Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Salt Employee Benefits. As a Data Engineer, you will play a critical role in building and maintaining our data infrastructure, ensuring that our business leaders have access to accurate and timely data insights.Key ResponsibilitiesData EngineeringCollaborate with business...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Planet10, a leading company in the Financial and Banking sector. As a Data Engineer, you will play a critical role in advancing our technical thought leadership, delivering fit-for-purpose data products, and supporting data initiatives.Key ResponsibilitiesDesign, develop, and...


  • Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleWe are seeking a highly skilled AWS Solutions Architect to join our team at NTT DATA. As an AWS Solutions Architect, you will be responsible for designing, implementing, and optimizing AWS solutions to meet our clients' business objectives.Key ResponsibilitiesCollaborate with clients to design effective, scalable, and secure AWS solutions.Stay...

  • AWS Cloud Architect

    1 week ago


    Johannesburg, Gauteng, South Africa Golden Rule Full time

    The OpportunityWe are seeking a highly skilled Lead AWS Python Developer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable, secure, and efficient cloud-based solutions using AWS services.Key ResponsibilitiesDesign and develop cloud-based applications using AWS services such as Lambda,...

  • Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa Planet10 Full time

    About the RoleWe are seeking a highly skilled Junior Data Engineer to join our team at Planet10, a leading company in the Financial sector. As a Junior Data Engineer, you will play a key role in leveraging your data expertise and data-related technologies to advance technical thought leadership for the Enterprise, deliver fit-for-purpose data products, and...

  • Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa JCM Consultants Full time

    At JCM Consultants, we're seeking a skilled Data Engineer to join our dynamic team. Our ideal candidate will have hands-on experience in building ETL pipelines on Big Data, using modern cloud Data Engineering tools.The RoleAs a Data Engineer, you will be responsible for developing scripts to process structured and unstructured data, recommending ways to...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    About the RolePBT Group is seeking an experienced AWS Data Engineer with DataBricks expertise to join our team.Key ResponsibilitiesDesign and Develop Large-Scale Data Solutions: Utilize AWS data and analytics services, such as Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, and Snowflake, to create scalable and efficient data platforms.Analyze and...