Mastering Cloud Data Engineering

1 month ago


Johannesburg, Gauteng, South Africa E-Merge Full time

Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide are looking for a seasoned AWS Data Engineer to join their fast-paced team at E-Merge.

Job Summary

We seek a highly skilled professional with expertise in designing, building, and operationalising large-scale enterprise data solutions on AWS cloud. The ideal candidate will have experience in analysing, re-architecting, and re-platforming on-premise data warehouses to data platforms using AWS or 3rd party services and Kafka CC.

Main Responsibilities:
  • Data Solution Design and Development: Design, build, and operationalise large-scale enterprise data solutions and applications using Java, PySpark, Scala, Kafka CC, and AWS native or custom programming.
  • Data Pipeline Development: Design and build production data pipelines from ingestion to consumption within a big data architecture.
  • Platform Migration: Analyse, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
  • Data Engineering and Ingestion: Design and implement data engineering, ingestion, and curation functions on AWS cloud.
  • Assessment and Transition: Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Infrastructure Support: Design, implement, and support analytical data infrastructure providing ad-hoc access to large datasets and computing power.
  • Data Integration: Interface with other technology teams to extract, transform, and load data from a wide variety of data sources.
  • Real-Time Data Pipelines: Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka CC.
Requirements:
  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields.
  • 5-8 years of experience in data engineering and AWS cloud services.
  • Experience with big data tools such as Delta.io, PySpark, Kafka, etc.
  • Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, and Delta.io.
  • Knowledge of software engineering best practices across the development lifecycle.
Salary and Benefits:

The successful candidate can expect a salary of R900k to R1.1mil cost-to-company per annum, based in Braamfontein, Johannesburg. This is a Contract, Hybrid position.



  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...


  • Johannesburg, Gauteng, South Africa ALOS Innovative Workforce Solution (Pty) Ltd Full time

    Cloud and Data Engineer Job DescriptionAward-winning ALOS Innovative Workforce Solution (Pty) Ltd is seeking a highly skilled IT Professional to join our team as a Cloud and Data Engineer. The successful candidate will be responsible for designing, implementing, and maintaining cloud-based systems and data engineering solutions.Job SummaryWe are looking for...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineer - Cloud Platform Specialist Job DescriptionWe are seeking a highly skilled Data Engineer - Cloud Platform Specialist to join our team at E-Merge. As a key member of our development team, you will be responsible for building and enhancing our cloud-based platform, focusing on data systems and pipelines.The ideal candidate will have experience...

  • Cloud Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a solutions company that leverages data and analytics to drive innovation. As a Data Engineer, you will play a key role in building and enhancing our cloud-based platform.


  • Johannesburg, Gauteng, South Africa Network Recruitment Full time

    About Network RecruitmentWe are a reputable recruitment agency in the Financial Services sector, specializing in matching top talent with exciting career opportunities.Job OverviewWe are seeking an experienced Cloud Data Solutions Engineer to join our dynamic team. As a key member of our engineering department, you will play a pivotal role in designing,...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is seeking an exceptional AWS Cloud Data Engineer to join our team. About the Role:Lead the design and implementation of scalable and secure cloud-based data architectures using AWS services.Collaborate with cross-functional teams to ensure data quality, integrity, and compliance with company standards.Develop and maintain ETL processes, data...

  • Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    Job Title: Junior Cloud Data ArchitectE-Merge is seeking a talented Junior Cloud Data Architect to join our team. As a key member of our cloud-based platform development team, you will play a crucial role in building and enhancing our revolutionary compliance service platform.The ideal candidate will have a strong background in data engineering, cloud...

  • Data Systems Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job Description:A reputable company in the Financial Services sector seeks a skilled Data Engineer to work with cloud data systems. To succeed, you should have proficiency in the Microsoft BI Stack, T-SQL development, and cloud services.About Network RecruitmentWe are a leading recruitment agency specializing in IT and finance jobs. Our team of experts helps...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleWe are looking for a talented Senior Data Solutions Engineer to join our team in Johannesburg. As a key member of our data engineering department, you will be responsible for designing and implementing state-of-the-art cloud, hybrid, and on-prem solutions. Our ideal candidate will have a deep understanding of best practice business intelligence...

  • Cloud Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    Establish Your Career with E-MergeE-Merge is a solutions company that starts with data, leveraging analytics and math to drive real-world impact. As a Junior Data Engineer, you'll play a crucial role in building and enhancing our cloud-based compliance service platform.Key Responsibilities:Present data insights on dashboards and visualizations using Power...


  • Johannesburg, Gauteng, South Africa Exusia Full time

    About the RoleWe are seeking an experienced Cloud Data Engineer to join our team in South Africa. The successful candidate will have a strong background in Microsoft and Data Engineering technologies, with a proven track record of delivering best-of-breed technology solutions based on Azure Cloud.Job DescriptionDesign and implement scalable data pipelines to...


  • Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job Title: Cloud Data Engineer Position in Financial ServicesAbout Network Recruitment: We are a reputable company in the Financial Services sector, committed to delivering cutting-edge data solutions. Our dynamic team is seeking an experienced Data Engineer to join us on our journey.Role Overview: As a Data Engineer at Network Recruitment, you will play a...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Cloud-Based Data Engineer Job Opportunity at E-MergeWe are looking for an experienced Cloud-Based Data Engineer to join our team. The successful candidate will work closely with our development team to build and enhance our cloud-based platform, focusing on data systems and pipelines.The successful candidate will have experience working with cloud-based...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    About Data CentrixData Centrix is a leading organization in the field of cloud computing, striving to provide cutting-edge solutions for businesses worldwide.Salary and BenefitsThe successful candidate will receive an attractive salary ranging from $140,000 to $200,000 per annum, commensurate with experience, plus a comprehensive benefits package including...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineer Job DescriptionE-Merge, a leading financial services group, seeks an experienced AWS data engineer to join their team in Johannesburg. The ideal candidate will be responsible for designing and implementing optimal data models, working with large data sources, and creating robust data solutions.Key Responsibilities:Designing and Implementing...

  • Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge, an innovative financial services provider, seeks a highly skilled Azure Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines using Azure Data Factory, Azure Data Explorer, and Azure Databricks.Key responsibilities include:Designing...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is seeking a talented Cloud Data Solutions Architect to join our team. As a Senior Cloud Engineer, you will be responsible for designing and implementing scalable data engineering solutions using Azure Cloud.In this role, you will work closely with our team to analyze and organize raw data, design robust data engineering solutions, and build scalable...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job DescriptionWe are seeking an experienced Cloud Infrastructure Specialist to join our team at Data Centrix. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining highly available cloud platforms aligned with company standards.About the RoleThis is a challenging role that requires strong technical...

  • Cloud Data Engineer

    6 days ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge, an autonomous Namibian bank, is seeking a skilled Azure Data Engineer to join their team. This unique position offers a deep insight into compliance and IT Methodology processes within the group.Key Responsibilities:Design and maintain Big Data Pipelines using Data PlatformsEnsure data sharing aligns with information classification requirements on a...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    **Job Title:** Data Science and Engineering ManagerWe are Planet10, a leading organization seeking an experienced Data Science and Engineering Manager to join our team.**Salary:** $150,000 - $180,000 per annumJob Description:We are looking for a highly skilled Data Science and Engineering Manager who will lead our data science and engineering team and drive...