AWS Cloud Data Scientist

1 month ago


Johannesburg, Gauteng, South Africa E-Merge Full time

Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide, E-Merge’s vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and simplified solutions. They are currently looking for an AWS Data Engineer to join their fast-paced and dynamic team.

Responsibilities

  • Design, build, and operationalize large-scale enterprise data solutions and applications
  • Analyze, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka
  • Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming
  • Perform detailed assessments of current-state data platforms and create an appropriate transition path to AWS cloud
  • Design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies, and Kafka
  • Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka
  • Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency

Qualifications and Experience:

  • Bachelor’s Degree in Computer Science, Information Technology, or other relevant fields
  • 5-8 years of experience
  • Has experience in any of the following: AWS Athena and Glue, PySpark, DynamoDB, Redshift, Lambda, Step Functions, and Kafka
  • Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka, and Delta.io
  • Knowledge of software engineering best practices across the development lifecycle
  • Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking an experienced AWS Cloud Data Architect to design and build large-scale enterprise data solutions and applications on the AWS cloud. As a key member of our team, you will be responsible for analysing, re-architecting and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    Job Title: AWS Cloud Data EngineerWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key Responsibilities:Design and implement data pipelines using AWS services such as S3,...

  • Data Scientist

    1 month ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    A leading global group with a focus on innovation and IT solutions is seeking a Data Scientist - Cloud Innovator to drive experiences with a deep insight into compliance and IT Methodology processes.Responsibilities:Cloud ManagementDevelopment and support environment coordinationRequirements translation and simplificationDevOps experienceProject and process...


  • Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group is seeking an exceptional AWS Cloud Data Engineer to join our team. About the Role:Lead the design and implementation of scalable and secure cloud-based data architectures using AWS services.Collaborate with cross-functional teams to ensure data quality, integrity, and compliance with company standards.Develop and maintain ETL processes, data...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a consultancy specialising in AI and applications, with a primary focus on helping enterprise clients to extract business value by implementing AI solutions and maximise a desired return on investment.Job Title: Lead Data Scientist for Cloud PlatformsJob Description:ResponsibilitiesManage cloud infrastructure and coordinate between development and...

  • AWS Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa PBT Group Full time

    About the Role: PBT Group is seeking an experienced AWS Data Engineer with a strong background in cloud data architecture and analytics.Key Responsibilities: The successful candidate will be responsible for designing and implementing scalable data pipelines, developing data analytics solutions, and ensuring the security and integrity of data.Required Skills...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    We are seeking an experienced AWS Cloud Data Engineer to join our team at Planet10. As a Cloud Data Engineer, you will play a key role in designing and implementing scalable and secure data solutions on the Amazon Web Services (AWS) cloud platform.Estimated Salary: $120,000 - $180,000 per yearAbout UsPlanet10 is a leading insurance company that utilizes...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    Job SummaryPlanet10 is seeking a highly skilled AWS Data Cloud Engineer to lead the development of big data solutions in the insurance industry.Design and implement scalable and secure data architectures on AWS.Develop and maintain high-quality engineering applications in corporate environments.Collaborate with cross-functional teams to drive project...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Data Engineer Job DescriptionE-Merge, a leading financial services group, seeks an experienced AWS data engineer to join their team in Johannesburg. The ideal candidate will be responsible for designing and implementing optimal data models, working with large data sources, and creating robust data solutions.Key Responsibilities:Designing and Implementing...

  • Data Scientist

    2 months ago


    Johannesburg, Gauteng, South Africa Snaphunt Full time

    The OpportunityWe are seeking a skilled Data Engineer to join our dynamic team at Snaphunt. As a Data Engineer, you will be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...

  • AWS Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    About E-MergeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide.We are currently looking for a skilled AWS Data Engineer to join our fast-paced and dynamic team.ResponsibilitiesDevelop and Operationalize Large-Scale Data...


  • Johannesburg, Gauteng, South Africa Mayfly Agri (Pty) Ltd Full time

    Mayfly Agri (Pty) Ltd is seeking a highly skilled Data Scientist to join our team. The successful candidate will be responsible for driving the strategy and implementation of Data-as-an-Asset (DaaA) in the RC Supply Mission.About the RoleWe are looking for an experienced Data Engineer/Analyst who can operate in a Dynamic Shared Ownership culture, working...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Senior Cloud Data Engineer RoleE-Merge is passionate about offering innovative solutions to its clients, and we're looking for a talented Senior Cloud Data Engineer to join our team.Key Responsibilities:Design and implement large-scale, critical data solutions using AWS services.Develop and maintain ETL processes to ingest data from various sources into AWS...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a leading African Corporate Investment Bank offering innovative advisory, funding, trading, corporate banking and principal investing solutions. We are passionate Solutionists who deliver real business value across various industries.About the RoleWe have a vacant position for an AWS Data Engineer to work within our team solving complex data...


  • Johannesburg, Gauteng, South Africa IndSAfri Full time

    About the RoleWe are seeking an experienced AWS Cloud Solutions Engineer to join our team at IndSAfri. This is a fantastic opportunity for someone who wants to work on challenging projects and contribute to the growth of our organization.Job DescriptionThe ideal candidate will have a strong background in designing and implementing cloud solutions using AWS...


  • Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job Opportunity: AWS Cloud EngineerWe are seeking an experienced AWS Cloud Engineer to join our team at Network Recruitment. This is a fantastic opportunity for a skilled professional to design, implement, and manage secure, scalable, and reliable cloud infrastructure using AWS services.About the Role:As an AWS Cloud Engineer, you will be responsible for...


  • Johannesburg, Gauteng, South Africa NTT Data Full time

    Job SummaryWe are seeking a highly skilled Cloud System Architect to join our team at NTT Data. As a key member of our cloud engineering team, you will be responsible for designing, developing, and maintaining the Central System, leveraging your expertise in Unibase, Unidata, and the Pick operating system.Key Responsibilities:Technical Support and...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    Unlock Africa's Potential with E-MergeE-Merge, a pioneering technology services provider, is accelerating its growth by expanding its team of experts. We are seeking a highly skilled Senior Data Scientist to spearhead the development and deployment of advanced machine learning models that drive business impact.Key Responsibilities:Develop and implement...


  • Johannesburg, Gauteng, South Africa Planet10 Full time

    At Planet10, we're seeking a skilled Data Science and Cloud Architect to join our team. This role offers a competitive salary of $120,000 per year.Job Description:This position involves the application of data engineering methods, including data architecting, big data, machine learning, deep learning, artificial intelligence, predictive analytics to meet the...