2063 AWS Data Engineer

2 weeks ago

Centurion, Gauteng, South Africa Jordan HR Full time

Product / Feature Team Information (if applicable)
Our Domain, Enterprise Data Services, Platforms, comprises of a number of Data Business Objects, namely, Quality, Motorbike, Purchasing & Supplier, Marketing & Research, Finance, Sales, Customer, Customer Support, ITO and OTD
ESSENTIAL SKILLS REQUIREMENTS:
Above average experience/understanding (in order of importance):
e.g. Technical Skills / Technology
  • Terraform
  • Python 3x
  • SQL - Oracle/PostgreSQL
  • Py Spark
  • Boto3
  • ETL
  • Docker
  • Linux / Unix
  • Big Data
  • Powershell / Bash
Basic experience/understanding of AWS Components (in order of importance):
  • Glue
  • CloudWatch
  • SNS
  • Athena
  • S3
  • Kinesis Streams (Kinesis, Kinesis Firehose)
  • Lambda
  • DynamoDB
  • Step Function
  • Param Store
  • Secrets Manager
  • Code Build/Pipeline
  • CloudFormation
  • Business Intelligence (BI) Experience
  • Technical data modelling and schema design ("not drag and drop")
  • Kafka
· AWS EMR
· Redshift

· Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.
· Experience developing technical documentation and artefacts.
· Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc.
· Experience working with Data Quality Tools such as Great Expectations.
· Experience developing and working with REST API's is a bonus.

· Basic experience in Networking and troubleshooting network issues.
· Any additional responsibilities assigned in the Agile Working Model (AWM) Charter
ADVANTAGEOUS SKILLS REQUIREMENTS:
· Demonstrate expertise in data modelling Oracle SQL.
· Exceptional analytical skills analysing large and complex data sets.
· Perform thorough testing and data validation to ensure the accuracy of data transformations.
· Strong written and verbal communication skills, with precise documentation.
· Self-driven team player with ability to work independently and multi-task.
· Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
· Familiar with data store such as AWS S3, and AWS RDS or DynamoDB.
· Experience and solid understanding of various software design patterns.
· Experience preparing specifications from which programs will be written, designed, coded, tested and debugged.
· Strong organizational skills.
WHICH QUALIFICATIONS/EXPERIENCE DO WE NEED FOR THE ROLE?
· Relevant IT / Business / Engineering Degree
Certifications:
· Candidates with one or more of the certifications are preferred.
· AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate
WHAT WILL BE YOUR ROLE AND RESPONSIBILITIES?
e.g. Core Role tasks and responsibilities
Data Engineers are responsible for building and maintaining Big Data Pipelines using Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.
Data Engineers are also expected to:
Stay up to date with the latest data engineering tools, technologies and industry trends. Identify opportunities for process improvements and automation to enhance the efficiency and reliability of data pipelines. Explore and evaluate new data engineering approaches and technologies to drive innovation within the organisation.

Mentor, train and upskill members in the team.

WHAT DO WE OFFER YOU?
· Cutting edge global IT system landscape and processes
· Flexible working of 1960 hours in a 12-month period
· High Work-Life balance
· Remote / On-site work location flexibility
· Affordable Group vehicle promotions (buying or leasing options available, terms and conditions apply)
· Highly motivating, energetic, and fast-paced working environment
· Modern, state-of-the-art offices
· Dynamic Global Team collaboration
· Application of the Agile Working Model Methodology

  • AWS Software Engineer

    7 days ago

    Centurion, Gauteng, South Africa Datafin IT Recruitment Full time

    Job DescriptionDatafin IT Recruitment seeks a highly skilled and experienced Backend Developer to join our team. The ideal candidate will have a strong background in cloud-based development, preferably with AWS.The role involves working on serverless functions using AWS Lambda, NodeJS, and other relevant services such as DynamoDB, AppSync, EventBridge,...

  • Senior Backend Engineer

    7 days ago

    Centurion, Gauteng, South Africa Datafin IT Recruitment Full time

    Role OverviewWe are looking for a highly skilled AWS Backend Developer to design, develop, and maintain scalable, secure, and efficient cloud-based systems using Amazon Web Services (AWS).Key ResponsibilitiesDesign, develop, and deploy serverless functions using AWS Lambda, NodeJS, and other AWS Services.Collaborate with cross-functional teams to identify...

  • Cloud Engineer Manager

    7 days ago

    Centurion, Gauteng, South Africa Moyoafrica Full time

    Innovative Solutions for BusinessesCloud Engineer ManagerMoyoAfrica provides expert digital consulting and technology services to drive business transformation. As a Cloud Engineer Manager, you will lead the development of cutting-edge data analytics and operational platforms on cloud-based infrastructure. Our customizable solutions optimize interactive...

  • Data Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience in...

  • Data Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience...

  • Data Engineering Manager

    7 days ago

    Centurion, Gauteng, South Africa Tracker South Africa Full time

    Job DescriptionWe are seeking an experienced Data Engineering Manager to lead our data engineering team in delivering high-quality, scalable, and secure data solutions. The successful candidate will have a strong technical background in data engineering, excellent leadership skills, and experience in managing cross-functional teams.About the RoleLead the...

  • Data Analysist

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Data Science Lead Build, Innovate, and Lead Are you a data-driven problem solver with a passion for business intelligence, analytics, and machine learning? This is your chance to take ownership of a growing data science function, build models from scratch, define data strategies, and lead a team in a cutting-edge environment. What Youll Do: Develop and...

  • Data Analysist

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Data Science Lead Build, Innovate, and Lead Are you a data-driven problem solver with a passion for business intelligence, analytics, and machine learning? This is your chance to take ownership of a growing data science function, build models from scratch, define data strategies, and lead a team in a cutting-edge environment.What Youll Do:Develop and...

  • Head of Big Data Engineering

    6 days ago

    Centurion, Gauteng, South Africa Tracker South Africa Full time

    Job Title: Head of Big Data EngineeringWe are seeking an experienced Head of Big Data Engineering to lead our big data engineering team in delivering high-quality, scalable, and secure data solutions. The successful candidate will have a strong technical background in big data engineering, excellent leadership skills, and experience in managing...

  • Data Engineer Consultant

    6 days ago

    Centurion, Gauteng, South Africa Mediro ICT Recruitment Full time

    Job DescriptionAt Mediro ICT Recruitment, we are seeking a highly skilled Data Engineer to join our team. As a technology-focused individual, you will design, configure, develop, and deploy data transformations using Azure Databricks and Python.Key ResponsibilitiesDevelop ETL pipelines to transform and process large datasets.Combine and curate data in a...

  • Data Science Lead

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    What Youll Do: Develop and implement business intelligence models to drive smarter decisions. Use Python & machine learning to analyze large datasets, extract insights, and optimize performance. Design and maintain scalable data infrastructure for real-time analytics. Collaborate with engineering, product, and operations teams to integrate data into key...

  • Data Science Lead

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    What Youll Do: Develop and implement business intelligence models to drive smarter decisions.Use Python & machine learning to analyze large datasets, extract insights, and optimize performance.Design and maintain scalable data infrastructure for real-time analytics.Collaborate with engineering, product, and operations teams to integrate data into key...

  • Enterprise Data Engineer

    7 days ago

    Centurion, Gauteng, South Africa Mediro ICT Recruitment Full time

    About This RoleWe are looking for an exceptional Data Engineer to join our team at Mediro ICT Recruitment. The successful candidate will possess:A Bachelor's degree in Computer Science, Software Engineering, or a related field.Hands-on experience with cloud-based solutions, preferably on Microsoft Azure.Proficiency in programming languages such as Python and...

  • Big Data Engineering Professional

    6 days ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Our Ideal CandidateWe are looking for a highly skilled Data Engineer who possesses a strong academic background and extensive experience in data engineering or ETL development. The ideal candidate will have a proven track record of delivering high-quality solutions, working collaboratively with cross-functional teams, and staying up-to-date with emerging...

  • SQL Data Engineer

    7 days ago

    Centurion, Gauteng, South Africa Sabenza IT Recruitment Full time

    Job OverviewSabenza IT Recruitment is seeking a proficient SQL Data Engineer to join their client's team in Gauteng.This role involves developing, maintaining, and supporting a portfolio of data products and services to ensure improved business efficiencies aligned to the enterprise architecture and business strategy.Candidates with advanced SQL skills,...

  • Data Engineer Team Lead

    11 hours ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Team Lead to join our team at Network Recruitment. The ideal candidate will have a strong background in data engineering and experience leading cross-functional teams.In this role, you will be responsible for:Leading and growing the data engineering team, providing guidance and support to team...

  • Data Science Lead

    1 week ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Are you a data-driven innovator ready to build and lead a world-class analytics function? Were looking for a Data Science Lead to drive business intelligence, machine learning, and strategic decision-making. If you thrive in a fast-paced fintech environment, this is your chance to make a real impact What Youll Do:Develop & implement business intelligence...

  • Data Science Lead

    6 days ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Are you a data-driven innovator ready to build and lead a world-class analytics function? Were looking for a Data Science Lead to drive business intelligence, machine learning, and strategic decision-making. If you thrive in a fast-paced fintech environment, this is your chance to make a real impact What Youll Do: Develop & implement business intelligence...

  • Senior Systems Engineer

    1 week ago

    Centurion, Gauteng, South Africa Profession Hub Full time

    Our client is searching for a Senior Systems Engineer to join their team in CenturionJob Description: We are looking for a Senior Systems Engineer with a passion for IT. This candidate must be highly proficient in Microsoft servers, Azure, and Microsoft Office 365 platforms. The ideal candidate will have extensive experience in networking and security, as...

  • Data Quality Engineer

    7 days ago

    Centurion, Gauteng, South Africa A 1L Realization (Pty) Ltd Full time

    Requirements:- Must skill: Experience: 3+ years in a data quality, data engineering, or related role, preferably in the healthcare industry.- Technical Skills: Proficiency in SQL, Python, or other scripting languages. - Experience with data quality tools such as Apache Griffin, Talend, Informatica is a plus.- Domain Knowledge: Familiarity with healthcare...