2063 AWS Data Engineer

5 days ago

Centurion, Gauteng, South Africa Jordan HR Full time

Product / Feature Team Information (if applicable)
Our Domain, Enterprise Data Services, Platforms, comprises of a number of Data Business Objects, namely, Quality, Motorbike, Purchasing & Supplier, Marketing & Research, Finance, Sales, Customer, Customer Support, ITO and OTD
ESSENTIAL SKILLS REQUIREMENTS:
Above average experience/understanding (in order of importance):
e.g. Technical Skills / Technology
  • Terraform
  • Python 3x
  • SQL - Oracle/PostgreSQL
  • Py Spark
  • Boto3
  • ETL
  • Docker
  • Linux / Unix
  • Big Data
  • Powershell / Bash
Basic experience/understanding of AWS Components (in order of importance):
  • Glue
  • CloudWatch
  • SNS
  • Athena
  • S3
  • Kinesis Streams (Kinesis, Kinesis Firehose)
  • Lambda
  • DynamoDB
  • Step Function
  • Param Store
  • Secrets Manager
  • Code Build/Pipeline
  • CloudFormation
  • Business Intelligence (BI) Experience
  • Technical data modelling and schema design ("not drag and drop")
  • Kafka
· AWS EMR
· Redshift

· Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.
· Experience developing technical documentation and artefacts.
· Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc.
· Experience working with Data Quality Tools such as Great Expectations.
· Experience developing and working with REST API's is a bonus.

· Basic experience in Networking and troubleshooting network issues.
· Any additional responsibilities assigned in the Agile Working Model (AWM) Charter
ADVANTAGEOUS SKILLS REQUIREMENTS:
· Demonstrate expertise in data modelling Oracle SQL.
· Exceptional analytical skills analysing large and complex data sets.
· Perform thorough testing and data validation to ensure the accuracy of data transformations.
· Strong written and verbal communication skills, with precise documentation.
· Self-driven team player with ability to work independently and multi-task.
· Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
· Familiar with data store such as AWS S3, and AWS RDS or DynamoDB.
· Experience and solid understanding of various software design patterns.
· Experience preparing specifications from which programs will be written, designed, coded, tested and debugged.
· Strong organizational skills.
WHICH QUALIFICATIONS/EXPERIENCE DO WE NEED FOR THE ROLE?
· Relevant IT / Business / Engineering Degree
Certifications:
· Candidates with one or more of the certifications are preferred.
· AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate
WHAT WILL BE YOUR ROLE AND RESPONSIBILITIES?
e.g. Core Role tasks and responsibilities
Data Engineers are responsible for building and maintaining Big Data Pipelines using Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.
Data Engineers are also expected to:
Stay up to date with the latest data engineering tools, technologies and industry trends. Identify opportunities for process improvements and automation to enhance the efficiency and reliability of data pipelines. Explore and evaluate new data engineering approaches and technologies to drive innovation within the organisation.

Mentor, train and upskill members in the team.

WHAT DO WE OFFER YOU?
· Cutting edge global IT system landscape and processes
· Flexible working of 1960 hours in a 12-month period
· High Work-Life balance
· Remote / On-site work location flexibility
· Affordable Group vehicle promotions (buying or leasing options available, terms and conditions apply)
· Highly motivating, energetic, and fast-paced working environment
· Modern, state-of-the-art offices
· Dynamic Global Team collaboration
· Application of the Agile Working Model Methodology

  • Electronic Engineer Centurion

    2 days ago

    Centurion, Gauteng, South Africa Network Engineering Full time

    Duties & ResponsibilitiesJob & Company Description:My client is a dynamic and innovative company committed to conservation efforts through cutting-edge technology. Their survey system is a pioneering platform designed to process and analyse aerial survey data. It utilizes state-of-the-art deep learning classifiers to identify animals in aerial images,...

  • Data Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience in...

  • Data Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience...

  • Data Engineer

    2 days ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements:Completed Bachelors Degree in computer science, Informatics or relatedAt least 3 years of relevant experienceProven experience in...

  • Data Insights Specialist

    2 days ago

    Centurion, Gauteng, South Africa BetterHome Group LTD Full time

    About the RoleBetterHome Group LTD is looking for a skilled Data Insights Specialist to join our team. As a key contributor, you will be responsible for developing and maintaining reporting solutions that deliver actionable insights to the business.Key Responsibilities:Work closely with business stakeholders to meet data requirements and ensure reporting...

  • Data Engineer Professional

    3 days ago

    Centurion, Gauteng, South Africa Optim-G Sourcing Full time

    At Optim-G Sourcing, we're looking for a highly skilled Data Engineer to join our team. As a key member of our data engineering department, you'll be responsible for designing, developing, and maintaining large-scale data systems that support business growth.The ideal candidate will have a strong background in computer science or a related field, with at...

  • Data Analysist

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Data Science Lead Build, Innovate, and Lead Are you a data-driven problem solver with a passion for business intelligence, analytics, and machine learning? This is your chance to take ownership of a growing data science function, build models from scratch, define data strategies, and lead a team in a cutting-edge environment. What Youll Do: Develop and...

  • Electronics Hardware Engineer Lead

    2 days ago

    Centurion, Gauteng, South Africa Network Engineering Full time

    About Our CompanyWe are a dynamic and innovative network engineering firm dedicated to applying technology to address environmental challenges. Our pioneering platform processes and analyses aerial survey data using deep learning classifiers.Job DescriptionAs a Data Analytics Platform Specialist, you will be responsible for expanding the scope of our...

  • Data Analysist

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Data Science Lead Build, Innovate, and Lead Are you a data-driven problem solver with a passion for business intelligence, analytics, and machine learning? This is your chance to take ownership of a growing data science function, build models from scratch, define data strategies, and lead a team in a cutting-edge environment.What Youll Do:Develop and...

  • Data-Driven Decision Maker

    2 days ago

    Centurion, Gauteng, South Africa BetterHome Group LTD Full time

    About the PositionBetterHome Group LTD is looking for a skilled Data-Driven Decision Maker to join our team. As a key contributor, you will be responsible for developing and maintaining reporting solutions that deliver actionable insights to the business.Key Responsibilities:Work closely with business stakeholders to meet data requirements and ensure...

  • Data Science Lead

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    What Youll Do: Develop and implement business intelligence models to drive smarter decisions. Use Python & machine learning to analyze large datasets, extract insights, and optimize performance. Design and maintain scalable data infrastructure for real-time analytics. Collaborate with engineering, product, and operations teams to integrate data into key...

  • Data Science Lead

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    What Youll Do: Develop and implement business intelligence models to drive smarter decisions.Use Python & machine learning to analyze large datasets, extract insights, and optimize performance.Design and maintain scalable data infrastructure for real-time analytics.Collaborate with engineering, product, and operations teams to integrate data into key...

  • Data Engineer Team Lead

    4 days ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Team Lead to join our team at Network Recruitment. The ideal candidate will have a strong background in data engineering and experience leading cross-functional teams.In this role, you will be responsible for:Leading and growing the data engineering team, providing guidance and support to team...

  • Data Science Lead

    2 weeks ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Are you a data-driven innovator ready to build and lead a world-class analytics function? Were looking for a Data Science Lead to drive business intelligence, machine learning, and strategic decision-making. If you thrive in a fast-paced fintech environment, this is your chance to make a real impact What Youll Do:Develop & implement business intelligence...

  • Data Science Lead

    1 week ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    Are you a data-driven innovator ready to build and lead a world-class analytics function? Were looking for a Data Science Lead to drive business intelligence, machine learning, and strategic decision-making. If you thrive in a fast-paced fintech environment, this is your chance to make a real impact What Youll Do: Develop & implement business intelligence...

  • Senior Systems Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Profession Hub Full time

    Our client is searching for a Senior Systems Engineer to join their team in CenturionJob Description: We are looking for a Senior Systems Engineer with a passion for IT. This candidate must be highly proficient in Microsoft servers, Azure, and Microsoft Office 365 platforms. The ideal candidate will have extensive experience in networking and security, as...

  • Data Quality Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa A 1L Realization (Pty) Ltd Full time

    Requirements:- Must skill: Experience: 3+ years in a data quality, data engineering, or related role, preferably in the healthcare industry.- Technical Skills: Proficiency in SQL, Python, or other scripting languages. - Experience with data quality tools such as Apache Griffin, Talend, Informatica is a plus.- Domain Knowledge: Familiarity with healthcare...

  • Data Science Lead

    3 days ago

    Centurion, Gauteng, South Africa Network Recruitment Full time

    What Youll Do:Develop and implement business intelligence models to drive smarter decisions.Use Python & machine learning to analyze large datasets, extract insights, and optimize performance.Design and maintain scalable data infrastructure for real-time analytics.Collaborate with engineering, product, and operations teams to integrate data into key business...

  • Senior Data and Vehicle Support Engineer

    3 weeks ago

    Centurion, Gauteng, South Africa E&D Recruiters Full time

    Senior Data and Vehicle Support Engineer (Telematics)  Centurion  Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. Proficient in interpreting vehicle log data to support data analysis relevant...

  • Senior Data and Vehicle Support Engineer

    3 weeks ago

    Centurion, Gauteng, South Africa E&D Recruiters Full time

    Senior Data and Vehicle Support Engineer (Telematics)  Centurion  Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. Proficient in interpreting vehicle log data to support data analysis relevant...