AWS Data Engineers Required

4 weeks ago

Midrand, South Africa Adzuna ZA B C2 Full time
Job Title: AWS Data Engineers Required - Project Based - Contractual-to start asap-JHB - HybridLocation: Gauteng, Johannesburg Metro, MidrandJob Type: Contract, expected to work Full-Time hoursPrimary Industry: Banking and FinanceSecondary Industry: Banking and FinanceJob Duties:

1. Design, develop, and implement AWS cloud solutions for data engineering projects.

2. Utilise AWS services such as S3 Buckets, Lambda, and API Gateway to build scalable and efficient data pipelines.

3. Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and ensure project delivery within deadlines.

4. Monitor and optimise AWS infrastructure for performance and cost efficiency.

5. Document processes, procedures, and best practises for knowledge sharing and future reference.

Required Qualifications:
  • Proven experience as an AWS Data Engineer or similar role
  • Strong understanding of AWS cloud technologies and services
  • Proficiency in working with S3 Buckets, Lambda functions, and API Gateway
  • Knowledge / Experience with AWS cloud and AWS services such as S3 Buckets, Lambda, API Gateway, SQS queues.
  • Knowledge / Experience with batch job scheduling and identifying data/job dependencies.
  • Knowledge / Experience with data engineering using AWS platform.
  • Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway4
  • Knowledge / Experience with data modeling, warehousing and building ETL pipelines.
  • Knowledge / Experience with SQL & SQL end-user Tools
  • Knowledge / Experience with one or more scripting language (e.g., Python)
  • Knowledge / Experience with configuring AWS Identity & Access Management (IAM), and integration with Microsoft Azure Active Directory (AD).
Education:

- Bachelor's degree in Computer Science, Engineering, or related field

Experience:

- Minimum of 3 years of experience in AWS cloud computing and data engineering

Knowledge and Skills:
  • In-depth knowledge of AWS cloud architecture and best practises
  • Strong programming skills in languages such as Python, Java, or Scala
  • Familiarity with data processing frameworks like Apache Spark or Hadoop
  • Excellent communication and interpersonal abilities
  • Ability to multitask and prioritise workload effectively
Preferred Qualifications:
  • AWS Certification (e.g., AWS Certified Solutions Architect, AWS Certified Developer)
  • Experience with data warehousing solutions such as Amazon Redshift
  • Knowledge of DevOps practises and tools
Working Conditions:
  • This is a project-based contractual role based in Johannesburg with a hybrid work setup
  • Full-time hours are expected, with flexibility to meet project milestones and deadlines

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL PySpark Boto3 ETL Docker Linux / Unix Big Data PowerShell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc. Experience developing technical documentation...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL Py Spark Boto ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): Glue CloudWatch SNS Athena S Kinesis Streams...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa iSanqa Full time

    Our client requires the services of a Technology Integrator (Chief Expert) Midrand/Menlyn/Rosslyn/Home Office RotationAmazing brand with cutting edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026 EXPERIENCE: 12+ Years related working...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    Essential Skills Requirements: Terraform Python 3.x SQL (Oracle/PostgreSQL) PySpark Boto ETL Docker Linux / Unix Big Data PowerShell / Bash Advantageous Skills Requirements: Expertise in data modelling with Oracle SQL Analytical skills for large and complex data sets Thorough testing and data validation Strong written and verbal communication Ability to work...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    2 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    Essential Skills Requirements: - Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements: - Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance):- Glue- CloudWatch- SNS- Athena-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): - Glue- CloudWatch- SNS-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance):- Glue- CloudWatch- SNS- Athena-...

  • AWS Data Engineer EXP 0675

    3 months ago

    Midrand, South Africa Open Source (Pty) Ltd Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashBMW Cloud Data Hub (CDH)BMW CDEC Blueprint · Experience in working with Enterprise Collaboration tools such as Confluence,...