AWS Data Engineer

4 weeks ago

Midrand, South Africa Liyema Consulting Full time
Essential Skills Requirements:
- Terraform
- Python 3.x
- SQL (Oracle/PostgreSQL)
- PySpark
- Boto3
- ETL
- Docker
- Linux / Unix
- Big Data
- PowerShell / Bash
Advantageous Skills Requirements:
- Expertise in data modelling with Oracle SQL
- Analytical skills for large and complex data sets
- Thorough testing and data validation
- Strong written and verbal communication
- Ability to work independently and multi-task
- Experience with Enterprise Collaboration tools (Confluence, JIRA, etc.)
- Knowledge of Cloud Data Hub (CDH) and CDEC Blueprint
- Development of technical documentation and artifacts
- Knowledge of data formats (Parquet, AVRO, JSON, XML, CSV, etc.)
- Experience with Data Quality Tools (Great Expectations)
- Development and working with REST APIs
- Building data pipelines using AWS Glue, Data Pipeline, or similar platforms
- Familiarity with data stores (AWS S3, AWS RDS, DynamoDB)
- Understanding of software design patterns
- Preparing specifications for program development
- Strong organizational skills
AWS Components (Basic Experience/Understanding in order of importance):
- Glue
- CloudWatch
- SNS
- Athena
- S3
- Kinesis Streams (Kinesis, Kinesis Firehose)
- Lambda
- DynamoDB
- Step Function
- Param Store
- Secrets Manager
- Code Build/Pipeline
- CloudFormation
- Business Intelligence (BI) experience
- Technical data modelling and schema design
- Kafka
- AWS EMR
- Redshift
- Basic networking and troubleshooting
Qualifications/Experience:
- Relevant IT / Business / Engineering Degree
- Preferred certifications:
- AWS Certified Cloud Practitioner
- AWS Certified SysOps Associate
- AWS Certified Developer Associate
- AWS Certified Architect Associate
- AWS Certified Architect Professional
- Hashicorp Certified Terraform Associate
Core Role Tasks and Responsibilities:
- Build and maintain Big Data Pipelines using Data Platforms.
- Ensure data sharing aligns with information classification requirements on a need-to-know basis.

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL PySpark Boto3 ETL Docker Linux / Unix Big Data PowerShell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc. Experience developing technical documentation...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL Py Spark Boto ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): Glue CloudWatch SNS Athena S Kinesis Streams...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa iSanqa Full time

    Our client requires the services of a Technology Integrator (Chief Expert) Midrand/Menlyn/Rosslyn/Home Office RotationAmazing brand with cutting edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026 EXPERIENCE: 12+ Years related working...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    Essential Skills Requirements: Terraform Python 3.x SQL (Oracle/PostgreSQL) PySpark Boto ETL Docker Linux / Unix Big Data PowerShell / Bash Advantageous Skills Requirements: Expertise in data modelling with Oracle SQL Analytical skills for large and complex data sets Thorough testing and data validation Strong written and verbal communication Ability to work...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    3 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance):- Glue- CloudWatch- SNS- Athena-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): - Glue- CloudWatch- SNS-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance):- Glue- CloudWatch- SNS- Athena-...

  • AWS Data Engineer EXP 0675

    2 months ago

    Midrand, South Africa Open Source (Pty) Ltd Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data Hub (CDH) BMW CDEC Blueprint · Experience in working with Enterprise Collaboration tools such...

  • AWS Data Engineer EXP 0675

    4 weeks ago

    Midrand, South Africa Open Source (Pty) Ltd Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashBMW Cloud Data Hub (CDH)BMW CDEC Blueprint · Experience in working with Enterprise Collaboration tools such as Confluence,...