AWS Data Engineer

4 weeks ago

Midrand, South Africa Liyema Consulting Full time
ESSENTIAL SKILLS REQUIREMENTS:
Above average experience/understanding (in order of importance):
- Terraform
- Python 3x
- SQL - Oracle/PostgreSQL
- Py Spark
- Boto3
- ETL
- Docker
- Linux / Unix
- Big Data
- Powershell / Bash
- Cloud Data Hub (CDH)
- CDEC Blueprint
Basic experience/understanding of AWS Components (in order of importance):
- Glue
- CloudWatch
- SNS
- Athena
- S3
- Kinesis Streams (Kinesis, Kinesis Firehose)
- Lambda
- DynamoDB
- Step Function
- Param Store
- Secrets Manager
- Code Build/Pipeline
- CloudFormation
- Business Intelligence (BI) Experience
- Technical data modelling and schema design ("not drag and drop")
- Kafka
- AWS EMR
- Redshift
Additional experience/understanding:
- Experience in working with Enterprise Collaboration tools such as Confluence, JIRA, etc.
- Experience developing technical documentation and artefacts.
- Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV, etc.
- Experience working with Data Quality Tools such as Great Expectations.
- Experience developing and working with REST APIs is a bonus.
- Basic experience in Networking and troubleshooting network issues.
- Any additional responsibilities assigned in the Agile Working Model (AWM) Charter
ADVANTAGEOUS SKILLS REQUIREMENTS:
- Demonstrate expertise in data modelling Oracle SQL.
- Exceptional analytical skills analyzing large and complex data sets.
- Perform thorough testing and data validation to ensure the accuracy of data transformations.
- Strong written and verbal communication skills, with precise documentation.
- Self-driven team player with the ability to work independently and multi-task.
- Experience building data pipelines using AWS Glue or Data Pipeline, or similar platforms.
- Familiar with data stores such as AWS S3, and AWS RDS or DynamoDB.
- Experience and solid understanding of various software design patterns.
- Experience preparing specifications from which programs will be written, designed, coded, tested, and debugged.
- Strong organizational skills.
WHICH QUALIFICATIONS/EXPERIENCE DO WE NEED FOR THE ROLE?
- Relevant IT / Business / Engineering Degree
Candidates with one or more of the certifications are preferred:
- AWS Certified Cloud Practitioner
- AWS Certified SysOps Associate
- AWS Certified Developer Associate
- AWS Certified Architect Associate
- AWS Certified Architect Professional
- Hashicorp Certified Terraform Associate
WHAT WILL BE YOUR ROLE AND RESPONSIBILITIES?
- Data Engineers are responsible for building and maintaining Big Data Pipelines using Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.
- Demonstrate Team Leadership skills and excellent Stakeholder Engagement.
- Support the Sub Product Owner and Team Leads on over-arching topics.
- Should be able to Mentor junior engineers.
- Demonstrate solution architect expertise.
- Be able to execute any Department-related task as and when required by the Delivery Manager.

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL PySpark Boto3 ETL Docker Linux / Unix Big Data PowerShell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc. Experience developing technical documentation...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):Terraform Python 3x SQL Oracle/PostgreSQL Py Spark Boto ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): Glue CloudWatch SNS Athena S Kinesis Streams...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa iSanqa Full time

    Our client requires the services of a Technology Integrator (Chief Expert) Midrand/Menlyn/Rosslyn/Home Office RotationAmazing brand with cutting edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026 EXPERIENCE: 12+ Years related working...

  • AWS Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Liyema Consulting Full time

    Essential Skills Requirements: Terraform Python 3.x SQL (Oracle/PostgreSQL) PySpark Boto ETL Docker Linux / Unix Big Data PowerShell / Bash Advantageous Skills Requirements: Expertise in data modelling with Oracle SQL Analytical skills for large and complex data sets Thorough testing and data validation Strong written and verbal communication Ability to work...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance): - Terraform - Python 3x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - PowerShell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Experience with Enterprise Collaboration tools such as Confluence, JIRA, etc.- Experience...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    3 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    1 month ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: - Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:- Technical Skills / Technology (in order of importance): - Terraform - Python 3.x - SQL - Oracle/PostgreSQL - PySpark - Boto3 - ETL - Docker - Linux / Unix - Big Data - Powershell / Bash - Cloud Data Hub (CDH) - CDEC Blueprint - Any additional responsibilities assigned in the Agile Working Model (AWM) CharterADVANTAGEOUS SKILLS...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    Essential Skills Requirements: - Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements: - Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    Essential Skills Requirements:- Terraform- Python 3.x- SQL (Oracle/PostgreSQL)- PySpark- Boto3- ETL- Docker- Linux / Unix- Big Data- PowerShell / Bash Advantageous Skills Requirements:- Expertise in data modelling with Oracle SQL- Analytical skills for large and complex data sets- Thorough testing and data validation- Strong written and verbal communication-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Liyema Consulting Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance): - Glue- CloudWatch- SNS-...

  • AWS Data Engineer

    4 weeks ago

    Midrand, South Africa Adzuna ZA B C2 Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):- Terraform- Python 3x- SQL - Oracle/PostgreSQL- Py Spark- Boto3- ETL- Docker- Linux / Unix- Big Data- Powershell / Bash- Cloud Data Hub (CDH)- CDEC Blueprint Basic experience/understanding of AWS Components (in order of importance):- Glue- CloudWatch- SNS- Athena-...

  • AWS Data Engineer EXP 0675

    2 months ago

    Midrand, South Africa Open Source (Pty) Ltd Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data Hub (CDH) BMW CDEC Blueprint · Experience in working with Enterprise Collaboration tools such...

  • AWS Data Engineer EXP 0675

    4 weeks ago

    Midrand, South Africa Open Source (Pty) Ltd Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashBMW Cloud Data Hub (CDH)BMW CDEC Blueprint · Experience in working with Enterprise Collaboration tools such as Confluence,...