Senior AWS Data Engineer

2 weeks ago

Pretoria, South Africa Jordan HR Full time
RESPONSIBILITIES
  • You will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis.
  • Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms.
  • Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
  • Ensuring data accuracy and integrity through thorough testing and data validation processes.
  • Developing technical documentation and artifacts to support data engineering processes.
  • Utilizing your expertise in Terraform, Python 3x, SQL (Oracle/PostgreSQL), PySpark, ETL, Docker, Linux/Unix, and other relevant technologies to optimize data workflows.
  • Leveraging AWS services such as S3, RDS, DynamoDB, Glue, and Data Pipeline for building and managing data pipelines.
  • Implementing software design patterns and best practices to ensure scalability, reliability, and maintainability of data solutions.
  • Providing support and guidance in data modelling, SQL optimization, and performance tuning.
SKILLS
  • Proficiency in Terraform, Python 3x, SQL (Oracle/PostgreSQL), PySpark, Boto3, ETL, Docker, Linux/Unix, and Big Data technologies.
  • Experience with PowerShell/Bash scripting for automation tasks.
  • Strong understanding of AWS Cloud services with relevant certifications such as AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, or AWS Certified Architect Professional.
  • Familiarity with HashiCorp Certified Terraform Associate certification is a plus.
  • Ability to develop technical documentation and artifacts.
  • Knowledge of data formats including Parquet, AVRO, JSON, XML, and CSV.
  • Experience with Data Quality Tools like Great Expectations.
  • Proficiency in working with REST APIs is desirable.
  • Familiarity with AWS Glue, Data Pipeline, and other similar platforms for building data pipelines.
  • Solid understanding of software design patterns and best practices.
  • Exceptional analytical skills for analyzing large and complex datasets.
QUALIFICATIONS
  • Bachelor's degree in IT, Business, Engineering, or related field.
  • Preferred certifications: AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, or HashiCorp Certified Terraform Associate.
ADVANTAGEOUS
  • Experience in data modelling and Oracle SQL.
  • Hands-on experience with AWS components and services.
  • Ability to prepare specifications for program development, testing, and debugging.
  • Experience in building data pipelines using AWS Glue or Data Pipeline.
  • Knowledge of data storage technologies such as AWS S3, RDS, or DynamoDB.
  • Strong understanding of various software design patterns and best practices.
Only apply should you meet the above requirements.

  • AWS Data Engineer

    4 days ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Knowledge of data...

  • AWS Data Engineer

    4 days ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts....

  • AWS Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • Aws Cloud DevOps Specialist

    3 weeks ago

    Pretoria, South Africa Skills Connector Full time

    Leader in IT innovation is ready to go to the next level and is seeking your expertise in the following areas: - Software engineering (data back-end and front end development) - AWS integration (Python) - Web services design & deployment - REST **This will put you at the TOP of the shortlist**: - _ AGILE methodology/SCRUM_ - _ API Gateway_ - _ S3,...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    4 weeks ago

    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    2 weeks ago

    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • Data Engineer

    4 weeks ago

    Pretoria, South Africa HR Genie Full time

    We are committed to excellence and are looking for a dynamic Data Engineer to join our team. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want you on our team. Hybrid (once a week) - Pretoria As a Data Engineer at Dotcom, you will play a crucial role in our engineering team, responsible for designing,...

  • AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashCloud Data Hub (CDH)CDEC BlueprintExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefactsKnowledge of...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts...

  • Senior Software Engineer

    4 weeks ago

    Pretoria, South Africa Lim Personnel Full time

    Senior Software EngineerA minimum of 6 year's ETL experience including Cloud Computing Platforms (preference AWS) and Informatica / Glue (Advantageous).ESSENTIAL SKILLS REQUIREMENTS:BI experience as well as 1 – 2 years in a Cloud environment6 years+ experience in Relational databases (Oracle / PostgreSQL preferable)Informatica / Glue (Advantageous)Source...

  • 1595 data Scientist

    7 days ago

    Pretoria, South Africa JorDan Human Resources Full time

    2024-04-09 - 2024-05-07 - Permanent - JHB009218 - IT- Gauteng, Tshwane (Pretoria) - 1595_**Data Engineer / Scientist (Advanced)** **Location: Gauteng** **Contract Term: 1 June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: Strong background in mathematics and good analytical and problem-solving skills. Any additional responsibilities assigned...

  • 2736 Aws/azure Operations

    4 days ago

    Pretoria, South Africa JorDan Human Resources Full time

    2024-04-12 - 2024-05-08 - Permanent - JHB009236 - IT- Gauteng, Tshwane (Pretoria) **2736_ AWS/Azure Operations (Advanced)** **Location: Gauteng** **Contract Term: 1June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: - AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC - Azure technologies: Azure...

  • Specialist: Data

    4 weeks ago

    Pretoria, South Africa Kamo Placements Full time

    *** - Define and plan the implementation and cut over approach requirements and steps to be followed including consulting the business on business readiness criteria - Design and present prototypes in accordance to the relevant requirements - Provide testers with background information and insight relating to processes and functionality provided **JOB...

  • 2615_Requirements Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS:· Very strong conceptual and methodical skills· Solid knowledge in software engineering with a focus on cloud architectures· Solid knowledge of JAVA, Linux, AWS and relational databases· Solid knowledge of AWS technologies: network & security groups, cross account communication, ECS, Fargate, RDS,...

  • 2615_Requirements Engineer

    2 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: · Very strong conceptual and methodical skills· Solid knowledge in software engineering with a focus on cloud architectures· Solid knowledge of JAVA, Linux, AWS and relational databases· Solid knowledge of AWS technologies: network & security groups, cross account communication, ECS, Fargate,...

  • Specialist: Data

    4 weeks ago

    Pretoria, South Africa Kamo Placement Full time

    Gauteng, Tshwane (Pretoria) - Annually Cost To Company (Market related, Negotiable) To design, develop, implement and maintain data and business intelligence solutions to meet both internal and external customer requirements **JOB DESCRIPTION** - Define and plan the implementation and cut over approach requirements and steps to be followed including...

  • Senior BI Solution Specialist

    7 days ago

    Pretoria, South Africa Professional Sourcing Full time

    **Job Overview**: **Senior BI Solution Specialist **(Financial Services)** **Location: Pretoria, Gauteng** **Position Overview**: An exceptional **financial services **concern requires the services of a** Senior BI Solution Specialist.** The main purpose of this position is to **develop and maintain detailed technical designs **and** ensure alignment of...

  • DevOPS Engineer

    4 weeks ago

    Pretoria, South Africa PRR Recruitment Services Full time

    DevOPS Engineer -- Rneg This medical company looking for a DevOPS Engineer with a minimum 5 years experience in Technology & Software Minimum 3 years experience in Cybersecurity3 years in any of: Scala, Go, Java, NodeJS/JavaScript/Typescript/RubyExtensive exposure to CI/CD frameworks: (Jenkins, Code Pipeline + CodeBuild)AWS' ecosystemAWS Well Architected...

  • 2736_ AWS/Azure Operations

    2 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: · AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...

  • 2736_ AWS/Azure Operations

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS:· AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...