AWS Data Engineer

2 weeks ago

Pretoria, South Africa Jordan HR Full time
Responsibilities:
  • Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team.
  • Develop technical documentation and artifacts to support data engineering processes and initiatives.
  • Work with various data formats including Parquet, AVRO, JSON, XML, and CSV.
  • Utilize Data Quality Tools such as Great Expectations to ensure data accuracy and integrity.
  • Apply knowledge of the Agile Working Model to adapt to changing requirements and priorities.
Technical Skills:
  • Proficiency in Terraform for infrastructure as code implementation.
  • Strong programming skills in Python 3.x for data manipulation and automation tasks.
  • Experience with SQL, including Oracle and PostgreSQL, for data querying and manipulation.
  • Familiarity with PySpark for big data processing and analysis.
  • Knowledge of Boto3 for interacting with AWS services programmatically.
  • Experience with ETL (Extract, Transform, Load) processes and tools.
  • Proficiency in Docker for containerization and deployment.
  • Familiarity with Linux/Unix operating systems.
  • Understanding of Big Data technologies and concepts.
  • Proficiency in Powershell/Bash scripting for automation tasks.
Qualifications and Experience:
  • Bachelor's degree in IT, Business, Engineering, or related field.
  • Relevant certifications preferred, including AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, and Hashicorp Certified Terraform Associate.
Advantageous Skills:
  • Expertise in data modeling with Oracle SQL.
  • Exceptional analytical skills for analyzing large and complex datasets.
  • Experience with thorough testing and data validation processes.
  • Strong written and verbal communication skills, with precise documentation abilities.
  • Self-driven team player with the ability to work independently and multitask effectively.
  • Experience building data pipelines using AWS Glue, Data Pipeline, or similar platforms.
  • Familiarity with data stores such as AWS S3, AWS RDS, or DynamoDB.
  • Solid understanding of various software design patterns.
  • Experience preparing specifications for software development projects.
  • Strong organizational skills.
  • Basic experience in networking and troubleshooting network issues.
  • Bonus: Experience developing and working with REST APIs.

  • AWS Data Engineer

    3 days ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Knowledge of data...

  • AWS Data Engineer

    3 days ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts....

  • AWS Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    2 weeks ago

    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    4 weeks ago

    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • Data Engineer

    4 weeks ago

    Pretoria, South Africa HR Genie Full time

    We are committed to excellence and are looking for a dynamic Data Engineer to join our team. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want you on our team. Hybrid (once a week) - Pretoria As a Data Engineer at Dotcom, you will play a crucial role in our engineering team, responsible for designing,...

  • Aws Cloud DevOps Specialist

    3 weeks ago

    Pretoria, South Africa Skills Connector Full time

    Leader in IT innovation is ready to go to the next level and is seeking your expertise in the following areas: - Software engineering (data back-end and front end development) - AWS integration (Python) - Web services design & deployment - REST **This will put you at the TOP of the shortlist**: - _ AGILE methodology/SCRUM_ - _ API Gateway_ - _ S3,...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts...

  • AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashCloud Data Hub (CDH)CDEC BlueprintExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefactsKnowledge of...

  • 1595 data Scientist

    6 days ago

    Pretoria, South Africa JorDan Human Resources Full time

    2024-04-09 - 2024-05-07 - Permanent - JHB009218 - IT- Gauteng, Tshwane (Pretoria) - 1595_**Data Engineer / Scientist (Advanced)** **Location: Gauteng** **Contract Term: 1 June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: Strong background in mathematics and good analytical and problem-solving skills. Any additional responsibilities assigned...

  • 2736 Aws/azure Operations

    3 days ago

    Pretoria, South Africa JorDan Human Resources Full time

    2024-04-12 - 2024-05-08 - Permanent - JHB009236 - IT- Gauteng, Tshwane (Pretoria) **2736_ AWS/Azure Operations (Advanced)** **Location: Gauteng** **Contract Term: 1June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: - AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC - Azure technologies: Azure...

  • Specialist: Data

    4 weeks ago

    Pretoria, South Africa Kamo Placements Full time

    *** - Define and plan the implementation and cut over approach requirements and steps to be followed including consulting the business on business readiness criteria - Design and present prototypes in accordance to the relevant requirements - Provide testers with background information and insight relating to processes and functionality provided **JOB...

  • Specialist: Data

    4 weeks ago

    Pretoria, South Africa Kamo Placement Full time

    Gauteng, Tshwane (Pretoria) - Annually Cost To Company (Market related, Negotiable) To design, develop, implement and maintain data and business intelligence solutions to meet both internal and external customer requirements **JOB DESCRIPTION** - Define and plan the implementation and cut over approach requirements and steps to be followed including...

  • DevOPS Engineer

    4 weeks ago

    Pretoria, South Africa PRR Recruitment Services Full time

    DevOPS Engineer -- Rneg This medical company looking for a DevOPS Engineer with a minimum 5 years experience in Technology & Software Minimum 3 years experience in Cybersecurity3 years in any of: Scala, Go, Java, NodeJS/JavaScript/Typescript/RubyExtensive exposure to CI/CD frameworks: (Jenkins, Code Pipeline + CodeBuild)AWS' ecosystemAWS Well Architected...

  • 2736_ AWS/Azure Operations

    2 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: · AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...

  • 2736_ AWS/Azure Operations

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS:· AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...

  • Aws/azure Operations

    6 days ago

    Pretoria, South Africa Mediro ICT Full time

    Primary responsibility is DevOps, with a strong focus on infrastructure, monitoring, debugging and fault-finding. Handling of incidents according to the client’s processes. Management/Coordination of Incidents across several internal & external support organisations. Config management & Service management. Active participation in Agile...

  • DevOPS Security Engineer

    4 weeks ago

    Pretoria, South Africa PRR Recruitment Services Full time

    DevOPS Security Engineer based in a medical company in Garsfontein The ideal candidate will have: Minimum 5 years experience in Technology & SoftwareMinimum 3 years experience in CybersecurityExperience would be:3 years in any of: Scala, Go, Java, NodeJS/JavaScript/Typescript/RubyExtensive exposure to CI/CD frameworks: (Jenkins, Code Pipeline +...

  • DBA or Database Engineer,

    4 weeks ago

    Pretoria, South Africa HR Genie Full time

    We are currently seeking a highly skilled and motivated Database Administrator (DBA)/Engineer to join our dynamic team. If you are passionate about database management, software engineering, and thrive in fast-paced environments, we would love to hear from you.Hybrid (once a week) - Pretoria Key Responsibilities:Design, implement, and manage databases with a...

  • Data Engineer/ BI Consultant

    4 weeks ago

    Pretoria, South Africa People Dimension Full time

    Job Description/Duties:• To identify, conceptualize & advocate strategic data enablement opportunities (new & existing customers). • Project and activity planning. • Stakeholder expectation management. • Product installation & configuration.• Stakeholder expectation management. • Product installation & configuration.• Implement data strategies,...