AWS Data Engineer
4 weeks ago
- Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team.
- Develop technical documentation and artifacts to support data engineering processes and initiatives.
- Work with various data formats including Parquet, AVRO, JSON, XML, and CSV.
- Utilize Data Quality Tools such as Great Expectations to ensure data accuracy and integrity.
- Apply knowledge of the Agile Working Model to adapt to changing requirements and priorities.
- Proficiency in Terraform for infrastructure as code implementation.
- Strong programming skills in Python 3.x for data manipulation and automation tasks.
- Experience with SQL, including Oracle and PostgreSQL, for data querying and manipulation.
- Familiarity with PySpark for big data processing and analysis.
- Knowledge of Boto3 for interacting with AWS services programmatically.
- Experience with ETL (Extract, Transform, Load) processes and tools.
- Proficiency in Docker for containerization and deployment.
- Familiarity with Linux/Unix operating systems.
- Understanding of Big Data technologies and concepts.
- Proficiency in Powershell/Bash scripting for automation tasks.
- Bachelor's degree in IT, Business, Engineering, or related field.
- Relevant certifications preferred, including AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, and Hashicorp Certified Terraform Associate.
- Expertise in data modeling with Oracle SQL.
- Exceptional analytical skills for analyzing large and complex datasets.
- Experience with thorough testing and data validation processes.
- Strong written and verbal communication skills, with precise documentation abilities.
- Self-driven team player with the ability to work independently and multitask effectively.
- Experience building data pipelines using AWS Glue, Data Pipeline, or similar platforms.
- Familiarity with data stores such as AWS S3, AWS RDS, or DynamoDB.
- Solid understanding of various software design patterns.
- Experience preparing specifications for software development projects.
- Strong organizational skills.
- Basic experience in networking and troubleshooting network issues.
- Bonus: Experience developing and working with REST APIs.
-
AWS Data Engineer
4 days ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts....
-
AWS Data Engineer
3 days ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Knowledge of data...
-
AWS Data Engineer
3 weeks ago
Pretoria, Gauteng, South Africa SabenzaIT Full timeAre you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...
-
Pretoria, South Africa E-Merge Full timee-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...
-
Pretoria, South Africa E-Merge Full timee-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...
-
Data Engineer
4 weeks ago
Pretoria, South Africa HR Genie Full timeWe are committed to excellence and are looking for a dynamic Data Engineer to join our team. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want you on our team. Hybrid (once a week) - Pretoria As a Data Engineer at Dotcom, you will play a crucial role in our engineering team, responsible for designing,...
-
Aws Cloud DevOps Specialist
3 weeks ago
Pretoria, South Africa Skills Connector Full timeLeader in IT innovation is ready to go to the next level and is seeking your expertise in the following areas: - Software engineering (data back-end and front end development) - AWS integration (Python) - Web services design & deployment - REST **This will put you at the TOP of the shortlist**: - _ AGILE methodology/SCRUM_ - _ API Gateway_ - _ S3,...
-
AWS Data Engineer
2 weeks ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts...
-
AWS Data Engineer
4 weeks ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashCloud Data Hub (CDH)CDEC BlueprintExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefactsKnowledge of...
-
1595 data Scientist
6 days ago
Pretoria, South Africa JorDan Human Resources Full time2024-04-09 - 2024-05-07 - Permanent - JHB009218 - IT- Gauteng, Tshwane (Pretoria) - 1595_**Data Engineer / Scientist (Advanced)** **Location: Gauteng** **Contract Term: 1 June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: Strong background in mathematics and good analytical and problem-solving skills. Any additional responsibilities assigned...
-
2736 Aws/azure Operations
3 days ago
Pretoria, South Africa JorDan Human Resources Full time2024-04-12 - 2024-05-08 - Permanent - JHB009236 - IT- Gauteng, Tshwane (Pretoria) **2736_ AWS/Azure Operations (Advanced)** **Location: Gauteng** **Contract Term: 1June 2024 - 31 December 2026** **ESSENTIAL SKILLS REQUIREMENTS**: - AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC - Azure technologies: Azure...
-
Specialist: Data
4 weeks ago
Pretoria, South Africa Kamo Placements Full time*** - Define and plan the implementation and cut over approach requirements and steps to be followed including consulting the business on business readiness criteria - Design and present prototypes in accordance to the relevant requirements - Provide testers with background information and insight relating to processes and functionality provided **JOB...
-
DevOPS Engineer
4 weeks ago
Pretoria, South Africa PRR Recruitment Services Full timeDevOPS Engineer -- Rneg This medical company looking for a DevOPS Engineer with a minimum 5 years experience in Technology & Software Minimum 3 years experience in Cybersecurity3 years in any of: Scala, Go, Java, NodeJS/JavaScript/Typescript/RubyExtensive exposure to CI/CD frameworks: (Jenkins, Code Pipeline + CodeBuild)AWS' ecosystemAWS Well Architected...
-
Specialist: Data
4 weeks ago
Pretoria, South Africa Kamo Placement Full timeGauteng, Tshwane (Pretoria) - Annually Cost To Company (Market related, Negotiable) To design, develop, implement and maintain data and business intelligence solutions to meet both internal and external customer requirements **JOB DESCRIPTION** - Define and plan the implementation and cut over approach requirements and steps to be followed including...
-
2736_ AWS/Azure Operations
2 weeks ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS: · AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...
-
2736_ AWS/Azure Operations
4 weeks ago
Pretoria, South Africa Jordan HR Full timeESSENTIAL SKILLS REQUIREMENTS:· AWS technologies: AWS Networking, SQS, SNS, Kinesis, Lambda, RDS, EKS, ElastiCache, Aurora, VPC· Azure technologies: Azure networking, SQL, Azure Functions, Azure Monitor· Kubernetes and Docker· ITIL processes, in particular Incident, Problem Management, Configuration Management. ADVANTAGEOUS...
-
Aws/azure Operations
7 days ago
Pretoria, South Africa Mediro ICT Full timePrimary responsibility is DevOps, with a strong focus on infrastructure, monitoring, debugging and fault-finding. Handling of incidents according to the client’s processes. Management/Coordination of Incidents across several internal & external support organisations. Config management & Service management. Active participation in Agile...
-
DevOPS Security Engineer
4 weeks ago
Pretoria, South Africa PRR Recruitment Services Full timeDevOPS Security Engineer based in a medical company in Garsfontein The ideal candidate will have: Minimum 5 years experience in Technology & SoftwareMinimum 3 years experience in CybersecurityExperience would be:3 years in any of: Scala, Go, Java, NodeJS/JavaScript/Typescript/RubyExtensive exposure to CI/CD frameworks: (Jenkins, Code Pipeline +...
-
DBA or Database Engineer,
4 weeks ago
Pretoria, South Africa HR Genie Full timeWe are currently seeking a highly skilled and motivated Database Administrator (DBA)/Engineer to join our dynamic team. If you are passionate about database management, software engineering, and thrive in fast-paced environments, we would love to hear from you.Hybrid (once a week) - Pretoria Key Responsibilities:Design, implement, and manage databases with a...
-
Data Engineer/ BI Consultant
4 weeks ago
Pretoria, South Africa People Dimension Full timeJob Description/Duties:• To identify, conceptualize & advocate strategic data enablement opportunities (new & existing customers). • Project and activity planning. • Stakeholder expectation management. • Product installation & configuration.• Stakeholder expectation management. • Product installation & configuration.• Implement data strategies,...