AWS Data Engineer
1 month ago
We are seeking a highly skilled Data Engineer to join our agile team at PBT Group. As a Data Engineer, you will play a pivotal role in constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security.
Key Responsibilities:- Design and implement data analytics frameworks.
- Translate complex functional and technical requirements into detailed architecture and high-performance software.
- Lead the development of data and batch/real-time analytical solutions using transformative technologies.
- Oversee user story analysis, design, software development, testing, and automation tool creation.
- Minimum 5 years of experience in Data Engineering or Software Engineering.
- Demonstrated leadership experience, managing teams of engineers for 3-5 years.
- Minimum 2 years of experience in Big Data.
- At least 5 years of experience with Extract, Transform, and Load (ETL) processes.
- Minimum 2 years of experience with AWS (Amazon Web Services).
- Demonstrated experience with agile or other rapid application development methodologies for at least 2 years.
- 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
- Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
- Support experience for data feeds in production on a break-fix basis (2 years).
- Minimum 4 years of experience in creating data marts using Talend or similar ETL development tools.
- Proficiency in data manipulation using Python and PySpark (2 years).
- Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS's distribution of Hadoop (2 years).
- DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
- Extensive knowledge of various programming or scripting languages.
- Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases.
- Ability to design highly scalable distributed systems using various open-source tools.
- Proficiency in both batch and streaming Big Data tools.
- Experience with Talend for at least 1 year.
- Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
- Proficiency in Python for at least 1 year.
- Familiarity with PySpark or Spark (desirable for at least 1 year).
- Experience in Business Intelligence data modeling for 3 years.
- Proficiency in SQL for 3 years.
- 5+ years of experience in Retail Operations.
- Bachelor's degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
- AWS Certification, at least at the associate level.
-
AWS Cloud Engineer
1 month ago
Cape Town, Western Cape, South Africa Dimension Data Full timeJob Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at Dimension Data. As a key member of our cloud engineering team, you will be responsible for designing, implementing, and managing cloud-based infrastructure and applications.Key Responsibilities:Design and implement cloud-based infrastructure and applications...
-
AWS Data Center Engineer
1 month ago
Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full timeAbout the RoleWe are seeking a highly skilled Data Center Engineering Operations Technician to join our team at Amazon Data Services South Africa (Pty) Ltd. As a key member of our Infrastructure Operations team, you will be responsible for ensuring the smooth operation of our data centers, including electrical and mechanical equipment maintenance and...
-
AWS Data Architect
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timeAbout the RolePBT Group is seeking a highly skilled AWS Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data pipelines and systems on Amazon Web Services (AWS).Key ResponsibilitiesData EngineeringDesign and develop scalable data architectures using AWS services such as S3,...
-
AWS Systems Engineer
3 weeks ago
Cape Town, Western Cape, South Africa Dimension Data Full timeJob Title: AWS Systems Engineer - Cloud InfrastructureAbout the Role:As an AWS Systems Engineer - Cloud Infrastructure, you will be responsible for designing, deploying, and managing scalable and secure cloud infrastructure on AWS. You will work closely with cross-functional teams to ensure the smooth operation of our cloud infrastructure and services.Key...
-
AWS Cloud Infrastructure Specialist
4 weeks ago
Cape Town, Western Cape, South Africa Dimension Data Full timeJob DescriptionWe are seeking an experienced AWS Architect to join our team at Dimension Data. As an AWS Architect, you will be responsible for designing and architecting the services that will power our cloud-based applications.Key responsibilities include:Providing guidance and leading architecture for the entire AWS cloud environmentLeading the team in...
-
AWS Cloud Infrastructure Architect
3 weeks ago
Cape Town, Western Cape, South Africa Dimension Data Full timeAs an AWS Architect at Dimension Data, you will be responsible for designing and architecting cloud based applications. The ideal candidate will have experience in cloud computing, including Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as a Service (SaaS), and/or Infrastructure as a Network Service (IANS).You will lead the...
-
AWS Cloud Infrastructure Specialist
3 weeks ago
Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full timeAbout the Role:We are seeking a Data Center Engineering Operations Technician to join our expanding Infrastructure Operations team. This role is a hands-on electrical and mechanical equipment troubleshooting and operation responder.As a Data Center Engineering Operations Technician, you will be responsible for:Safety:Following and maintaining the highest...
-
Data Center Electrical Engineer Expert
5 days ago
Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full timeCompany OverviewAmazon Data Services South Africa (Pty) Ltd is a leading provider of cloud computing services. We empower businesses to innovate and grow by providing a robust suite of products and services.Job SummaryWe are seeking an experienced Data Center Electrical Engineer Expert to join our team. As a key member of our AWS Infrastructure Services, you...
-
AWS DevOps Engineer
4 weeks ago
Cape Town, Western Cape, South Africa DataTech Recruitment Full timeJob Title: AWS DevOps EngineerJob Summary:We are seeking a skilled DevOps/SysOps Engineer to build and manage the infrastructure, automate deployment processes, and maintain the production systems. The ideal candidate will have 5+ years of experience in DevOps or a related role and proficiency with AWS services (EC2, S3, RDS, Lambda, CloudFormation,...
-
Senior Cloud Infrastructure Engineer
5 days ago
Cape Town, Western Cape, South Africa Dimension Data Full timeJob SummaryWe are seeking a highly skilled Senior Cloud Infrastructure Engineer to join our team at Dimension Data. As a key member of our engineering team, you will be responsible for designing, deploying, and managing scalable cloud infrastructure on AWS.Key ResponsibilitiesDesign and implement efficient and reliable automated scripts to automate...
-
Intermediate DevOps Engineer
3 weeks ago
Cape Town, Western Cape, South Africa Black Swan Data Full timeJob Summary:We are seeking an experienced DevOps Engineer with a strong background in Kubernetes, AWS, and Linux to join our team. As a Cloud Infrastructure Specialist, you will play a critical role in designing, implementing, and maintaining our cloud infrastructure, with a focus on Kubernetes-based container orchestration, AWS services, and Linux...
-
Data Streaming Engineer
1 month ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group is seeking a highly skilled Data Streaming Engineer to join our team. As a senior engineer on the Data Streaming Platform team, you will be responsible for designing, developing, and maintaining real-time data pipelines that drive business growth. You will collaborate with various teams to understand data needs and turn them into scalable platforms...
-
Senior Cloud Engineer
12 hours ago
Cape Town, Western Cape, South Africa The Legends Agency Full timeRole OverviewThe Legends Agency is seeking a highly skilled Senior Cloud Engineer with expertise in designing and implementing cloud-based solutions on the Amazon Web Services (AWS) platform. This role will play a pivotal part in shaping our cloud infrastructure, ensuring scalability, security, and high performance.About The RoleThis exciting opportunity...
-
Senior Data Engineer
4 weeks ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeJob Title: Senior Data Engineer - Data ArchitectJob Summary:We are seeking a highly skilled Senior Data Engineer - Data Architect to join our team at Network Recruitment. As a Senior Data Engineer - Data Architect, you will be responsible for designing and implementing efficient data systems, ensuring data quality, and maintaining data infrastructure...
-
Intermediate DevOps Engineer
1 month ago
Cape Town, Western Cape, South Africa Black Swan Data Full timeJob Summary:We are seeking a highly skilled DevOps Engineer to join our team at Black Swan Data. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure, with a focus on Kubernetes-based container orchestration, AWS services, and Linux systems.Key Responsibilities:Design and...
-
Data Engineer
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group Seeking Intermediate DevOps Data EngineerPBT Group is looking for an intermediate DevOps Data Engineer to join our team.Job DescriptionWe require an experienced data engineer to design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties -...
-
Data Streaming Engineer
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group's Data Streaming Engineer OpportunityPBT Group is seeking a seasoned Data Streaming Engineer to build, enhance, and maintain real-time data pipelines that drive business growth. As a key member of the Data Streaming Platform team, you will collaborate with various infrastructure and operations teams to ensure seamless data infrastructure...
-
Senior Data Engineering Lead
1 month ago
Cape Town, Western Cape, South Africa PBT Group Full timeSenior DataOps EngineerWe are seeking a highly skilled Senior DataOps Engineer to lead the development of DataOps practices within our organisation. As a seasoned DevOps professional with a strong background in software and data, you will be responsible for setting the direction for DataOps within the team, building scalable data pipelines, and ensuring...
-
Senior Data Engineer
1 month ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeKey Responsibilities:Process Optimization: Identify and implement process improvements, automating tasks, and enhancing data system efficiency.Feature Development: Develop new features and optimize existing ones across the data ecosystem to improve scalability and performance.Data Assembly: Assemble complex data sets to support functional and analytical...
-
Platform Engineering Strategist
3 weeks ago
Cape Town, Western Cape, South Africa NTT DATA Full timeJob DescriptionAbout the RoleThis is a high-level technical leadership position that involves providing strategic direction and technical guidance to our platform engineering team. The ideal candidate will have a strong background in cloud infrastructure, containerization, and automation, as well as excellent leadership and collaboration skills.Key...