AWS Data Engineer
1 week ago
The Data Engineer will be responsible for designing, implementing, and optimising data pipelines and data solutions using AWS and Snowflake. The successful candidate will work closely with Data Analysts, Data Scientists, and other stakeholders to ensure efficient data storage, processing, and accessibility in a cloud environment.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using AWS services (e.g., S3, Glue, Lambda, Redshift) and Snowflake.
- Implement best practices for data storage, transformation, and optimisation in a cloud environment.
- Develop data models to support business intelligence and analytics needs.
- Ensure data integrity, consistency, and reliability through data validation and quality assurance processes.
- Optimise data performance and cost efficiency in Snowflake and AWS.
- Collaborate with cross-functional teams to define data architecture and infrastructure requirements.
- Automate data workflows and monitor performance for continuous improvements.
- Troubleshoot and resolve data-related issues.
Requirements:
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- 5+ years of experience in Data Engineering.
- Strong proficiency in AWS cloud services, particularly S3, Glue, Lambda, Redshift, and IAM.
- Hands-on experience with Snowflake, including data warehousing concepts, performance tuning, and optimisation.
- Expertise in SQL for data modelling, transformation, and querying.
- Experience with ETL/ELT processes and tools.
- Understanding of data governance, security, and compliance in a cloud environment.
- Proficiency in Python or another scripting language for automation.
- Preferred Skills & Experience:
- Experience with data orchestration tools like Apache Airflow.
- Knowledge of DevOps practices and CI/CD pipelines for data workflows.
- Familiarity with Big Data technologies such as Spark or Kafka.
- Exposure to machine learning workflows and MLOps.
- Experience in financial, banking, or insurance sectors.
- Preferred Skills & Experience:
Key Competencies:
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
- Ability to work independently and collaboratively within a team.
- Detail-oriented with a strong focus on data quality and integrity.
- Ability to adapt to a fast-paced and evolving technology landscape.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.
-
AWS Data Engineer
3 weeks ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeMinimum Experience: 5 years of experience in Python/C# development 3 years of experience in AWS Data Engineering Education Requirements: Bachelors degree in Computer Science, Information Systems, or a related field Advantageous: AWS Certified Machine Learning Specialty Certificate Responsibilities: Design and create data models that can extract information...
-
Data Pipeline Engineer AWS
6 days ago
Cape Town, Western Cape, South Africa Ampstek Full timeAWS Data Engineer Position at Ampstek:About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesImplement data security, governance and compliance best...
-
AWS Data Engineer
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...
-
AWS Data Engineer
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...
-
AWS Data Solutions Expert
12 hours ago
Cape Town, Western Cape, South Africa PBT Group Full timeWe are looking for an experienced AWS Data Solutions Expert to join our team at PBT Group. As an AWS Data Solutions Expert, you will be responsible for designing, building, and maintaining cloud-based data infrastructure to ensure scalability, security, and high performance.About the Role:You will work closely with the development team and business...
-
Data Engineer
2 weeks ago
Cape Town, Western Cape, South Africa Datonomy Solutions Full timeJob Overview:We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...
-
Data Engineering
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Engineering
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Engineering
1 week ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Engineer
15 hours ago
Cape Town, Western Cape, South Africa proFound Faith Consulting Full timeJob title : Data Engineer (Streaming)Job Location : Western Cape, Cape TownDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries What You'll DoDesign, develop, and maintain real-time streaming pipelines using tools like Apache Kafka, Apache Flink, and AWS Kinesis. Build scalable architectures for event-driven systems and ensure...
-
AWS Cloud Solutions Architect
6 days ago
Cape Town, Western Cape, South Africa Ampstek Full timeAmpstek is seeking a highly skilled AWS Data Engineer to design, develop and maintain scalable data solutions on AWS Cloud.Job DescriptionWe are looking for an experienced professional who can work with data pipelines, ETL processes and data lake/warehouse solutions using AWS services.Design and build data pipelines using AWS Glue, AWS Lambda and AWS Step...
-
Cloud Data Engineer
6 days ago
Cape Town, Western Cape, South Africa Ampstek Full timeAmpstek is seeking a highly skilled Data Engineer to join our team in Cape Town.About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesDesign and build data...
-
Security Engineer, Aws Trust
5 days ago
Cape Town, Western Cape, South Africa Ananzi Full timeAWS Trust and Safety (T&S) Risk & Response (R&R) is seeking a motivated Security Engineer with a strong background in incident response, threat investigation, and developing solutions to security issues.As a Security Engineer in R&R, you will employ your technical skills to develop solutions to complex and ambiguous security-related events originating from...
-
Software Development Engineer, AWS Alameda
4 weeks ago
Cape Town, Western Cape, South Africa Amazon Full timeSoftware Development Engineer, AWS AlamedaAWS Alameda is shaping the future of how Control Planes for AWS Services will be offered. The Alameda team builds innovative and secure technologies on a massive scale that manage the control planes for AWS services and keep them secure and scalable for their customers. As a software development engineer on this...
-
Data Engineer
4 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full time? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...
-
Data Engineer
3 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full time? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...
-
Principal Lead: Data Engineering
3 days ago
Cape Town, Western Cape, South Africa BADRI Management Consultancy Full timeWoolworths Financial Services | Full timePRINCIPAL LEAD: DATA ENGINEERINGCape Town, South Africa | Posted on 02/14/2025Woolworths Financial Services, or WFS as it is better known, is a Joint Venture with Absa Bank, that supports the Woolworths retail business by providing in-store credit in the form of the Woolworths StoreCard and offering value-added...
-
AWS Serverless Engineer Lead
1 hour ago
Cape Town, Western Cape, South Africa Theodo Full timeTheodo is a company that helps businesses create innovative digital solutions. Our core stack is AWS Serverless & TypeScript, but you'll gain exposure to different technologies and ways of working.Job Description:As an AWS Serverless Engineer Lead, you will be hands-on coding while also engaging in client-facing discussions, bridging technical and business...
-
AWS Data Model Design Lead
2 days ago
Cape Town, Western Cape, South Africa Penta Consulting Full timePenta Consulting provides professional and managed solutions across EMEA, focusing on technology-driven business growth.We are recruiting an AWS Data Model Design Lead to join one of our clients on a 6-month contract, based in Cape Town. The ideal candidate has experience in the banking sector and a strong background in AWS.Data Modelling TasksThe successful...
-
Principal Lead: Data Engineer
4 days ago
Cape Town, Western Cape, South Africa BigTalent Full timeBigTalent City of Cape Town, Western Cape, South AfricaPrincipal Lead: Data EngineerOur financial services client is looking for a Principal Lead Data Engineer to drive the Technical Vision, Strategy and Execution of their data engineering capability.The role will lead the design and implementation of scalable, high-performance data pipelines, data...