Data Streaming Engineer
3 weeks ago
Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to deliver efficient and scalable solutions.
Key Responsibilities:
- Build and Maintain: Design, develop, and manage robust streaming pipelines using Kafka and Flink.
- Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
- Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
- Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
- Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.
Key Requirements:
- Expertise in Kafka and Flink: Proven experience with these technologies is essential.
- Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
- Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
- Java , or Scala.Programming Proficiency: Advanced knowledge of Python, Java , or Scala.
- AWS , GCP, or Azure is a significant advantage.Cloud Platforms: Experience with AWS , GCP, or Azure is a significant advantage.
- DevOps Familiarity: Understanding of DevOps tools and principles.
Additional Skills:
- Problem-Solving: Analytical mindset with the ability to tackle complex challenges.
- Independence: Ability to work autonomously while managing intricate projects.
- Communication: Strong verbal and written communication skills for effective collaboration with cross-functional teams.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
-
Data Streaming Engineer
3 weeks ago
Cape Town, South Africa PBT Group Full timeAre you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to...
-
Data Engineering
2 weeks ago
Cape Town, South Africa PBT Group Full time**Duties & Responsibilities** **Operational Delivery** - Build, enhance, and maintain real-time data pipelines. - Work with infrastructure and operations teams to maintain data infrastructure. - Identify, document, and resolve feature gaps while implementing solutions. - Modernize and maintain services and tooling to ensure resilience, fix data...
-
Streaming Data Architect
7 days ago
Cape Town, Western Cape, South Africa Findojobs South Africa Full timeAbout the RoleThe Streaming Data Architect will be responsible for designing and developing real-time data pipelines. The ideal candidate will have strong experience with AWS technologies, including Kafka and Confluent.Key ResponsibilitiesDesign and develop real-time data streaming tools and platforms.Collaborate with infrastructure and operations teams to...
-
Data Engineering
1 week ago
Cape Town, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Engineering
1 week ago
Cape Town, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Ingestion Specialist
7 days ago
Cape Town, Western Cape, South Africa Findojobs South Africa Full timeStreaming Data Engineer Job SummaryThis is an exciting opportunity to join our team as a Streaming Data Engineer. The ideal candidate will have strong experience with real-time data processing and streaming technologies.Key ResponsibilitiesDesign and develop real-time data streaming tools and platforms.Collaborate with infrastructure and operations teams to...
-
Senior Technical Lead
2 days ago
Cape Town, Western Cape, South Africa The Family Independence Initiative (FII) Full timeQualifications and ExperienceLeadership Experience:2+ years of experience leading teams, mentoring, and coaching, with a passion for leadership and team growth.Data Engineering Expertise:5+ years of experience building modern, cloud-native data platforms, with deep hands-on expertise in:Designing scalable and resilient pipelines for big data processing and...
-
Real-Time Data Engineer Lead
7 days ago
Cape Town, Western Cape, South Africa Findojobs South Africa Full timeData Engineer Lead Job DescriptionWe are seeking a highly experienced Data Engineer Lead to join our team. The successful candidate will have a strong background in real-time data processing and streaming technologies.Main ResponsibilitiesBuild, enhance, and maintain real-time data pipelines.Work closely with infrastructure and operations teams to maintain...
-
Data Engineering Lead
2 weeks ago
Cape Town, South Africa Progressive Edge Full time**Data Engineering Lead** **Permanent** **Cape Town** A large established enterprise is looking to employ a Technical Lead : Data Engineering with deep technical knowledge the ability to lead and mentor a team of Data engineers. You will require substantial expertise in a broad range of software development & programming fields. Your knowledge of data...
-
Data Engineer
3 weeks ago
Cape Town, South Africa Network Recruitment Full timeAs a Data Engineer at our client, youll play a pivotal role in expanding and optimizing their data architecture and data pipeline systems. Youll work with cutting-edge technology to build efficient data solutions that support cross-functional teams, improve processes, and unlock powerful insights for the business. If you enjoy tackling complex data...
-
Data Insights Engineer
2 days ago
Cape Town, Western Cape, South Africa DataEQ Full timeCompany OverviewAt DataEQ, we're passionate about using cutting-edge AI to turn unstructured customer and public feedback into actionable insights. Our goal is to help businesses improve customer experiences, manage risk, and streamline digital services.Our tech stack includes Java, Spring Boot, PostgreSQL, and Python. As a senior machine learning and java...
-
Data Engineer
3 weeks ago
Cape Town, South Africa Network Recruitment Full timeAs a Data Engineer at our client, youll play a pivotal role in expanding and optimizing their data architecture and data pipeline systems. Youll work with cutting-edge technology to build efficient data solutions that support cross-functional teams, improve processes, and unlock powerful insights for the business.If you enjoy tackling complex data...
-
AWS Data Engineer
3 weeks ago
Cape Town, South Africa PBT Group Full timePBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...
-
AWS Data Engineer
3 weeks ago
Cape Town, South Africa PBT Group Full timePBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...
-
Cloud Data Pipeline Manager
7 days ago
Cape Town, Western Cape, South Africa Findojobs South Africa Full timeReal-Time Data Engineering Team LeadWe are seeking a highly experienced Real-Time Data Engineering Team Lead to join our team. The successful candidate will have a strong background in real-time data processing and streaming technologies.Main ResponsibilitiesLead the development and maintenance of real-time data pipelines.Collaborate with infrastructure and...
-
Enterprise Engineer
2 days ago
Cape Town, Western Cape, South Africa TFG (The Foschini Group) Full timeWe are seeking a talented Senior Software Engineer to join our Information Technology team at TFG. As a key member of our team, you will play a critical role in driving business growth through the design and development of integration solutions.About the PositionThis is an exceptional opportunity for a software engineer with expertise in C# and .NET...
-
Software Engineer with a Passion for Data
2 days ago
Cape Town, Western Cape, South Africa DataEQ Full timeThe RoleWe are seeking a skilled Full Stack Developer to join our small dev team. As a Full Stack Developer, you will be responsible for building web applications used by both our staff and clients. You will work on both front-end code as well as back-end development, processing real-time data streams and storing them for efficient querying.You will also be...
-
Production Supervisor/team Leader/value Stream
2 weeks ago
Cape Town, South Africa Unique Personnel Full time**Job Number** - 68607 **Job Type** - Permanent **Job Title** - Production Supervisor/Team Leader/Value Stream Leader **Computer Skills** - SPC,VSM,SMED,JIT,5S,TPM,MS Office Suite **Industry** - Manufacturing **City** - Cape Town **Province** - Western Cape - Reporting to the Operations Manager- Job Purpose: - Full responsibility for and leadership of...
-
Data Engineer
3 weeks ago
Cape Town, South Africa PBT Group Full time? Join PBT Group as a Senior Data Engineer ! ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data...
-
Data Engineer
3 weeks ago
Cape Town, South Africa PBT Group Full time? Join PBT Group as a Senior Data Engineer! ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...