Data Streaming Engineer
1 week ago
Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to deliver efficient and scalable solutions.
Key Responsibilities:
- Build and Maintain: Design, develop, and manage robust streaming pipelines using Kafka and Flink.
- Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
- Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
- Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
- Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.
Key Requirements:
- Expertise in Kafka and Flink: Proven experience with these technologies is essential.
- Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
- Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
- Programming Proficiency: Advanced knowledge of Python, Java, or Scala.
- Cloud Platforms: Experience with AWS, GCP, or Azure is a significant advantage.
- DevOps Familiarity: Understanding of DevOps tools and principles.
Additional Skills:
- Problem-Solving: Analytical mindset with the ability to tackle complex challenges.
- Independence: Ability to work autonomously while managing intricate projects.
- Communication: Strong verbal and written communication skills for effective collaboration with cross-functional teams.
-
Streaming Data Engineer Lead
3 days ago
Cape Town, Western Cape, South Africa PBT Group Full timePBT Group is at the forefront of data-driven innovation, leveraging real-time data processing to drive business success.We're seeking an exceptional Data Streaming Engineer to lead our efforts in designing and implementing high-performance data pipelines.This role offers the chance to collaborate with cross-functional teams and work with industry-leading...
-
Cloud Data Streams Architect
6 days ago
Cape Town, Western Cape, South Africa Amazon Full timeThe way businesses think about managing their information needs is changing rapidly in today's cloud-first world. As a Cloud Data Streams Architect on our AWS Kinesis team, you'll have the opportunity to shape this exciting new technology and help customers achieve their goals.About the JobYou'll be working closely with product managers to refine product...
-
Data Engineer
1 week ago
Cape Town, Western Cape, South Africa proFound Faith Consulting Full timeJob title : Data Engineer (Streaming)Job Location : Western Cape, Cape TownDeadline : April 13, 2025Quick Recommended LinksJobs by Location Job by industries What You'll DoDesign, develop, and maintain real-time streaming pipelines using tools like Apache Kafka, Apache Flink, and AWS Kinesis. Build scalable architectures for event-driven systems and ensure...
-
Cape Town, Western Cape, South Africa Amazon Full timeSenior Software Development Engineer, AWS Kinesis Data StreamsLeading brands like Epic Games, Lyft, AirBnB, and Vanguard use Amazon Kinesis Data Streams as their foundation for real-time streaming data. With Amazon Kinesis Data Streams, customers process Gigabytes per second of real-time user engagement data for gaming and marketing analytics, build...
-
Data Engineering
2 weeks ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Data Engineering
5 hours ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...
-
Senior Data Engineer
6 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeKey Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract,...
-
Senior Data Engineer
4 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeKey Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...
-
Senior Data Engineer
5 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeKey Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...
-
Senior Data Engineer
5 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeKey Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...
-
Senior Cloud Architect
5 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeAbout the RoleIn this role, you will be responsible for designing and implementing scalable data architectures that meet the needs of our business. This includes building and maintaining data pipelines, working with big data batch and streaming tools, and ensuring the smooth operation of data infrastructures.The ideal candidate will have extensive experience...
-
Senior Data Engineer
52 minutes ago
Cape Town, Western Cape, South Africa PBT Group Full timeThe role of a Senior Data Engineer at PBT Group involves designing and developing scalable data infrastructure to support business growth. The successful candidate will be responsible for building, enhancing, and maintaining real-time data pipelines using AWS technologies.Key Responsibilities:Developing and maintaining data ingestion pipelines to ensure...
-
Data Engineer Lead
5 days ago
Cape Town, Western Cape, South Africa Network Recruitment Full timeCompany OverviewWe are Network Recruitment, a leading provider of specialized staffing solutions. Our mission is to connect exceptional talent with innovative companies.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and...
-
Data Network Operations Engineer
1 day ago
Cape Town, Western Cape, South Africa Data Centrix Full time**Job Description**Data Centrix seeks a Data Network Operations Engineer to support the maintenance and operation of our customer MPLS and Cisco SDWAN networks.As a key member of our network operations team, you will be responsible for identifying opportunities for improving the efficiency and reliability of our network infrastructure.The ideal candidate...
-
Real-Time Data Solutions Architect
3 days ago
Cape Town, Western Cape, South Africa PBT Group Full timeAt PBT Group, we're on the cutting edge of real-time data processing and cutting-edge technology.We're seeking a highly skilled Data Streaming Engineer to play a pivotal role in shaping our data streaming architecture.This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and...
-
Data Engineering Technical Lead
4 hours ago
Cape Town, Western Cape, South Africa The Family Independence Initiative (FII) Full timeThe Data Engineering Technical Lead will be part of the existing central Data Team, working to take iiDENTIFii's data practices to the next level. You will assist in refining our current platform while contributing to the development and implementation of our next-generation data platform using industry best practices such as the Medallion Architecture,...
-
Data Engineer
4 days ago
Cape Town, Western Cape, South Africa Bookboost AB Full timeWelcome to Bookboost AB, a pioneering B2B SaaS provider in the hospitality engagement space. We empower hotels to design personalized guest journeys, automate communications, and gain full visibility over their customer touchpoints.About the roleWe're seeking an experienced Cloud Data Engineer to join our team and play a key role in designing and...
-
Director of Data Engineering
6 days ago
Cape Town, Western Cape, South Africa The Parent Centre Empowering parents through Positive Parenting Full timeAbout You and the Key Skills We're Looking ForOur ideal candidate has a proven track record as an AWS Cloud Data Engineer, showcasing expertise in designing scalable and secure data solutions.Achieving proficiency in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, and Spark / SparkSQL enables you to handle massive amounts of data...
-
Cape Town, Western Cape, South Africa Bookboost AB Full timeWe're excited to announce a new opportunity for an Engineering Lead to join our team at Bookboost AB! As a fast-growing company in the hospitality tech space, we're redefining what's possible with innovative solutions that transform the way hotels connect with their guests.About the roleThis is an exciting chance to lead our data engineering efforts and...
-
Big Data Processing Specialist
3 days ago
Cape Town, Western Cape, South Africa PBT Group Full timeAs a Data Specialist at PBT Group, you will contribute to developing next-generation data solutions that transform industries.We are looking for an accomplished Data Streaming Engineer who can help us realize cutting-edge data architectures.In this pivotal role, you will have the opportunity to work closely with seasoned developers and engineers to implement...