Data Engineering Expert

5 days ago

Cape Town, Western Cape, South Africa PBT Group Full time

PBT Group is a pioneer in data streaming technology. We're seeking an experienced Data Streaming Engineer to join our team of talented developers and data specialists.

About the Role:

The successful candidate will design, develop, and maintain robust streaming pipelines using Kafka and Flink. They will handle data integration, transformation, and processing in real-time environments, working closely with engineering teams to integrate streaming solutions into the broader data ecosystem.

Key Responsibilities:

  • Pipeline Development: Build and maintain efficient and scalable data pipelines using industry-leading tools like Kafka and Flink.
  • Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
  • Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
  • Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
  • Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.

Requirements:

  • Kafka and Flink Expertise: Proven experience with these technologies is essential.
  • Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
  • Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
  • Programming Proficiency: Advanced knowledge of Python, Java, or Scala.
  • Cloud Platforms: Experience with AWS, GCP, or Azure is a significant advantage.
  • DevOps Familiarity: Understanding of DevOps tools and principles.

We Offer:

  • Opportunity to Work with Industry-Leading Tools: You'll have the chance to work with cutting-edge technologies like Kafka and Flink.
  • Career Growth: As part of our team, you'll have opportunities to learn and grow, developing new skills and expertise.
  • Collaborative Environment: Our team is passionate about delivering high-quality solutions, and we encourage collaboration and knowledge-sharing.

  • Systems Engineering Expert

    2 days ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Dimension Data seeks an experienced IT professional to join our team as a Systems Engineering Expert. This key role will be responsible for implementing and maintaining various technology systems, including Azure, AWS, Oracle Databases, SAP applications, and more.In this position, you will work closely with cross-functional teams to design and develop ETL...

  • Enterprise Cloud Engineering Leader

    2 days ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Dimension Data is seeking an Enterprise Cloud Engineering Leader to spearhead the development and delivery of cloud-based solutions. As a senior technical expert, you will be responsible for leading a team of engineers in designing and implementing complex cloud architectures that meet the needs of our clients.

  • Technical Data Solutions Expert

    13 hours ago

    Cape Town, Western Cape, South Africa Analyticsengineering Full time

    We are looking for a highly skilled and experienced Technical Data Solutions Expert to join our data engineering team.The ideal candidate will have a strong understanding of data engineering principles, data architecture, and experience with cloud data platforms. They will be responsible for designing, building, and maintaining technical data solutions that...

  • Software Engineer Position

    2 days ago

    Cape Town, Western Cape, South Africa The Talent Expert Full time

    Job OverviewThe Talent Expert is seeking a skilled Software Engineer to join our team. This role involves working on the full software development lifecycle, from conceptualization to deployment.You will be responsible for designing, developing, testing, deploying, maintaining, and enhancing robust software systems and applications. Collaboration with both...

  • Server Infrastructure Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    Data Centrix is committed to delivering exceptional IT solutions and seeks a seasoned Senior Server Support Engineer to join their team in Western Cape, South Africa.In this role, you will be responsible for delivering comprehensive technical support services to Datacentrix clients, focusing on software support services, hardware troubleshooting, and...

  • AWS Data Solutions Expert

    6 days ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    We are looking for an experienced AWS Data Solutions Expert to join our team at PBT Group. As an AWS Data Solutions Expert, you will be responsible for designing, building, and maintaining cloud-based data infrastructure to ensure scalability, security, and high performance.About the Role:You will work closely with the development team and business...

  • Lycopodium Data Engineering Job

    6 days ago

    Cape Town, Western Cape, South Africa Lycopodium Limited Full time

    Lycopodium Limited is a global company that offers a wide range of services across various sectors. As a Junior Data Engineer, you will play a critical role in designing, developing, and maintaining data structures, as well as developing and maintaining data pipelines to collect, transform, store, and share / integrate data across platforms.In this role, you...

  • Data Engineer Lead

    2 days ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Company OverviewWe are Network Recruitment, a leading provider of specialized staffing solutions. Our mission is to connect exceptional talent with innovative companies.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and...

  • Senior Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract,...

  • Senior Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...

  • Senior Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...

  • Senior Data Engineer

    1 day ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data batch and streaming tools to process and analyze data at scale. Develop and optimize Extract, Transform,...

  • Engineering Expert

    12 hours ago

    Cape Town, Western Cape, South Africa Sapientis Full time

    We are seeking an Engineering Expert to join our Retail Logistics team. As an expert in process improvement, you'll analyze existing processes, identify areas for optimization, and implement strategies to boost efficiency and performance.You'll spearhead crucial logistics projects, driving continuous improvement initiatives that boost efficiency and...

  • Technical Data Sales Expert

    12 hours ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    Datacentrix is committed to delivering exceptional customer experiences through our innovative data solutions. As a Pre-Sales: Data & AI Specialist, you will be instrumental in driving this vision forward.Your role will involve developing and presenting value propositions to clients, leveraging your technical expertise to identify opportunities for growth...

  • Software Development Expert

    7 days ago

    Cape Town, Western Cape, South Africa NTT Data Full time

    About NTT Data:NTT Data is a leading IT services provider, delivering innovative solutions to clients across various industries. Our team of experts works together to provide cutting-edge technology services that meet the needs of our clients.Job Requirements:A strong background in software developmentExperience with .NET technologiesFamiliarity with...

  • Data Visualization Expert

    6 days ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    Job Description:We are seeking a skilled Data Visualization Expert to join our team at PBT Group. As a key player in our business intelligence function, you will be responsible for designing and maintaining insightful reports and dashboards using Power BI.Main Responsibilities:Develop and maintain interactive dashboards using Power BI.Create automated...

  • Engineering Optimization Expert

    3 days ago

    Cape Town, Western Cape, South Africa FACT Sa Full time

    Position Summary:Facts Sa seeks an experienced Engineering Optimization Expert to enhance our wireless network capabilities.Main Tasks:Optimize wireless network performance through data analysis and expertise.Identify areas for improvement and develop strategic plans to address them.Liaise with cross-functional teams to ensure seamless implementation.Stay...

  • Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Pbt Group Full time

    Job DescriptionPBT Group, a leading provider of data solutions, is seeking an experienced Data Engineer to join its team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying ETL processes for various projects.Duties and ResponsibilitiesETL Development: Design and develop efficient ETL processes using...

  • IT Infrastructure Expert

    2 days ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    This role offers an exciting opportunity for a skilled Network Engineer (L3) to join our team at Dimension Data. The successful candidate will be responsible for ensuring a high level of service to clients by proactively identifying and resolving technical incidents and problems.The role involves working closely with colleagues to ensure that assigned...

  • Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Decision Inc Full time

    Decision Inc. is a global management and technology consulting organization, helping companies become Data Driven Businesses that are fit to take on the challenges of a digital world.We're looking for a seasoned Data Architect to join our Data Information and Analytics team as a client-facing permanently employed consultant.About the RoleEngage with clients...