Data Pipeline Developer

4 days ago


Sandton, South Africa Tech Sight (Pty) Ltd Full time

About this Opportunity:

Tech Sight (Pty) Ltd is seeking a highly skilled Principal Ab Initio Data Engineer to join their team. As a key member of the team, you will be responsible for designing, building, and maintaining scalable Ab Initio data pipelines and ETL processes that meet business requirements.

Responsibilities:

  • Design and implement advanced data engineering solutions using Ab Initio, ensuring scalability and reliability.
  • Develop automated solutions to streamline deployments and data extraction, integrating with existing systems.
  • Optimize data storage, retrieval, and processing for efficiency, improving system performance.
  • Collaborate with analysts and stakeholders to translate data needs into scalable solutions that meet business objectives.

Requirements:

  • 15+ years of experience in data engineering and ETL development, with expertise in Ab Initio and its ecosystem.
  • Strong coding skills in SQL and scripting languages, including Python and R.
  • Experience with Big Data & Cloud technologies, including Hadoop, Spark, Hive, and Azure cloud deployments.
  • Ability to develop complex automation processes that integrate with various systems.
  • Understanding of data governance and security best practices, ensuring data integrity and confidentiality.

Benefits:

  • Competitive compensation package that supports your professional growth.
  • Opportunities for career advancement and professional development.
  • A collaborative work environment that values expertise and innovation.

Join Tech Sight and drive innovation in the banking industry.

Seniority level

Mid-Senior level

Employment type

Contract

Industries

IT Services and IT Consulting


  • Solution Analyst

    3 weeks ago


    Sandton, South Africa Dimension Data Full time

    **Requirements - Ensure successful implementation and embedment of effective DevOps solutions (i.e. SAST, DAST, CWPP, SCA, etc) - Assist the Engineering and Development teams to build effective and secure CI/CD pipelines, assisting in the configuration and maintenance of the pipelines - shifting security left - Ensure that capabilities are deployed through a...


  • Sandton, South Africa Steinmüller Africa Full time

    Job SummaryWe are looking for a highly motivated Pipeline Systems Designer to join our team at Steinmüller Africa. The successful candidate will be responsible for designing, analyzing and maintaining piping systems to ensure code compliance and cost effectiveness in terms of implementation and operation.Main Responsibilities:Developing piping system...


  • Sandton, South Africa DeARX Full time

    About DeARXWe are a leading bank in Sandton, and we're looking for a talented Data Engineer to join our team.You will be responsible for designing, developing, and optimizing data pipelines using Ab Initio. You will also work closely with data scientists, analysts, and stakeholders to address data needs and ensure seamless integration.Key...

  • Hadoop Data Engineer

    2 weeks ago


    Sandton, South Africa DeARX Full time

    Exciting Opportunity: Data Engineer at a Leading BankRef: 4046Contract Period: 01/10/2024 to 30/09/2025Location: Hybrid (3 days onsite in Sandton, 2 days remote)Application Deadline: 12/09/2024Are you a talented Data Engineer with expertise in Ab Initio? Join a prestigious bank in Sandton and play a key role in transforming their data infrastructure. If...


  • Sandton, South Africa TalentCru Full time

    Key Responsibilities:Managing application and submission processesBasic deal assessment prior to accepting deals into the pipeline for evaluation and due diligenceDeal evaluation and due diligence according to the current IDC definitionEnsuring deals align with the fund's strategic objectives and contribute to meeting industry development goalsIdentifying...


  • Sandton, South Africa DeARX Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team in Sandton. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing data pipelines using Ab Initio.Main Responsibilities:Design and develop data pipelines using Ab Initio.Develop efficient ETL processes.Work closely with data...


  • Sandton, South Africa IDC Full time

    **Synopsis** This position exists within the Infrastructure Pipeline Development and Management Unit in Infrastructure Pipeline Development at Infrastructure South Africa under the PICC (Presidential Infrastructure Coordinating Commission) Offices in Sandton and Pretoria. **Job Description** JOB PURPOSE**: The availability of a comprehensive and robust...


  • Sandton, South Africa Discovery Limited Full time

    Company OverviewDiscovery Limited is committed to creating long-lasting solutions that meet essential business needs. Our dedicated team of experts focuses on harnessing the power of data to drive business success.Data Science Job DescriptionThis role involves developing data science models and A/B testing pipelines for deployment. You will work closely with...


  • Sandton, South Africa Copious Software Full time

    Drive Business Growth with Data InsightsCopious Software is dedicated to helping businesses grow by providing high-value technology services. As a Solution Engineer in the Data vertical, you will play a crucial role in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Your responsibilities will include creating and...


  • Sandton, South Africa Copious Software Full time

    Transform Your Career with Copious SoftwareWe're a Talent & Technology services company that believes in empowering businesses to thrive in today's fast-paced world. As a Solution Engineer in the Data vertical, you will have the opportunity to design, implement, and manage data solutions on the Microsoft Azure cloud platform.You will work closely with data...


  • Sandton, South Africa Copious Software Full time

    Shape the Future of Business with Data-Driven InsightsCopious Software is committed to helping businesses grow through high-value technology services. As a Solution Engineer in the Data vertical, you will play a vital role in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.You will be responsible for creating and...


  • Sandton, South Africa ProDevelopment Group Full time

    Software Development Role: Data Engineering ProfessionalWe are seeking a highly skilled Data Engineering Professional to join our team at ProDevelopment Group in Johannesburg Metro.This 12-month contract position requires full-time hours and offers an exciting opportunity to work on challenging projects and collaborate with cross-functional teams.The...


  • Sandton, South Africa ProDevelopment Group Full time

    Job Description: Data Engineering ProfessionalWe are seeking a highly skilled Data Engineering Professional to join our team at ProDevelopment Group in Johannesburg Metro.This 12-month contract position requires full-time hours and offers an exciting opportunity to work on challenging projects and collaborate with cross-functional teams.The successful...


  • Sandton, South Africa Core Group Full time

    As a Senior Business Intelligence Manager, you will lead our business intelligence efforts, managing a dynamic team while leveraging your expertise in various data tools. You will be responsible for designing and implementing robust BI solutions, overseeing the creation and management of data pipelines, and ensuring the team delivers valuable insights to...


  • Sandton, South Africa Copious Software Full time

    Unlock the Power of Cloud DataCopious Software is a pioneering Talent & Technology services company that empowers businesses to thrive in today's fast-paced world. We're on a mission to revolutionize the economic and technology landscape, and we need talented professionals like you to join our team.As a Solution Engineer in the Data vertical, you will be...

  • BI Data Analyst

    5 days ago


    Sandton, South Africa Nedbank Head Office Full time

    Requisition Details & Talent Acquisition Contact XXX-XXXX- Tshego Semenya Location: Sandton Closing date: 19 February 2025 Cluster RBB Career Stream It Application Development Leadership Pipeline Manage Self: Technical Position BI Data Analyst Why join our team Join a forward-thinking team at Nedbank where innovation and continuous improvement are at the...


  • Sandton, South Africa Absa Bank Limited Full time

    Bring your possibility to life! Define your career with us - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.Job Summary Team...

  • Data Engineer

    1 week ago


    Sandton, South Africa Brambles Full time

    CHEP helps move more goods to more people, in more places than any other organization on earth via our 347 million pallets, crates and containers. We employ approximately 13,000 people and operate in 60 countries. Through our pioneering and sustainable share-and-reuse business model, the world's biggest brands trust us to help them transport their goods more...

  • Senior Data Scientist

    3 weeks ago


    Sandton, South Africa Blue Label Telecoms Full time

    **About company** BluNova is a subsidiary of Blue Label Telecoms responsible for drawing value from its large heterogeneous corpus of data originating from multiple companies within the Blue Label group. With this data, we identify opportunities in the market and develop sustainable solutions to exploit these opportunities. We leverage scalable cloud...

  • Senior Data Scientist

    2 weeks ago


    Sandton, South Africa Blue Label Telecoms Full time

    **About company** BluNova is a subsidiary of Blue Label Telecoms responsible for drawing value from its large heterogeneous corpus of data originating from multiple companies within the Blue Label group. With this data, we identify opportunities in the market and develop sustainable solutions to exploit these opportunities. We leverage scalable cloud...