Data Engineer

3 weeks ago


Johannesburg, Gauteng, South Africa Nedbank Full time
Job title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended Links
  • Jobs by Location
  • Job by industries

Job Purpose

  • The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank's strategy to become a data driven organisation.

Job Responsibilities

  • Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank's operational and analytics databases.
  • Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastucture eg using Infrastructure and Databases (DB2, PostgreSQL, MSSQL, HBase, NoSQL, etc), Data Lakes Storage (Azure Data Lake Gen 2), Cloud-based solutions (SAS , Azure Databricks, Azure Data Factory, HDInsight), Data Platforms (SAS, Ab Initio, Denodo, Netezza, Azure Cloud). Ensure data security and privacy in collaboration with Information Security, CISO and Data Governance
  • Data Pipeline Build (Ingestion, Provisioning, Streaming and API): Build and maintain data pipelines to:
  •  create data pipelines for data integration (Data Ingestion, Data Provisioning and Data Streaming) utilising both On Premise tool sets and Cloud Data Engineering tool sets
  • efficiently extract data (Data Acquisition) from Golden Sources, Trusted sources and Writebacks with data integration from multiple sources, formats and structures
  • load the Nedbank Data Warehouse (Data Reservoir, Atomic Data Warehouse, Enterprise Data Mart) 
  • provide data to the respective Lines of Business Marts, Regulatory Marts and Compliance Marts through self service data virtualisation
  • provide data to applications or Nedbank Data consumers
  • transform data to a common data model for reporting and data analysis, and to provide data in a consistent, useable format to Nedbank data stakeholders
  • handle big data technologies (Hadoop), streaming (KAFKA) and data Replication (IBM Inphosphere Data Replication)
  • drive utilisation of data integration tools ( Ab Initio) and Cloud data integration tools (Azure Data Factory and Azure Data Bricks)
  • Data Modelling and Schema Build: In collaboration with Data Modellers, create data models and database schemas on the Data Reservoir, Data Lake, Atomic Data Warehouse and Enterprise Data Marts.
  • Nedbank Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines.
  • Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientistsm Scrum Masers and Data Warehouse teams as part of a squad to contribute to the data architecture detail designs and take ownership of Epics end-to-end and ensure that data solutions deliver business value.
  • Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented in the data pipelines to maintain a high level of data accuracy, consistency and security.
  • Performance and Optimisation: Ensure the performance of the Nedbank data warehouse, integration patterns, batch and real time jobs, streaming and API's.
  • API Development: Build API's that enable the Data Driven Organisation, ensuring that the data warehouse is optimised for API's by collaborating with Software Engineers.

Essential Qualifications - NQF Level

  • Matric / Grade 12 / National Senior Certificate
  • Advanced Diplomas/National 1st Degrees

Preferred Qualification

  • Field of Study: Bcom, BSc, BEng

Preferred Certifications

  • Cloud (Azure, AWS), DEVOPS or Data engineering certification.
  • Any Data Science certification will be an added advantage, Coursera, Udemy, SAS Data Scientist certification, Microsoft Data Scientist. 

Minimum Experience Level

  • Total number of years of experience:3 - 6 years
  • Experienced at working independently within a squad and has the demonstrated knowledge and skills to deliver data outcomes without supervision.
  • Experience designing, building, and maintaining data warehouses and data lakes.
  • Experience with big data technologies such as Hadoop, Spark, and Hive.
  • Experience with programming languages such as Python, Java, and SQL.
  • Experience with relational databases and NoSQL databases.
  • Experience with cloud computing platforms such as AWS, Azure, and GCP.
  • Experience with data visualization tools.
  • Result-driven, analytical creative thinker, with demonstrated ability for innovative problem solving.   
  • Research / Data Analysis  jobs


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year contractHybrid RoleJohannesburgJob Summary We are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    The Cloud Data Architect will be responsible for designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureEnsure data quality, integrity, and security across all data processing workflows.Implement data governance,...

  • Cloud Data Architect

    14 hours ago


    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a skilled Big Data and AI Developer to join our team. The ideal candidate has strong experience in data engineering, analytics, and BI development, with expertise in SQL, Python, ETL processes, and big data platforms.Data Engineering & ArchitectureDesign, develop, and maintain scalable and efficient ETL pipelines for data ingestion,...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    As a Senior Data Science Specialist at Gig Engineer, you will play a critical role in driving data-driven decision-making across the organization. This senior-level position requires expertise in designing, building, and maintaining scalable and efficient ETL pipelines for data ingestion, transformation, and storage.Data Engineering & ArchitectureDesign and...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a talented Cloud Data Architect to lead our cloud-based data solutions. The successful candidate will have experience in designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureCollaborate with Data...


  • Johannesburg, Gauteng, South Africa Vantage Data Centers Full time

    Key Responsibilities:Ensure that all assets receive the necessary life cycle and enhancement services.Ensure that assets are controlled, operated and to the necessary operational specifications.Ensure that all engineering services are always efficiently, effectively maintained, and controlled according to the client's specifications as stated in the...

  • Data Analyst

    2 weeks ago


    Johannesburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Key Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job SummaryWe are seeking a highly skilled Infrastructure Engineer to join our team at Data Centrix. The successful candidate will be responsible for designing, implementing and maintaining our network infrastructure. This is a challenging role that requires strong technical skills and attention to detail.


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Inherent RequirementsAt least 10 years of hands-on involvement in data science projects, including managing large-scale initiatives and leading multidisciplinary teams.Degree (Honours, Masters or PHD) in quantitative fields such as Actuarial Science, Statistics, Computer Science, Engineering, Mathematics and/or combination of these.Proven expertise in data...

  • Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications:Bachelors Degree in Computer Science, Computer Engineering, or related...


  • Johannesburg, Gauteng, South Africa Vantage Data Centers Full time

    Vantage Data Centers is a leading provider of data center solutions, committed to delivering high-quality services to our clients. As a critical facilities engineer lead, you will play a key role in ensuring the optimal operation of our data center infrastructure.Job SummaryWe are seeking a highly skilled and motivated individual to join our team as a lead...

  • Data Engineer

    1 week ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications: Bachelors Degree in Computer Science, Computer Engineering, or a related...

  • Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    5 days ago


    Johannesburg, Gauteng, South Africa Isilumko Staffing (JHB) Full time

    The Group Data and Analytics Office is on the lookout for a skilled Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL, and Oracle, and will be responsible for designing, developing, and maintaining the data infrastructure.Key ResponsibilitiesDesign, build, and maintain scalable data...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa CrossBoundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind...


  • Johannesburg, Gauteng, South Africa Vantage Data Centers Full time

    Vantage Data Centers is a global leader in data center solutions, dedicated to delivering exceptional services to our clients. We are seeking a talented and experienced lead critical facilities engineer to join our team.About UsWe power, cool, protect and connect the technology of the world's well-known hyperscalers, cloud providers and large enterprises....

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Ananzi Full time

    Data EngineerCrossBoundary EnergyAbout the FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements.With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind generation, approximately 600MWh of...

  • Data Engineer

    5 days ago


    Johannesburg, Gauteng, South Africa Psybergate (Pty) Ltd Full time

    Psybergate - Data EngineerReference: PR000446-RN-3Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a Data Engineer to join our financial services client based in Sandton for a 12-month contract role.Duties & ResponsibilitiesWhat you will be doing / What we are looking...

  • Data Engineer

    4 weeks ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job & Company Description An industry requiring specialist skills, deserves specialist recruitment.I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority.This will allow me to enhance your current skills...