Data Engineer

2 weeks ago

Johannesburg, Gauteng, South Africa Nedbank Full time
Job title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended Links
  • Jobs by Location
  • Job by industries

Job Purpose

  • The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank's strategy to become a data driven organisation.

Job Responsibilities

  • Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank's operational and analytics databases.
  • Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastucture eg using Infrastructure and Databases (DB2, PostgreSQL, MSSQL, HBase, NoSQL, etc), Data Lakes Storage (Azure Data Lake Gen 2), Cloud-based solutions (SAS , Azure Databricks, Azure Data Factory, HDInsight), Data Platforms (SAS, Ab Initio, Denodo, Netezza, Azure Cloud). Ensure data security and privacy in collaboration with Information Security, CISO and Data Governance
  • Data Pipeline Build (Ingestion, Provisioning, Streaming and API): Build and maintain data pipelines to:
  •  create data pipelines for data integration (Data Ingestion, Data Provisioning and Data Streaming) utilising both On Premise tool sets and Cloud Data Engineering tool sets
  • efficiently extract data (Data Acquisition) from Golden Sources, Trusted sources and Writebacks with data integration from multiple sources, formats and structures
  • load the Nedbank Data Warehouse (Data Reservoir, Atomic Data Warehouse, Enterprise Data Mart) 
  • provide data to the respective Lines of Business Marts, Regulatory Marts and Compliance Marts through self service data virtualisation
  • provide data to applications or Nedbank Data consumers
  • transform data to a common data model for reporting and data analysis, and to provide data in a consistent, useable format to Nedbank data stakeholders
  • handle big data technologies (Hadoop), streaming (KAFKA) and data Replication (IBM Inphosphere Data Replication)
  • drive utilisation of data integration tools ( Ab Initio) and Cloud data integration tools (Azure Data Factory and Azure Data Bricks)
  • Data Modelling and Schema Build: In collaboration with Data Modellers, create data models and database schemas on the Data Reservoir, Data Lake, Atomic Data Warehouse and Enterprise Data Marts.
  • Nedbank Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines.
  • Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientistsm Scrum Masers and Data Warehouse teams as part of a squad to contribute to the data architecture detail designs and take ownership of Epics end-to-end and ensure that data solutions deliver business value.
  • Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented in the data pipelines to maintain a high level of data accuracy, consistency and security.
  • Performance and Optimisation: Ensure the performance of the Nedbank data warehouse, integration patterns, batch and real time jobs, streaming and API's.
  • API Development: Build API's that enable the Data Driven Organisation, ensuring that the data warehouse is optimised for API's by collaborating with Software Engineers.

Essential Qualifications - NQF Level

  • Matric / Grade 12 / National Senior Certificate
  • Advanced Diplomas/National 1st Degrees

Preferred Qualification

  • Field of Study: Bcom, BSc, BEng

Preferred Certifications

  • Cloud (Azure, AWS), DEVOPS or Data engineering certification.
  • Any Data Science certification will be an added advantage, Coursera, Udemy, SAS Data Scientist certification, Microsoft Data Scientist. 

Minimum Experience Level

  • Total number of years of experience:3 - 6 years
  • Experienced at working independently within a squad and has the demonstrated knowledge and skills to deliver data outcomes without supervision.
  • Experience designing, building, and maintaining data warehouses and data lakes.
  • Experience with big data technologies such as Hadoop, Spark, and Hive.
  • Experience with programming languages such as Python, Java, and SQL.
  • Experience with relational databases and NoSQL databases.
  • Experience with cloud computing platforms such as AWS, Azure, and GCP.
  • Experience with data visualization tools.
  • Result-driven, analytical creative thinker, with demonstrated ability for innovative problem solving.   
  • Research / Data Analysis  jobs

  • Data Analyst

    4 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...

  • Data Insights Analyst

    4 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    About the RoleThe Data Analyst will play a crucial role in driving business growth by providing insights and recommendations based on data analysis.Key Responsibilities include:Collecting, organizing, analyzing, and disseminating information to support business decision-makingResolving data queries, report writing, and presenting findings to...

  • Analytical Data Solutions Provider

    4 days ago

    Johannesburg, Gauteng, South Africa Data Bene Full time

    About the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...

  • Data Protection Lead/Manager

    3 weeks ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Key Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...

  • Data Science and Analytics Manager

    5 days ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Inherent RequirementsAt least 10 years of hands-on involvement in data science projects, including managing large-scale initiatives and leading multidisciplinary teams.Degree (Honours, Masters or PHD) in quantitative fields such as Actuarial Science, Statistics, Computer Science, Engineering, Mathematics and/or combination of these.Proven expertise in data...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business. Key Responsibilities: Implement...

  • Data Engineer

    12 hours ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications:Bachelors Degree in Computer Science, Computer Engineering, or related...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    We are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for youQualifications: BSc in Computer Science, Information Systems, Engineering, or a related...

  • Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa CrossBoundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind...

  • Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Ananzi Full time

    Data EngineerCrossBoundary EnergyAbout the FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements.With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind generation, approximately 600MWh of...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job & Company Description An industry requiring specialist skills, deserves specialist recruitment.I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority.This will allow me to enhance your current skills...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Edge Executives Full time

    We are seeking a skilled Data Engineer to design and optimize scalable data infrastructure for AI, machine learning, and generative AI initiatives. This role involves building ETL/ELT pipelines, managing AWS-based data systems, and collaborating with cross-functional teams to develop cutting-edge solutions. Ideal candidates will have experience in AWS...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    An industry requiring specialist skills, deserves specialist recruitment. I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority. This will allow me to enhance your current skills within the FMCG, Manufacturing...

  • Data Systems Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing and analytics systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams...

  • Engineer, Data

    2 weeks ago

    Johannesburg, Gauteng, South Africa Standard Bank Group Full time

    Job title : Engineer, DataJob Location : Gauteng, JohannesburgDeadline : April 04, 2025Quick Recommended LinksJobs by Location Job by industries Job DescriptionTo design, code, verify, test, document, amend, and secure data pipelines and data stores according to agreed architecture, solution designs, standards, policies and governance requirements. To...

  • Data Engineering Lead

    4 days ago

    Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to...

  • Senior Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...