Data Engineer

3 days ago


Johannesburg, South Africa Discovery Full time

Achieve more than YOU BELIEVE

Discovery Corporate & Employee Benefits

Data Engineer (Junior)

About Discovery

Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, self-driven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.

About Discovery Corporate & Employee Benefits

Discovery Corporate and Employee Benefits is the first and only employee benefits provider to shape employee behaviour, creating healthier and wealthier workforces. It is an exciting business to be in as we reimagine the way retirement savings and life insurance are brought to companies and employees.

Key Purpose

The role entails building a reusable sustainable framework to ensure collection, processing, and availability of high-quality health care data to enable us to achieve the core purpose. The Data Engineer will work collaboratively with the Program Managers, Data Scientists, Systems Architects to define data sources and to build a custom data framework that facilitates Machine Learning, AI and productionising AI models based on the principles of ETL/ELT. Together these teams will enable data driven actionable insights.

Areas of responsibility may include but not limited to

- Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability.
- Develop and implement a reusable architecture of data pipelines to make data available for various purposes including Machine Learning (ML), Analytics and Reporting
- Work collaboratively as part of team engaging with system architects, data scientists and business in a healthcare context
- Define hardware, tools, and software to enable the reusable framework for data sharing and ML model productionization
- Work comfortably with structured and unstructured data in a variety of different programming languages such as SQL, R, python, Java etc
- Understanding of distributing programming and advising data scientists on how to optimally structure program code for maximum efficiency
- Build data solutions that leverage controls to ensure privacy, security, compliance, and data quality
- Understand meta-data management systems and orchestration architecture in the designing of ML/AI pipelines
- Deep understanding of cutting-edge cloud technology and frameworks to enable Data Science
- System integration skills between Business Intelligence and source transactional
- Improving overall production landscape as required
- Define strategies with Data Scientists to monitor model’s postproduction
- Write unit tests and participate in code reviews

Personal Attributes and Skills

- Exceptional analytical, conceptual thinking and problem solving skills
- Excellent oral and written communication skills.
- Ability to understand entity-relationship diagrams, normalized and de-normalized structures
- Excellent planning, organizational, and time management skills
- Scope and size BI initiatives.
- Work breakdown management
- Coach and co-ordinate team members
- Data manipulation, storytelling, and visualization
- Experience in Excel Pivot

Education and Experience

- Honours or Master’s degree in BSc Computer Science specialising in Data Science or Data Engineering (Honours or Master’s), IT degree, Data Engineering or related.
- Experience in data pipelines, data modelling and machine learning (advantageous).
- 3 - 5 years working experience.
- A working knowledge of the Operations environment throughout Employee Benefits – Compass or Sonata (advantageous).
- Expert in programming languages such as MS SQL, Oracle PL/SQL, DAX, MQL, SSIS, (Mongo Query Language) and (R, Python, Scala,.Net or Java).
- Essential skills required (MS SQL, Oracle PL/SQL, DAX, MQL).
- Expert database knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics and PowerBI.
- Modern Azure data warehouse skills.
- Expert Unix/Linux admin experience including shell script development (Not essential).
- Exposure to AI or Data modelling development.
- Experience working on OLTP systems.
- Experience working on large and complex datasets.
- Understanding and application of Big Data and distributed computing principles (Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure HDInsight and Azure Synapse Analytics).
- Data and ML model optimization skills in a production environment.
- Production environment machine learning and AI (advantageous).
- DevOps / DataOps and CI/CD experience (essential).
- AWS experience (advantageous).

Employment Equity

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.

EMPLOYMENT EQUITY

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.



  • Johannesburg, South Africa Dimension Data Full time

    **Data Governance Manager** The primary responsibility of Data Governance Manager is to coordinate, design, develop, direct, and oversee the implementation of the Data Governance Framework and do analysis and presentation on various area to ensure that Governance is adhered to, and Data Quality is positively affected by this. This position will manage the...

  • Data Anayst

    3 weeks ago


    Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience: Bachelors degree in computer science, Information Systems and/ or; Advanced computer literacy. Financial services knowledge. SDLC methodology knowledge. Minimum 5 years experience in financial services sector. Minimum 5 years experience in IT. Key Responsibilities:Collecting, cleaning, and organizing data from...

  • Data Anayst

    3 weeks ago


    Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience:Bachelors degree in computer science, Information Systems and/ or;Advanced computer literacy.Financial services knowledge.SDLC methodology knowledge.Minimum 5 years experience in financial services sector.Minimum 5 years experience in IT.Key Responsibilities:Collecting, cleaning, and organizing data from various...

  • Data Scientist

    3 months ago


    Johannesburg, South Africa NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...


  • Johannesburg, South Africa Axis Data Full time

    Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    About Data CentrixData Centrix is a leading provider of data-driven solutions, dedicated to empowering businesses with actionable insights.Job SummaryWe are seeking an experienced Data Insights Strategist to join our team. As a key member of our analytics department, you will be responsible for gathering, structuring, and analyzing complex data from various...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    At Data Centrix, we are seeking a highly skilled Data Solutions Architect to join our team. This is an exciting opportunity to work with cutting-edge technologies and contribute to the design of innovative data solutions.About the RoleWe are looking for a seasoned professional with expertise in data architecture, business analysis, and IT project management....


  • Johannesburg, South Africa Dimension Data Full time

    **Requirements**: - The Data Center Technician (DCT) responsibility is the maintenance of all Data Centre White Space, ensuring a 24/7 service offering within Internet Solutions Data Centers.The DCT provides a service to clients to ensure that their IT infrastructure and systems remain operational through proactively identifying, investigating and resolving...

  • Business Analyst

    3 weeks ago


    Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience: Bachelors degree in computer science, Information Systems and/ or; Diploma in Business Analysis from an IIBA endorsed education provider and/or; Valid CBAP or CCBA certification. Advanced computer literacy. Financial services knowledge. Advanced knowledge of the BABOK. SDLC methodology knowledge. Minimum 5 years...

  • Business Analyst

    3 weeks ago


    Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience:Bachelors degree in computer science, Information Systems and/ or;Diploma in Business Analysis from an IIBA endorsed education provider and/or;Valid CBAP or CCBA certification.Advanced computer literacy.Financial services knowledge.Advanced knowledge of the BABOK.SDLC methodology knowledge.Minimum 5 years experience in...

  • Data Engineer

    1 month ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...

  • Data Engineer

    2 months ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    As a Data Engineer, you will: - Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment. - Collaborate with clients to understand their requirements and translate them into scalable data solutions. - Aggregate, store, and manage data from various sources, ensuring...

  • Data Engineer

    1 month ago


    Johannesburg, South Africa Network Recruitment Full time

    A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...


  • Johannesburg, South Africa Dimension Data Full time

    As a **Networking Data Centre Engineer **you will be responsible for the management of all aspects of the company’s IT infrastructure and its users. You'll ensure that our systems are running smoothly, that our network is secure and reliable, and that we're always up to date with software patches. You'll also ensure your team has enough technical expertise...


  • Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience: Matric plus Bachelors degree in computer science, Information Systems and/ or; Diploma in Business Analysis from an IIBA endorsed education provider and/or; Valid CBAP or CCBA certification. Advanced computer literacy. Financial services knowledge. Advanced knowledge of the BABOK. SDLC methodology knowledge....


  • Johannesburg, South Africa Data Centrix Full time

    Qualifications / Knowledge / Experience:Matric plus Bachelors degree in computer science, Information Systems and/ or;Diploma in Business Analysis from an IIBA endorsed education provider and/or;Valid CBAP or CCBA certification.Advanced computer literacy.Financial services knowledge.Advanced knowledge of the BABOK.SDLC methodology knowledge.Minimum 5 years...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job Title: Lead Software EngineerWe are seeking an experienced and skilled Lead Software Engineer to join our team at Data Centrix. About the Role:As a Lead Software Engineer, you will be responsible for researching, designing, implementing, and maintaining software programs and services.You will create and maintain database tables, functions, and stored...

  • Data Engineer

    2 months ago


    Johannesburg, South Africa Network Recruitment Full time

    As a Data Engineer, you will:Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment.Collaborate with clients to understand their requirements and translate them into scalable data solutions.Aggregate, store, and manage data from various sources, ensuring...

  • Data Engineer

    2 months ago


    Johannesburg, South Africa Network Recruitment Full time

    As a Data Engineer, you will:Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment. Collaborate with clients to understand their requirements and translate them into scalable data solutions. Aggregate, store, and manage data from various sources, ensuring...

  • Data Engineer

    2 months ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    What you will be doing - The ideal candidate will have extensive experience in data engineering, particularly with Ab Initio, and will be responsible for designing, developing, and maintaining the data infrastructure. - Design, build, and maintain scalable data pipelines using Ab Initio. - Develop ETL processes to extract, transform, and load data from...