Big Data Administrator

2 months ago

Sandton, South Africa Discovery Ltd. Full time

**Business Unit**:Discovery Health**Function**:Information Technology**Date**:4 Nov 2024Discovery - Health Systems (DHS)

Big Data Administrator
- About Discovery
Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, selfdriven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.- About Discovery Health Systems (DHS)
The Discovery Health Systems (DHS) is a world class software development house that enables the Discovery Health Business to use digital transformation as a competitive advantage. It focuses on rapid quality software delivery. Innovation and excellence are key attributes to all our initiatives. The skills and expertise in the team allows a diverse product development on all strategic, tactical and operational changes. Our environment is fast-paced and demands energy, drive, enthusiasm, ownership and creativity, but it rewards with an extremely fulfilling and stimulating environment that actively supports career growth and development.- Key Purpose
To join our Enterprise Architecture team (System Architects, Enterprise Architects, Developers) with the responsibility of understanding the overall business needs and the requirements. The primary responsibility of this role is to have deep understanding and be able to perform the admin tasks for the Big Data environment.- Areas of responsibility may include but not limited to
- Be able to perform installations from scratch
- Handle all key server integration and HA responsibilities
- Setup the Kerberos dependencies and necessary configuration
- Create and manage users / groups
- Manage the security roles - AD as well as Sentry / Ranger and OS
- Understand all admin modules, ingestion pipeline as well as monitoring requirements
- Be able to perform troubleshooting e.g. identifying unhealthy / problematic modules in the context of an issue / problem resolution
- Handle partitioning and indexing requirements with the objective not to compromise performance
- Have excellent in depth OS knowledge and handle any OS level scripting requirements
- Provide the necessary OS training / knowledge transfer to the Junior Administrators
- Mange the TCP proxy and any firewall port requirements
- Plan and provision new hardware as required.]
- Execute the BigData hybrid strategy e.g. seamless on premise and in the cloud cluster integration
- Personal Attributes and Skills
- Technology savvy person with real hunger for acquiring technology knowledge
- Ability and willingness to do research and do remote courses
- Fast learner
- Learning is regarded as a hobby
- Really driven individual
- Ability to work under stress
- Self-starter
- Education and Experience
- BSc Computer Science or equivalent 3-year IT qualification
- 2 years’ experience in a Chief Technology Office working on the Big Data environment
- Cloudera|Hortonworks|Linux (RedHat) Certification - advantageous
- Understanding of and experience in distributed architecture working with Python, JVM and multithreading
- Good experience in partitioning and sharding
- Good experience in Datacenter architecture and processes working on racks, servers and wiring
- Good understanding of network - topology, VLANs, switches, routers including firewalls (Kerberos, PKI)
- Experience working with AD forest and LDAP including strong operating systems such as Linux (RedHat)
- A good grasp of Cloud infrastructure (preferably AWS) architecture, provisioning and operating
- Experience and knowledge of tools such as HBase, HDFS, Spark, Map Reduce, Zookeeper, YARN, Kafka, NiFi
- Strong experience in TCP, UDP, multicast
- Entry level knowledge of containers (Kubernetes and Docker)
- EMPLOYMENT EQUITY

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.

  • Big Data Infrastructure Specialist

    3 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    Designing and Delivering Data Engineering SolutionsWe are seeking an experienced Data Engineer to join our team at Datonomy Solutions. As a key member of our team, you will be responsible for designing, developing, and maintaining our data infrastructure.About Our TeamOur team of experts is dedicated to delivering innovative solutions that meet the evolving...

  • Lead Hadoop Administrator

    3 months ago

    Sandton, South Africa Absa Bank Limited Full time

    Empowering Africa’s tomorrow, together one story at a time. - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group. Job...

  • Big Data Architecture Developer

    3 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    Are you an experienced Data Engineer looking for a new challenge? We are seeking a skilled professional to join our team in Johannesburg and contribute to the design and development of our data infrastructure.You will be responsible for developing and maintaining data pipelines using Ab Initio and other technologies, as well as collaborating with...

  • Data Scientist

    5 days ago

    Sandton, South Africa e-Merge IT Recruitment Full time

    **Requirements**: - A minimum of 4 years’ experience in Data Science role - Experience with R, Python, Matlab is required - Experience in programming in C# or C++, Java. - Experience working with large scale data etc. - Experience With Cloud Data Engineering Technologies Is Advantageous - Implement complex data projects - Modelling and visualising large...

  • Data Engineer

    2 months ago

    Sandton, South Africa Jobted ZA C2 Full time

    We are looking for Data Engineers to join our team based in JHB- onsite. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and maintaining the data infrastructure. Qualifications: Education: Bachelors or Masters degree in Computer...

  • Data Administrator

    2 days ago

    Sandton, South Africa Discovery Ltd. Full time

    **Business Unit**:Discovery Employee Benefits **Function**:Data Analysis **Date**:13 Jun 2024 - Achieve more than**YOU BELIEVE** - Discovery Corporate and Employee Benefits - Data Administrator **About Discovery** - Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional...

  • Data Engineer

    2 months ago

    Sandton, South Africa Datonomy Solutions Full time

    We are looking for Data Engineers to join our team based in JHB- onsite. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and maintaining the data infrastructure. Qualifications: Education: Bachelors or Masters degree in Computer...

  • Data Engineer

    2 months ago

    Sandton, South Africa Datonomy Solutions Full time

    We are looking for Data Engineers to join our team based in JHB- onsite.The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and maintaining the data infrastructure.Qualifications: Education: Bachelors or Masters degree in Computer Science,...

  • Data Strategist

    2 days ago

    Sandton, South Africa Profile Personnel Full time

    **Data Strategist **required for an Automotive Manufacturing company based in **Sandton, Gauteng.** **Job Duties**: Responsible to provide a holistic view of the organization’s use of data by interpreting all of its current usage and providing a future oriented, strategic plan as well as translating the requirements of executives, managers into concrete...

  • Data Strategist

    2 days ago

    Sandton, South Africa Volkswagen Group Full time

    **Job Description and Responsibilities**: - As the expert on latest technology trends & products in the space of (big) data, analytics, ad-tech, machine learning and AI, be a thought-partner for managers and executives by bridging market trends to their specific challenges, dynamics, limitations & ambitions. - Guide the organization from the maze of...

  • Data Science Head

    1 week ago

    Sandton, South Africa FirstRand Full time

    About us, purpose, experience and qualifications **about us**: - make a promise - be deeply invested - value our differences - build trust, not territory - have courage - always do the right thing **purpose**: To implement the Analytics standards across big complex business areas, that contribute to the monetisation of data through the development and...

  • Data Infrastructure Specialist

    3 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    Data Engineers at Datonomy Solutions design and develop complex data infrastructures that support business-critical applications. If you have extensive experience with Ab Initio, SQL, and big data technologies, we invite you to apply for this challenging role.This position requires a strong understanding of data modeling, data warehousing, and data...

  • Data Strategist

    6 days ago

    Sandton, South Africa RMG Recruitment (Pty) Ltd Full time

    Based in Sandton, the position is responsible to provide a holistic view of the organization’s use of data by interpreting all of its current usage and providing a future oriented, strategic plan as well as translating the requirements of executives, managers into concrete data-driven initiatives and specific actions. **Job Description and...

  • Junior Data Scientist

    4 weeks ago

    Sandton, South Africa Discovery Ltd. Full time

    **Business Unit**:Discovery Health **Function**:Data Sciences **Date**:13 Dec 2024 Discovery Health Junior Data Scientist - About Discovery - Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values...

  • Master Data Administrator

    5 days ago

    Sandton, South Africa Innate Med (Pty) Ltd. Full time

    Minimum certificate in IT Management and/or Information Technology Minimum of 3 years experience as a master data administrator Knowledge of SysPro would be advantageous **Job Types**: Full-time, Permanent Ability to commute/relocate: - Sandton, Gauteng: Reliably commute or planning to relocate before starting work (required)

  • Data Strategist

    7 days ago

    Sandton, South Africa Staff Solutions Full time

    Gauteng, Sandton - Monthly Cost To Company (Market related) Our well known and much loved OEM has a position for a Data Strategist. Based in Sandton, the position is responsible to provide a holistic view of the organization’s use of data by interpreting all of its current usage and providing a future oriented, strategic plan as well as translating the...

  • Data Analyst

    2 months ago

    Sandton, South Africa Discovery Ltd. Full time

    **Business Unit**:Discovery Health**Function**:Data Analysis**Date**:25 Oct 2024 Discovery Health Data Analyst - About Discovery - Discovery’s core purpose is to enhance and protect people’s lives. It does this through breakthrough product designs that harness incentives to encourage people to make healthier lifestyle choices. Healthy behaviour leads...

  • Senior Data Systems Engineer

    3 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    We are seeking a highly skilled Senior Data Systems Engineer to lead our data infrastructure development in Johannesburg.As a key member of our team, you will design and implement efficient data pipelines using Ab Initio and other technologies. Your expertise in SQL, big data, and cloud platforms such as Azure is crucial to the success of this role.The ideal...

  • Data Systems Architect

    3 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    Company OverviewDatonomy Solutions is a leading provider of data engineering services. Our team of experts is dedicated to delivering innovative solutions that meet the evolving needs of our clients.Estimated Salary: R 600,000 - R 900,000 per annumJob Description:We are seeking an experienced Data Engineer to join our team based in Johannesburg. The...

  • Internship: Data Analyst

    4 months ago

    Sandton, South Africa Discovery Ltd. Full time

    **Business Unit**:Discovery Central Services**Function**:Data Analysis**Date**:25 Sep 2024- Discovery Health Data Analyst**About Discovery** - Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align...