Big Data Administrator

3 weeks ago

Sandton, South Africa Discovery Ltd. Full time

**Business Unit**:Discovery Health**Function**:Information Technology**Date**:4 Nov 2024Discovery - Health Systems (DHS)

Big Data Administrator
- About Discovery
Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, selfdriven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.- About Discovery Health Systems (DHS)
The Discovery Health Systems (DHS) is a world class software development house that enables the Discovery Health Business to use digital transformation as a competitive advantage. It focuses on rapid quality software delivery. Innovation and excellence are key attributes to all our initiatives. The skills and expertise in the team allows a diverse product development on all strategic, tactical and operational changes. Our environment is fast-paced and demands energy, drive, enthusiasm, ownership and creativity, but it rewards with an extremely fulfilling and stimulating environment that actively supports career growth and development.- Key Purpose
To join our Enterprise Architecture team (System Architects, Enterprise Architects, Developers) with the responsibility of understanding the overall business needs and the requirements. The primary responsibility of this role is to have deep understanding and be able to perform the admin tasks for the Big Data environment.- Areas of responsibility may include but not limited to
- Be able to perform installations from scratch
- Handle all key server integration and HA responsibilities
- Setup the Kerberos dependencies and necessary configuration
- Create and manage users / groups
- Manage the security roles - AD as well as Sentry / Ranger and OS
- Understand all admin modules, ingestion pipeline as well as monitoring requirements
- Be able to perform troubleshooting e.g. identifying unhealthy / problematic modules in the context of an issue / problem resolution
- Handle partitioning and indexing requirements with the objective not to compromise performance
- Have excellent in depth OS knowledge and handle any OS level scripting requirements
- Provide the necessary OS training / knowledge transfer to the Junior Administrators
- Mange the TCP proxy and any firewall port requirements
- Plan and provision new hardware as required.]
- Execute the BigData hybrid strategy e.g. seamless on premise and in the cloud cluster integration
- Personal Attributes and Skills
- Technology savvy person with real hunger for acquiring technology knowledge
- Ability and willingness to do research and do remote courses
- Fast learner
- Learning is regarded as a hobby
- Really driven individual
- Ability to work under stress
- Self-starter
- Education and Experience
- BSc Computer Science or equivalent 3-year IT qualification
- 2 years’ experience in a Chief Technology Office working on the Big Data environment
- Cloudera|Hortonworks|Linux (RedHat) Certification - advantageous
- Understanding of and experience in distributed architecture working with Python, JVM and multithreading
- Good experience in partitioning and sharding
- Good experience in Datacenter architecture and processes working on racks, servers and wiring
- Good understanding of network - topology, VLANs, switches, routers including firewalls (Kerberos, PKI)
- Experience working with AD forest and LDAP including strong operating systems such as Linux (RedHat)
- A good grasp of Cloud infrastructure (preferably AWS) architecture, provisioning and operating
- Experience and knowledge of tools such as HBase, HDFS, Spark, Map Reduce, Zookeeper, YARN, Kafka, NiFi
- Strong experience in TCP, UDP, multicast
- Entry level knowledge of containers (Kubernetes and Docker)
- EMPLOYMENT EQUITY

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.

  • Big Data Solutions Engineer

    4 hours ago

    Sandton, South Africa Absa Group Full time

    Unlocking Big Data Potential at Absa GroupWe are looking for a talented Full Stack Developer to join our Big Data team in CIB Technology. As a Full Stack Developer, you will be responsible for building high-performing, scalable, enterprise-grade applications and leading all phases of the development lifecycle to deliver.Key AccountabilitiesYou will involve...

  • Big Data Services Lead

    4 weeks ago

    Sandton, South Africa Absa Bank Limited Full time

    Bring your possibility to life! Define your career with us - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.Job Summary Team...

  • Big Data Developer Lead

    5 days ago

    Sandton, South Africa Absa Group Full time

    Job DescriptionThis role involves designing, developing, and supporting an Enterprise Infrastructure Big Data Service using Hadoop and Kafka. The successful candidate will be responsible for building and maintaining a real-time streaming platform used by the Absa data engineering community.

  • Big Data Software Engineer Lead

    5 days ago

    Sandton, South Africa Absa Group Full time

    Why Choose Us?Absa Group offers a culture of learning, trust, empowerment, flexibility, recognition, work-life harmony, and diversity & inclusion.We provide great opportunities for professional growth and development, including access to innovative technology and tools.Key Accountabilities:Involve the design, development, automation, testing, and ongoing...

  • Lead Big Data and Business Intelligence Specialist

    4 hours ago

    Sandton, South Africa DeARX Full time

    Role OverviewWe are seeking a skilled Data Engineer to join our team at DeARX. The successful candidate will have a strong background in data engineering, analytics, and business intelligence, with expertise in the following tools and technologies: Power BI, Python, SQL, QlikView, and Hadoop. They will design, develop, and maintain scalable data pipelines...

  • Lead Hadoop Administrator

    1 week ago

    Sandton, South Africa Absa Bank Limited Full time

    Empowering Africa’s tomorrow, together one story at a time. - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group. Job...

  • Data Scientist

    2 weeks ago

    Sandton, South Africa e-Merge IT Recruitment Full time

    **Requirements**: - A minimum of 4 years’ experience in Data Science role - Experience with R, Python, Matlab is required - Experience in programming in C# or C++, Java. - Experience working with large scale data etc. - Experience With Cloud Data Engineering Technologies Is Advantageous - Implement complex data projects - Modelling and visualising large...

  • Data Administrator

    2 weeks ago

    Sandton, South Africa Discovery Ltd. Full time

    **Business Unit**:Discovery Employee Benefits **Function**:Data Analysis **Date**:13 Jun 2024 - Achieve more than**YOU BELIEVE** - Discovery Corporate and Employee Benefits - Data Administrator **About Discovery** - Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional...

  • Systems & Data Administrator

    4 weeks ago

    Sandton, South Africa Broll Property Group Full time

    **POSITION PURPOSE** Assist with all system-related issues/requests to ensure that the operational team can execute work as required. This position is the custodian of client account data collection. The Systems and Data Administrator will ensure robust quality control of all data received and data changes for all our client’s databases. This position is...

  • Data Scientist

    4 weeks ago

    Sandton, South Africa e-Merge IT Recruitment Full time

    Are you currently in a Data Science space and have the ability to use statistics, analyse complex data, simplify it, and present it more easily for others? Can you analyse Large Data sets? Can you implement, optimise and Reduce? You must be able to create data regression models! **The successful incumbent will be responsible to develop prototypes and...

  • Data Engineer

    4 weeks ago

    Sandton, South Africa Datonomy Solutions Full time

    We are looking for Data Engineers to join our team based in JHB- onsite. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and maintaining the data infrastructure. Qualifications: Education: Bachelors or Masters degree in Computer...

  • Data Strategist

    2 weeks ago

    Sandton, South Africa Profile Personnel Full time

    **Data Strategist **required for an Automotive Manufacturing company based in **Sandton, Gauteng.** **Job Duties**: Responsible to provide a holistic view of the organization’s use of data by interpreting all of its current usage and providing a future oriented, strategic plan as well as translating the requirements of executives, managers into concrete...

  • Specialist Data Analyst

    4 weeks ago

    Sandton, South Africa Absa Bank Limited Full time

    Bring your possibility to life! Define your career with us - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.Job Summary **Job...

  • Data Operations Analyst

    4 weeks ago

    Sandton, South Africa Mimecast Services Limited Full time

    Overview: **Data Operations Analyst** Interpret trends and stop cybercriminals in their tracks. Are you methodical and detail-oriented? Then join our dynamic Digital Business Innovation team. We use our high-powered tech stack to plan, control and improve data quality throughout the business. Day to day you’ll build reporting capabilities to identify...

  • Data Strategist

    2 weeks ago

    Sandton, South Africa Volkswagen Group Full time

    **Job Description and Responsibilities**: - As the expert on latest technology trends & products in the space of (big) data, analytics, ad-tech, machine learning and AI, be a thought-partner for managers and executives by bridging market trends to their specific challenges, dynamics, limitations & ambitions. - Guide the organization from the maze of...

  • Data Science Head

    2 weeks ago

    Sandton, South Africa FirstRand Full time

    About us, purpose, experience and qualifications **about us**: - make a promise - be deeply invested - value our differences - build trust, not territory - have courage - always do the right thing **purpose**: To implement the Analytics standards across big complex business areas, that contribute to the monetisation of data through the development and...

  • Senior Data Administrator

    5 days ago

    Sandton, South Africa Headhunters Full time

    About the JobHeadhunters is seeking a highly skilled Senior Data Administrator to join our team in Sandton. As a key member of our Financial Services department, you will be responsible for managing data and information systems, working closely with the Operations Head, Finance Manager, and IT department.The successful candidate will have a strong background...

  • Data Infrastructure Specialist

    5 days ago

    Sandton, South Africa AB InBev Africa Full time

    The RoleWe are seeking a highly skilled Principal Data Architect to join our team in AB InBev Africa. The ideal candidate will have a deep understanding of relational and dimensional data modeling, as well as extensive experience in leading DevOps teams within the realm of Data Engineering.RequirementsTo succeed in this role, you must possess the following...

  • Data Strategist

    2 weeks ago

    Sandton, South Africa RMG Recruitment (Pty) Ltd Full time

    Based in Sandton, the position is responsible to provide a holistic view of the organization’s use of data by interpreting all of its current usage and providing a future oriented, strategic plan as well as translating the requirements of executives, managers into concrete data-driven initiatives and specific actions. **Job Description and...

  • Master Data Administrator

    2 weeks ago

    Sandton, South Africa Innate Med (Pty) Ltd. Full time

    Minimum certificate in IT Management and/or Information Technology Minimum of 3 years experience as a master data administrator Knowledge of SysPro would be advantageous **Job Types**: Full-time, Permanent Ability to commute/relocate: - Sandton, Gauteng: Reliably commute or planning to relocate before starting work (required)