Data Engineer

6 hours ago

Pretoria, Gauteng, South Africa ALOS Innovative Workforce Solution (Pty) Ltd Full time
Job Title: Data Engineer

We are seeking a highly skilled Data Engineer to join our team at ALOS Innovative Workforce Solution (Pty) Ltd. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems and infrastructure.

Key Responsibilities:
  • Design and implement data management systems for central sectors and entire organizations, adhering to established guidelines.
  • Manage systems, including scVENUS and Ansible, to ensure seamless operation and efficiency.
  • Develop and deploy Ansible playbooks to automate tasks and improve productivity.
  • Work with public cloud platforms such as Azure and AWS to design and implement scalable data solutions.
  • Collaborate with the team to implement Directory Access Manager (DIVA) and ensure secure access to data.
  • Manage Linux Redhat and Ubuntu operating systems, ensuring optimal performance and security.
  • Implement Intelligent Storage Orchestration Environment (iStore) to streamline data storage and retrieval.
  • Work with Confluence, Jira, and Bitbucket/GitHub to ensure seamless collaboration and version control.
  • Design and implement private cloud solutions to meet business needs.
  • Provide expert guidance to users on data storage, archiving, and reporting.
  • Assign CA roles to folders and create ADGR roles to folders, ensuring secure access and data management.
  • Design and implement CA data structures according to guidelines and configure using Autofs and DFS.
  • Perform regular housekeeping, monitoring, and management of NAS using iStore and DIVA, ensuring security and compliance.
  • Identify and delete obsolete data using the CA Cleanup Tool, ensuring data integrity and security.
  • Backup and restore CA data to ensure business continuity.
  • Operate and maintain CA Cleanup Tool, casr, resmon, and ca-its, ensuring smooth operation and efficiency.
  • Develop and maintain scripts to automate tasks and improve productivity.
  • Stay up-to-date with the latest storage technologies, including EMC2 and NetApp.
  • Hold a degree in Information Technology or a related field and have proven experience with SUSE Linux Enterprise Server (SLES), Redhat, Windows, and LDAP/AD server administration.
  • Have a strong understanding of network information services (NIS) mappings and configuration management for automount NFS and CIFS protocols.
  • Experience with repository management tools such as Nexus and Artifactory.
  • Knowledge of Distributed File System (DFS) and Active Directory (AD).
  • Proficient in automation with Ansible Automation Platform.
  • Familiarity with codebase management tools such as GitHub/Github Actions.
  • Excellent problem-solving and troubleshooting skills.
  • Working knowledge of Linux Automounter (AutoFS).
  • Setup and configuration of NFSv3,4 Server and Client (exports).
Requirements:
  • Minimum of 5 years of experience in Linux Administration (SLES, RHEL).
  • ITIL certification.
  • Any Linux/Cloud Server certifications.
  • Experience in a multi-platform environment (Windows, Linux).
  • Advanced knowledge of network information services (NIS), DFS, and NFS/CIFS configurations.
  • Expertise in managing LDAP/IDM servers and automount configurations.

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa IT Ridge Technologies Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IT Ridge Technologies. As a Data Engineer, you will play a critical role in designing and managing a robust data pipeline that effectively processes and integrates both structured and unstructured data into data lakes, warehouses, databases, and other data sources.Key...

  • Senior Process Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Job DescriptionWe are seeking a highly skilled Senior Process Engineer to join our team at Data Centrix. As a key member of our organization, you will be responsible for defining and optimizing business processes to drive operational excellence.Key ResponsibilitiesProcess Definition and Optimization: Develop and implement business processes that align with...

  • Process Engineering Lead

    3 weeks ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Job DescriptionAt Data Centrix, we are seeking a highly skilled Senior Process Engineer to join our team. As a key member of our organization, you will play a critical role in defining and optimizing business processes to drive efficiency and effectiveness.Key ResponsibilitiesProcess Definition and Optimization: Define business processes and value chains...

  • Head of Data Engineering

    2 weeks ago

    Pretoria, Gauteng, South Africa HR Genie Full time

    About the RoleWe are seeking a highly skilled and experienced Head of Data Engineering to join our team at HR Genie. As a key member of our organization, you will be responsible for driving the development and implementation of our data engineering strategy, ensuring the delivery of high-quality data solutions that meet the needs of our business.Key...

  • Head of Data Engineering

    2 weeks ago

    Pretoria, Gauteng, South Africa HR Genie Full time

    About the RoleWe are seeking a highly skilled and experienced Head of Data Engineering to join our team at HR Genie. As a key member of our organization, you will be responsible for driving the development and implementation of our data engineering strategy, ensuring the delivery of high-quality data solutions that meet the needs of our business.Key...

  • Azure Data Engineer – Johannesburg

    1 week ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking an experienced Azure Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory, Azure Data Explorer, and Azure Databricks.Key ResponsibilitiesDesign and implement data pipelines...

  • Data Engineer/BI Consultant

    3 days ago

    Pretoria, Gauteng, South Africa People Dimension Full time

    Job Title: Data Engineer/BI Consultant Job Summary: We are seeking a highly skilled Data Engineer/BI Consultant to join our team at People Dimension. The successful candidate will be responsible for identifying and conceptualizing strategic data enablement opportunities, project and activity planning, stakeholder expectation management, and implementing...

  • Senior Software Quality Assurance Engineer

    1 week ago

    Pretoria, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Software Quality Assurance / Testing Engineer to join our team. As a key member of our development process, you will be responsible for ensuring the quality of our software products.Key ResponsibilitiesCollaborate with cross-functional teams to plan, execute, and report on QA activities for new development...

  • Azure Data Engineer – Johannesburg

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    E-Merge is seeking a skilled Azure Data Engineer to join our team and contribute to the development of innovative data solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Azure Data Platforms.Key Responsibilities:Design and implement data pipelines using...

  • Senior Process Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Job SummaryWe are seeking a highly skilled Senior Process Engineer to join our team at Data Centrix. As a key member of our organization, you will be responsible for driving business transformation and process improvement initiatives across the company.Key ResponsibilitiesProcess Analysis and Improvement: Conduct thorough analysis of existing business...

  • AWS Cloud Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    A leading financial institution with a strong presence in African capital markets is seeking a highly skilled AWS Cloud Data Engineer to join their team. As a key member of the organization, you will play a crucial role in solving complex problems and delivering real business value across various industries.Key Responsibilities:Develop and maintain...

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa H2R Africa Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at H2R Africa in Pretoria. The successful candidate will be responsible for delivering central data management, governance, and reporting within the Financial Surveillance Division (FinSurv).Key Responsibilities:Design and implement data strategies and systems to create...

  • Data Engineer

    5 days ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    Unlock Business Potential with Data-Driven InsightsE-Merge is seeking a talented Intermediate Data Engineer to join our team and contribute to the success of our organization. As a key member of our data science team, you will play a crucial role in leveraging data-driven insights to drive business decisions and optimize operations.Key...

  • Mechanical Team Lead Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Royal HaskoningDHV Full time

    About the RoleWe are seeking a highly skilled and experienced Mechanical Team Lead Engineer to join our Data Centres team in South Africa. As a key member of our team, you will be responsible for overseeing and managing all mechanical engineering aspects of data centre building projects.Key ResponsibilitiesProvide technical leadership and guidance to the...

  • Business Process Optimization Specialist

    3 weeks ago

    Pretoria, Gauteng, South Africa Data Centrix Full time

    Job DescriptionAt Data Centrix, we are seeking a highly skilled Senior Process Engineer to join our team. As a key member of our organization, you will play a critical role in defining and optimizing business processes to drive efficiency and effectiveness.Key ResponsibilitiesProcess Definition and Optimization: Define business processes and value chains...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    1 week ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at E-Merge, a leading e-Commerce retailer. As a Data Engineer, you will play a critical role in designing and building scalable ETL systems for our big data warehouse.Key ResponsibilitiesDesign and develop data warehouses according to the Kimball methodologyDevelop ETL processes...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    Job Summary:E-Merge is seeking a highly skilled AWS Data Engineer to join our team in Pretoria. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using AWS Glue or Data Pipeline, and other similar platforms.Key Responsibilities:Data Modelling: Develop and maintain data...

  • AWS Redshift Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    Job SummaryE-Merge is seeking a highly skilled Data Engineer to join our team and drive the design and development of scalable ETL systems for our big data warehouse. As a Data Engineer, you will be responsible for implementing robust and trustworthy data to support high-performing ML algorithms, predictive models, and real-time data visualization...

  • Intermediate Data Engineer

    3 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    A forward-thinking company, E-Merge, at the forefront of innovation in the telecommunications industry, prides itself on providing cutting-edge services and solutions that enhance connectivity and empower their clients seeks a skilled Intermediate Data Engineer. You will play a pivotal role in leveraging data-driven insights to drive business decisions and...

  • Data Architect

    2 weeks ago

    Pretoria, Gauteng, South Africa H2R Africa Full time

    Job DescriptionCompany OverviewH2R Africa is a leading financial institution in Pretoria, committed to delivering innovative solutions to our clients. We are seeking a highly skilled Data Engineer to join our team and contribute to our IT transformational programme.Job SummaryWe are looking for a Data Engineer to design and implement data strategies and...