Senior Data Engineer I

3 days ago

Port Elizabeth, Eastern Cape, South Africa Boardroom Appointments Full time R800 000 - R1 200 000 per year


Minimum Requirements:

  • Matric (Grade 12)
  • Masters degree in Software Engineering, Data Engineering, Computer Science or related field
  • 5 years of relevant work experience
  • Strong Scala and Python background
  • Experience with Apache Spark and/or Ray
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Knowledge of current principles and frameworks for ML Ops
  • Experience with ML Ops technologies such as ML Flow, DVC, Grafana, DataHub, Databricks
  • Experience with machine learning technologies such as PyTorch, TensorFlow, AWS Sagemaker
  • Experience with CI/CD pipelines, including Jenkins or Git Actions
  • Experience with Docker containerization or Kubernetes orchestration
  • Experience in improving data security and privacy, and managing and reducing cloud costs
  • Knowledge of API development and machine learning deployment

Responsibilities:

  • Develop and implement a strategy for continuous improvement of our Machine Learning Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy
  • Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate
  • Collaborate with data scientists, data engineers, API engineers, and the dev ops team
  • Build scalable data ingestion and machine learning inference pipelines
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data

  • Senior Team Lead, Software Engineering/Architecture

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa NTT DATA, Inc. Full time R900 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior Team...

  • Data Engineer

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa NOV Full time R600 000 - R1 200 000 per year

    Job DescriptionAre you passionate about leveraging data and analytics to drive operational impact in the energy sector? At NOV, we lead technological innovation to deliver exceptional value to our customers in drilling and rig equipment solutions. We are seeking a talented Data Engineer who not only excels at building scalable data architectures but also...

  • Intermediate Data Engineer

    3 days ago

    Port Elizabeth, Eastern Cape, South Africa Boardroom Appointments Full time R120 000 - R240 000 per year

    Intermediate Data EngineerMinimum Requirements:Matric (Grade 12)Masters in Software Engineering, Data Engineering, Computer Science or related field2-3 years of relevant work experienceStrong Scala or Java backgroundKnowledge of AWS, GCP, Azure, or other cloud platformUnderstanding of data modeling principlesAbility to work with complex data modelsExperience...

  • Cross Technology Managed Server Engineer

    2 weeks ago

    Port Elizabeth, Eastern Cape, South Africa NTT DATA, Inc. Full time R1 200 000 - R2 400 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Cross...

  • Senior Team Lead, Software Engineering/Architecture

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa NTT Full time R1 200 000 - R3 600 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATAThe Senior Team...

  • Engineering Data Controller

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa Interdot Solutions Full time R900 000 - R1 200 000 per year

    ABOUT THE OPPORTUNITY:1. Bill-of-Materials Management- Create and maintain BOMs using Technical Product Descriptions and Vehicle PR specifications.- Collaborate with local and international design engineers to ensure BOMs reflect accurate design levels.- Coordinate with production and logistics teams to ensure material availability.- Represent VWGA in global...

  • Head of Data

    1 day ago

    Port Elizabeth, Eastern Cape, South Africa Sun International Full time R1 450 000 - R1 830 000 per year

    The Head of Data is responsible for leading the design, implementation, and evolution of the company's data architecture, platforms, and practices. This role ensures that data is accurate, accessible, secure, and strategically valuable across all business functions. The Head of Data will oversee the development of data pipelines, reporting systems, and...

  • Engineering Data Controller: Engineering Operations Department, Kariega, Eastern Cape

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa REVTECH GLOBAL (South Africa) Full time R900 000 - R1 200 000 per year

    Engineering Data Controller: Engineering Operations Department – Product DevelopmentKariega, Eastern CapeJob DetailsTo ensure that all activities set out by Supervision are undertaken and completed by the Engineering Data Controller, to ensure all databases are completed on time. This includes providing product information, product planning that is...

  • Ship Surveyor Engine

    6 days ago

    Port Elizabeth, Eastern Cape, South Africa South African Maritime Safety Authority Full time R200 000 - R300 000 per year

    DescriptionShip Surveys and Inspections:Undertake all Statutory Surveys, Audits, and Inspections in accordance with applicable legislation and other relevant regulations relating to Marine Pollution Prevention and Safety. Give effect to our obligation under the Instruments relevant to the III Code (Tonnage, COLREGS, Load line, SOLAS, MARPOL)Examinations and...

  • Senior Service Desk Engineer

    5 days ago

    Port Elizabeth, Eastern Cape, South Africa Zenzero Full time R900 000 - R1 200 000 per year

    The Senior Service Desk Engineer role is critical to ensure the effective and continuous provision of service desk support to clients. You will provide exceptional standards of support to customers, across a variety of products, services and platforms. You will work with the Lifecycle Coordinator(s) and Service Desk Manager, to ensure tickets are worked on...