Data Engineer

3 days ago

Port Elizabeth, South Africa Top Vitae Full time

FUNCTIONAL DEFINITION AND RESPONSIBILITY: The Data Engineer is responsible for developing, maintaining, and optimising the data systems and operational pipelines that support the company’s market research and analytics processes. The role ensures that data flows seamlessly from collection through transformation to reporting, enabling timely, accurate, and actionable insights for clients. This position bridges technical development and operational efficiency, ensuring data reliability, process automation, and continuous improvement across the data lifecycle. RESPONSIBILITIES: Data Systems Development and Maintenance: Design, build, and maintain data pipelines and ETL processes for efficient ingestion, transformation, and storage of large, multi-source datasets. Develop automation solutions that improve data quality, integrity, and processing efficiency across the research workflow. Maintain and enhance database systems, ensuring data consistency, accuracy, and optimal performance. Develop APIs and integration scripts to connect internal platforms with third-party data sources and tools. Operational Data Management: Monitor data workflows to ensure timely delivery and availability for analysis and reporting. Diagnose and resolve issues in data processing and system performance. Implement process controls and error handling to minimise downtime and data discrepancies. Support data validation and reconciliation to maintain confidence in reporting outputs. Collaboration and Stakeholder Support: Work closely with research, data analytics and data science to understand operational needs and deliver scalable data solutions. Translate data and workflow requirements into robust, maintainable technical systems. Provide technical input into data architecture, governance, and process improvement initiatives. Document data flows, system configurations, and development procedures for operational continuity. Innovation and Continuous Improvement: Identify opportunities to optimise data pipelines and automate manual processes. Evaluate and implement new tools and technologies to improve data efficiency and quality. Contribute to the continuous improvement of data engineering standards, best practices, and workflows. QUALIFICATIONS & EXPEREINCE: Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (or equivalent experience). 3-5 years’ experience in data operations, data engineering, or software development roles. Proven experience in building and maintaining data pipelines and automated workflows. Exposure to market research or data analytics environments is highly advantageous. Experience in managing data within cloud-based or hybrid infrastructures. TECHNICAL SKILLS: Proficiency in scripting languages (Python, R, DAX, or equivalent). Expertise in designing and maintaining ETL/ELT pipelines. Proficiency in SQL and data modelling for relational and non-relational databases. Experience with cloud platforms (AWS, Azure, or GCP) and associated data services. Knowledge of BI tools (Power BI, Tableau) and data warehousing concepts. Knowledge of Microsoft Fabric. Knowledge of APIs and systems integration. CORE COPETENCIES: Strong statistical / mathematical skills. Excellent understanding of data operations within a commercial or research environment. Ability to translate business requirements into scalable technical workflows. Please consider your application unsuccessful should you not receive a response within 2 weeks of applying.

  • Data Engineer

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa NOV Full time R600 000 - R1 200 000 per year

    Job DescriptionAre you passionate about leveraging data and analytics to drive operational impact in the energy sector? At NOV, we lead technological innovation to deliver exceptional value to our customers in drilling and rig equipment solutions. We are seeking a talented Data Engineer who not only excels at building scalable data architectures but also...

  • Senior Team Lead, Software Engineering/Architecture

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa NTT DATA, Inc. Full time R900 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior Team...

  • Intermediate Data Engineer

    4 days ago

    Port Elizabeth, Eastern Cape, South Africa Boardroom Appointments Full time R120 000 - R240 000 per year

    Intermediate Data EngineerMinimum Requirements:Matric (Grade 12)Masters in Software Engineering, Data Engineering, Computer Science or related field2-3 years of relevant work experienceStrong Scala or Java backgroundKnowledge of AWS, GCP, Azure, or other cloud platformUnderstanding of data modeling principlesAbility to work with complex data modelsExperience...

  • Cross Technology Managed Server Engineer

    2 weeks ago

    Port Elizabeth, Eastern Cape, South Africa NTT DATA, Inc. Full time R1 200 000 - R2 400 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Cross...

  • Engineering Data Controller

    2 weeks ago

    Port Elizabeth, South Africa Profile Personnel Full time

    Requirements: A relevant 3-year diploma or degree in Engineering, Logistics or IT 5 years of data management experience in an automotive environment Proficiency in the following systems is essential: TIS, MBT, AVON, MBV, KVS, Connect, TI-REX, CoRe, COPS. Ability to read and interpret technical change documentation. Ability to confidently represent Product...

  • Engineering Data Controller

    2 weeks ago

    Port Elizabeth, South Africa Boikago Group Full time

    Our client is an international automotive OEM which produces vehicles in over 10 countries and delivers them to customers in more than 100 markets worldwide. Applications are invited from suitably qualified & experienced candidates to fill the Engineering Data Controller position in the Engineering Operations Department - Product Development (Kariega) Brief...

  • Senior Data Engineer I

    4 days ago

    Port Elizabeth, Eastern Cape, South Africa Boardroom Appointments Full time R800 000 - R1 200 000 per year

    Minimum Requirements:Matric (Grade 12)Masters degree in Software Engineering, Data Engineering, Computer Science or related field5 years of relevant work experienceStrong Scala and Python backgroundExperience with Apache Spark and/or RayKnowledge of AWS, GCP, Azure, or other cloud platformKnowledge of current principles and frameworks for ML OpsExperience...

  • Engineering Data Controller

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa Interdot Solutions Full time R900 000 - R1 200 000 per year

    ABOUT THE OPPORTUNITY:1. Bill-of-Materials Management- Create and maintain BOMs using Technical Product Descriptions and Vehicle PR specifications.- Collaborate with local and international design engineers to ensure BOMs reflect accurate design levels.- Coordinate with production and logistics teams to ensure material availability.- Represent VWGA in global...

  • Head of Data

    2 days ago

    Port Elizabeth, Eastern Cape, South Africa Sun International Full time R1 450 000 - R1 830 000 per year

    The Head of Data is responsible for leading the design, implementation, and evolution of the company's data architecture, platforms, and practices. This role ensures that data is accurate, accessible, secure, and strategically valuable across all business functions. The Head of Data will oversee the development of data pipelines, reporting systems, and...

  • Engineering Data Controller: Engineering Operations Department, Kariega, Eastern Cape

    1 week ago

    Port Elizabeth, Eastern Cape, South Africa REVTECH GLOBAL (South Africa) Full time R900 000 - R1 200 000 per year

    Engineering Data Controller: Engineering Operations Department – Product DevelopmentKariega, Eastern CapeJob DetailsTo ensure that all activities set out by Supervision are undertaken and completed by the Engineering Data Controller, to ensure all databases are completed on time. This includes providing product information, product planning that is...