Data Engineer

1 week ago

Cape Town, Western Cape, South Africa Oxyon Human Capital Solutions Full time

Job Summary:

The Data Engineer will manage and analyze the company's data from battery systems, microgrids, and energy management solutions. This role includes designing databases, developing analytics/reporting systems, and applying machine learning (ML) for actionable insights. The Data Engineer will also integrate AI/ML into the EMS product to drive innovation in energy management.

Key Responsibilities:

  • Design and maintain robust database architectures to support operational data from battery systems and microgrids.
  • Develop and optimize data pipelines to ensure seamless ingestion, processing, and storage of structured and unstructured data.
  • Ensure data integrity, security, and availability through best practices in database management.
  • Develop and implement data analytics and visualization tools to provide insights into system performance.
  • Create automated reporting solutions to track key metrics, enabling data-driven decision-making across the organization.
  • Work closely with stakeholders to understand reporting needs and deliver actionable insights through dashboards and custom reports.
  • Analyse historical data to identify patterns, trends, and correlations in battery system and microgrid performance using statistical methods and AI tools.
  • Develop trend forecasting models to anticipate system behavior and provide proactive recommendations for system optimization.
  • Find innovative ways to optimize energy costs and management.
  • Lead initiatives to integrate AI and machine learning models within the EMS product, focusing on predictive analytics and anomaly detection.
  • Collaborate with software developers to create data-driven features that enhance the EMS product's capabilities and user experience.
  • Identify opportunities for innovative new services based on data trends and lead their development.
  • Collaborate with the EMS team, software engineers, and product owners to align data initiatives with product objectives.
  • Facilitate training and workshops to promote AI and ML technologies across the company, ensuring teams understand and utilize data-driven insights.

Job Requirements:

  • Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • Minimum of 3-5 years of experience in data engineering, analytics, or a related role.
  • Proven experience in designing and managing databases, developing ETL pipelines, and building analytics solutions.
  • Hands-on experience with AI/ML technologies and frameworks, such as TensorFlow, Scikit-Learn, or similar.
  • Proficiency in SQL, Python, and data visualization tools (e.g., Power BI, Tableau), including Python Data Analysis libraries
  • Experience with cloud platforms for data storage and processing (e.g., AWS, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and big data technologies (e.g., Spark, Hadoop).
  • Strong understanding of time series data analysis, pattern recognition, forecasting and model building and using AI tools to achieve these.

  • Data Network Operations Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    **Job Description**Data Centrix seeks a Data Network Operations Engineer to support the maintenance and operation of our customer MPLS and Cisco SDWAN networks.As a key member of our network operations team, you will be responsible for identifying opportunities for improving the efficiency and reliability of our network infrastructure.The ideal candidate...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa WatersEdge Solutions Full time

    Data Engineer – Microsoft Fabric (Team Lead)  We are looking for an experienced Data Engineer (Team Lead) with expertise in Microsoft Fabric to spearhead the development and optimisation of a next-generation data warehouse. This hybrid role requires flexibility for 3 days in-office per week in Cape Town and offers an exciting opportunity to build...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Watersedge Solutions Full time

    Data Engineer – Microsoft Fabric (Team Lead)We are looking for an experienced Data Engineer (Team Lead) with expertise in Microsoft Fabric to spearhead the development and optimisation of a next-generation data warehouse.This hybrid role requires flexibility for 3 days in-office per week in Cape Town and offers an exciting opportunity to build and lead a...

  • Data Engineer

    4 days ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    FinTech IndustryData Engineer RoleSouth Africa (Remote/Hybrid) Python, AWS & PySpark Experience a Must An innovative FinTech firm is hiring a Data Engineer to drive data infrastructure initiatives and streamline data processes. If you thrive in a fast-paced, cloud-first environment and enjoy designing efficient data systems from scratch, this is your chance...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Elixirr Digital Full time

    Do you like building data systems and pipelines? Do you enjoy interpreting trends and patterns? Are you able to recognize the deeper meaning of data?Join Elixirr Digital as a Data Engineer and help us analyze and organize raw data to provide valuable business insights to our clients and stakeholdersAs a Data Engineer, you will be responsible for ensuring the...

  • Data Engineering

    1 week ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    Data Engineering & Streaming Lead –Cape Town.The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines.The role involves working closely with various infrastructure and operations teams to maintain data infrastructure.As a senior engineer, the candidate will develop and maintain data...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview: We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...

  • Data Engineer –

    3 weeks ago

    Cape Town, Western Cape, South Africa 5th Dimension Consulting Full time

    Data Engineer: Ingestions Squad (Group Data & ML Platform)We're a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    A company dedicated to partnering with underserved communities to co-develop products and services that promote dignity, safety, and financial stability is seeking a Data Engineer. This role is based in Cape Town and follows a hybrid working model. Skills Required · 4 years of relevant work experience in data engineering or a similar role · Experience with...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Surgo HR & Training Full time

    Surgo (PTY) Ltd. has partnered with a global analytics and digital solutions company serving industries including insurance, healthcare, banking and financial services, media, retail, and others. They aim to bridge the gap between digital expectations and real outcomes for international companies with Digital Intelligence.Our client is recruiting for a Data...

  • Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa EQ Plus Full time

    Key Responsibilities:Designing and implementing scalable processes to manage large data sets, ensuring quality and consistency across sources. This involves developing and maintaining data pipelines, creating optimal extraction patterns, and aligning cloud strategy with data architecture. As the Data Engineer, you will also engineer data formats for...

  • Data Engineering

    4 weeks ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    1 week ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineer

    7 days ago

    Cape Town, Western Cape, South Africa Sanlam Group Full time

    Job title : Data Engineer - Group Data & ML Platform TribeJob Location : Western Cape, BellvilleDeadline : May 03, 2025Quick Recommended LinksJobs by Location Job by industries What will make you successful in this role? What success will look like for you 12 months into the role. (Ingestions Squad) Built configurable data ingestion platforms to collect...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa PBT Group Full time

    Data Engineer position currently available in Cape Town.The Data Engineer will be responsible for designing, building, and optimising data pipelines and ensuring the efficient movement and transformation of data across various systems.The ideal candidate will have expertise in SQL, data modelling, and experience with cloud-based or on-premises data...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Network It Full time

    Reference : BIT-CdP-1We are looking for a skilled Data Engineer to join our clients' investment team to oversee their database architecture, data flow, and data processes.The role involves efficiently managing the reception, transfer, processing, analysis, and integration of third-party systems for investment research and business operational...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Afrizan Personnel Full time

    A leading organisation is looking for a Data Engineer to join their team. The main purpose of the role is to prepare and manage large volumes of data for analytical or operational uses. This role involves designing, building, and maintaining the architecture used for data processing and storage. This includes tasks such as:Data Modeling and Design:...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Network IT Full time

    Reference: BIT002679-CdP-1We are looking for a skilled Data Engineer to join our clients' investment team to oversee their database architecture, data flow, and data processes. The role involves efficiently managing the reception, transfer, processing, analysis, and integration of third-party systems for investment research and business operational...

  • Data Engineering Visionary

    3 days ago

    Cape Town, Western Cape, South Africa BADRI Management Consultancy Full time

    About the RoleWe are seeking a highly skilled Principal Lead Data Engineer to drive our technical vision and strategy for data engineering capabilities. This role will lead the design and implementation of scalable, high-performance data pipelines, data platforms, and infrastructure to support our data-driven business objectives.Key ResponsibilitiesData...

  • Data Engineering Lead

    20 hours ago

    Cape Town, Western Cape, South Africa Sanlam Full time

    Data Engineering ResponsibilitiesAs a senior data engineer, you'll be responsible for designing, building, and maintaining large-scale data systems that collect, process, and store complex data sets. You'll work closely with data scientists, analysts, and engineers to ensure seamless integration and efficient data flow throughout the organisation. Your...