Data Engineer

2 weeks ago


Cape Town, Western Cape, South Africa PBT Group Full time
Data Engineer position currently available in Cape Town.

The Data Engineer will be responsible for designing, building, and optimising data pipelines and ensuring the efficient movement and transformation of data across various systems.

The ideal candidate will have expertise in SQL, data modelling, and experience with cloud-based or on-premises data solutions.

Additionally, knowledge of ML and statistical methodologies is beneficial for supporting advanced analytics.

Key Responsibilities:

  • Develop, maintain, and optimise data pipelines for structured and unstructured data.
  • Design and implement scalable and efficient data models to support analytical and operational reporting.
  • Ensure data integrity, accuracy, and performance through best practices in database management.
  • Work closely with data analysts, data scientists, and business stakeholders to understand data requirements.
  • Implement ETL/ELT processes for data ingestion, transformation, and storage.
  • Optimise database performance, including query tuning and indexing strategies.
  • Monitor and troubleshoot data pipeline issues to ensure reliability and efficiency.
  • Stay up to date with industry best practices and emerging data technologies.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • 5+ years of experience in data engineering, database management, or a related role.
  • Strong proficiency in SQL, including complex queries, indexing, and performance tuning.
  • Expertise in data modelling and schema design for relational and NoSQL databases.
  • Experience with data integration tools and ETL/ELT processes.
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
  • Strong understanding of the principles of data governance and security.

Preferred Skills & Experience:

  • Exposure to big data technologies such as Spark, Hadoop, or Snowflake.
  • Knowledge of Python or other scripting languages for data processing.
  • Background in ML and statistics to support data science initiatives.
  • Experience with CI/CD practices for data pipeline deployment.
  • Proficiency in working with APIs for data extraction and integration.

Key Competencies:

  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to manage multiple projects in a fast-paced environment.
  • Attention to detail and a focus on data quality.
#J-18808-Ljbffr

  • Cape Town, Western Cape, South Africa Data Centrix Full time

    About the Role:We are seeking a highly experienced Data Center Solutions Expert to lead our data center operations team. As a key member of our team, you will be responsible for designing, implementing, and maintaining complex data center solutions using Hyper-V, Exchange, and Microsoft 365 technologies.Responsibilities:Design and implement data center...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Watersedge Solutions Full time

    Data Engineer – Microsoft Fabric (Team Lead)We are looking for an experienced Data Engineer (Team Lead) with expertise in Microsoft Fabric to spearhead the development and optimisation of a next-generation data warehouse.This hybrid role requires flexibility for 3 days in-office per week in Cape Town and offers an exciting opportunity to build and lead a...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa WatersEdge Solutions Full time

    Data Engineer – Microsoft Fabric (Team Lead)  We are looking for an experienced Data Engineer (Team Lead) with expertise in Microsoft Fabric to spearhead the development and optimisation of a next-generation data warehouse. This hybrid role requires flexibility for 3 days in-office per week in Cape Town and offers an exciting opportunity to build...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Network Recruitment Full time

    FinTech IndustryData Engineer RoleSouth Africa (Remote/Hybrid) Python, AWS & PySpark Experience a Must An innovative FinTech firm is hiring a Data Engineer to drive data infrastructure initiatives and streamline data processes. If you thrive in a fast-paced, cloud-first environment and enjoy designing efficient data systems from scratch, this is your chance...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Elixirr Digital Full time

    Do you like building data systems and pipelines? Do you enjoy interpreting trends and patterns? Are you able to recognize the deeper meaning of data?Join Elixirr Digital as a Data Engineer and help us analyze and organize raw data to provide valuable business insights to our clients and stakeholdersAs a Data Engineer, you will be responsible for ensuring the...

  • Data Engineering

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    Data Engineering & Streaming Lead –Cape Town.The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines.The role involves working closely with various infrastructure and operations teams to maintain data infrastructure.As a senior engineer, the candidate will develop and maintain data...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job Overview: We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate...

  • Data Engineer

    1 week ago


    Cape Town, Western Cape, South Africa DLK Group Full time

    Data EngineerWe require a Data Engineer and this is an office-based position.Duties & ResponsibilitiesModifying the database structure, as necessary, from information given by application developers.Enrolling users and maintaining system security.Controlling and monitoring user access to the database.Monitoring and optimizing the performance of the...

  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa Oxyon Human Capital Solutions Full time

    Job Summary:The Data Engineer will manage and analyze the company's data from battery systems, microgrids, and energy management solutions. This role includes designing databases, developing analytics/reporting systems, and applying machine learning (ML) for actionable insights. The Data Engineer will also integrate AI/ML into the EMS product to drive...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Oxyon Human Capital Solutions Full time

    Job Summary: The Data Engineer will manage and analyze the company's data from battery systems, microgrids, and energy management solutions. This role includes designing databases, developing analytics/reporting systems, and applying machine learning (ML) for actionable insights. The Data Engineer will also integrate AI/ML into the EMS product to drive...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    A company dedicated to partnering with underserved communities to co-develop products and services that promote dignity, safety, and financial stability is seeking a Data Engineer. This role is based in Cape Town and follows a hybrid working model. Skills Required · 4 years of relevant work experience in data engineering or a similar role · Experience with...

  • Data Engineer –

    4 weeks ago


    Cape Town, Western Cape, South Africa 5th Dimension Consulting Full time

    Data Engineer: Ingestions Squad (Group Data & ML Platform)We're a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Surgo HR & Training Full time

    Surgo (PTY) Ltd. has partnered with a global analytics and digital solutions company serving industries including insurance, healthcare, banking and financial services, media, retail, and others. They aim to bridge the gap between digital expectations and real outcomes for international companies with Digital Intelligence.Our client is recruiting for a Data...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa EQ Plus Full time

    Key Responsibilities:Designing and implementing scalable processes to manage large data sets, ensuring quality and consistency across sources. This involves developing and maintaining data pipelines, creating optimal extraction patterns, and aligning cloud strategy with data architecture. As the Data Engineer, you will also engineer data formats for...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineer

    1 day ago


    Cape Town, Western Cape, South Africa Eq Plus Full time

    Key Responsibilities:Designing and implementing scalable processes to manage large data sets, ensuring quality and consistency across sources.This involves developing and maintaining data pipelines, creating optimal extraction patterns, and aligning cloud strategy with data architecture.As the Data Engineer, you will also engineer data formats for analytics,...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Sanlam Group Full time

    Job title : Data Engineer - Group Data & ML Platform TribeJob Location : Western Cape, BellvilleDeadline : May 03, 2025Quick Recommended LinksJobs by Location Job by industries What will make you successful in this role? What success will look like for you 12 months into the role. (Ingestions Squad) Built configurable data ingestion platforms to collect...

  • Data Engineer

    1 day ago


    Cape Town, Western Cape, South Africa Datafin Full time

    ENVIRONMENT:ASSIST with the design & build of a modern, automated, event-based communications platform as the next Data Engineer (Azure) sought by a dynamic Independent Asset Management Firm. Collaborating with relevant IT Heads, Engineering Leads and Product Owners, you will also help define and execute the IT Strategy while building supplementary...


  • Cape Town, Western Cape, South Africa Data Centrix Full time

    As a Senior Networks Engineer at Data Centrix, you will be responsible for designing, implementing, and managing complex network architectures to meet the evolving needs of our clients.Primary ResponsibilitiesDesign and implement network architectures that meet the specific requirements of our clients, including scalability, security, and reliability.Manage...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Network It Full time

    Reference : BIT-CdP-1We are looking for a skilled Data Engineer to join our clients' investment team to oversee their database architecture, data flow, and data processes.The role involves efficiently managing the reception, transfer, processing, analysis, and integration of third-party systems for investment research and business operational...