Senior/ Intermediate Data Engineer

1 week ago

Southern Suburbs Western Cape, South Africa Intelligent Debt Management Full time R900 000 - R1 200 000 per year

Senior / Intermediate Data Engineer (Pinelands, Cape Town)

We are looking for a motivated and technically skilled Data Engineer who is eager to learn and grow. This role involves working with modern data platforms and development practices to design, build, and maintain scalable data solutions.

Key Requirements

  • Core Skills:
    • Strong communication and collaboration abilities.
  • Attention to detail with a focus on data quality.
  • Experience in end-to-end data flow design and implementation.
  • Familiarity with agile ways of working.
  • Growth Mindset. Demonstrated eagerness to learn and adapt, supported by examples of applying new skills in practice.
  • Technical Expertise:
    • Proven experience with big data tools, particularly Databricks.
  • Strong background in cluster computing using Apache Spark.
  • Experience developing and maintaining CI/CD pipelines.
  • Proficiency in Python with mandatory PySpark experience.
  • Beneficial Experience:
    • Prior work as a backend developer, showcasing strong software engineering fundamentals.
  • Previous experience as a data engineer.
  • Familiarity with Azure cloud infrastructure and services/

What You'll Do

  • Build and optimize data pipelines and workflows on Databricks and Spark.
  • Contribute to the design and implementation end-to-end data flows and CI/CD processes.
  • Collaborate with cross-functional teams to deliver reliable, scalable, and high-quality data solutions.
  • Continuously expand your knowledge of modern data engineering practices.

What's in it for you?

Being South Africa's largest company of its kind – IDM is continuously growing, with no signs of stopping.

One of our core values is 'growing people' and we take that very seriously. We have internal learning opportunities to better our people, and leaders who are experts in their fields and freely impart knowledge and are open to new ideas. As one of our people said, "you can speak to anyone here. Your rank doesn't matter. You are listened to."

Our culture is one of collaboration, diversity, and helpfulness. That goes for our people internally and how we deal with our clients.

At IDM, you can play a part in educating and assisting real South Africans get out of tough financial situations. You can make a difference with the work you do. Our people believe this too – one said, "I wake up each day knowing I am going to make a difference."

Other key benefits:

  • We make sure our employees are mentally and physically healthy with Healthy Together campaigns throughout the year.
  • We offer various rewards and awards as tokens of recognition for hard work.
  • We have a vibrant office with easy access to stores and outlets if you need.
  • We offer company benefits – like a half day off on your birthday, medical aid, retirement annuity, and further study opportunities should you meet relevant requirements.
  • We have a culture of growth, meaning you have access to move both upwards or across in the business if you want to.

  • Intermediate Data Engineer

    14 hours ago

    Cape Town, South Africa LexisNexis Full time

    Join to apply for the Intermediate Data Engineer role at LexisNexis . Would you like to ensure the successful delivery of the Data Platform and Software Innovations? Do you enjoy creating a collaborative and customer-focused working environment? About Team LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800...

  • Intermediate / Senior Data Analyst (Rainmaker) - Shopritex

    2 weeks ago

    Cape Town, South Africa Shopritex Full time

    ShopriteX is Shoprite's digital innovation hub where customer data is at the heart of everything. ShopriteX is dedicated to saving customers time and money through frictionless, more personalised shopping experiences, supporting the vision to be Africa's most customer-centric retailer. Rainmaker Media is a precision retail media agency that creates campaigns...

  • Senior Structural Engineer

    3 weeks ago

    Cape Town, South Africa Gig Engineer Full time

    About the Role We are looking to recruit a Senior Professional Structural Engineer to fulfil the role of Technical Lead in MCF & Industry in South Africa teams, which are looking to recruit to expand and develop their South Africa‑based Structural Engineering team to assist with our growing workload. Requirements Desired Qualifications and Professional...

  • Data Analyst

    2 weeks ago

    Southern Suburbs, South Africa Intelligent Debt Management Full time

    **Data Analyst (Pinelands, Cape Town)** The Intelligent Debt Management (IDM) Group, South Africa’s largest and multi-award winning debt management company, has a position available for a** Data Analyst.** This individual will join the Business Intelligence Team and will be accountable for mostly (but not limited to only) data analytics and...

  • Data Analyst

    1 week ago

    Southern Suburbs, Western Cape, South Africa Intelligent Debt Management Full time R20 000 - R450 000 per year

    Data Analyst (Pinelands, Cape Town)The Intelligent Debt Management (IDM) Group, South Africa's largest and multi-award winning debt management company, has a position available for a Data Analyst.This individual will join the Business Intelligence Team and will be accountable for mostly (but not limited to only) data analytics and...

  • Senior Structural Engineer | Technical Lead for Buildings

    1 week ago

    Cape Town, South Africa Gig Engineer Full time

    A leading engineering consultancy in Cape Town seeks a Senior Professional Structural Engineer to provide technical leadership in the Structural Engineering team. The candidate must have a minimum of 15 years of experience and be registered with ECSA as a PrEng. Responsibilities include managing projects, mentoring junior engineers, and ensuring compliance...

  • Intermediate Data Engineer

    2 days ago

    Cape Town, South Africa LexisNexis Risk Solutions Full time

    ## .**About Team:**LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of , a global provider of information-based analytics and decision tools for professional and business customers. Our company has been a long-time leader in deploying AI and advanced technologies to the legal market...

  • Intermediate Data Engineer

    2 days ago

    Cape Town, South Africa RELX Full time

    Would you like to ensure the successful delivery of the Data Platform and Software Innovations? Do you enjoy creating a collaborative and customer-focused working environment? About Team: LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of RELX, a global provider of information-based...

  • Intermediate Data Engineer

    2 days ago

    Cape Town, South Africa LexisNexis Risk Solutions Full time

    .**About Team:**LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of , a global provider of information-based analytics and decision tools for professional and business customers. Our company has been a long-time leader in deploying AI and advanced technologies to the legal market to...

  • Senior Data Engineer

    1 day ago

    Cape Town, Western Cape, South Africa Queer Networks, Inc. Full time R1 200 000 - R2 400 000 per year

    Hornet (Queer Networks) is the world's leading queer tech company, providing a digital home for gay men to safely connect with each other — anytime, anywhere. Amplifying the radical, affirmative power of the queer community with cutting-edge technology, Queer Networks serves the LGBTQ+ community with products such as the gay chat app Hornet, with over 100...