Data Engineering Lead

4 months ago

Cape Town, South Africa Intelligent Debt Management Full time

**Data Engineering Lead** **(Cape Town)**

The Intelligent Debt Management (IDM) Group, South Africa’s largest and multi-award-winning debt management company, has a position available for a Data Engineering Lead.

This individual will join the Data Team and will be accountable for mostly (but not limited to) data engineering design and implementation across on premise and cloud based platforms.

**Qualifications**:

- Bachelor's degree in Computer Science, Engineering, or a related field.
- Certifications in Azure, Azure Databricks Data Engineering or similar or equivalent practical experience.
- Extensive proven experience as a data engineer or in a similar role, designing and implementing data architectures, data integration and ETL processes. Practical experience in Azure, Azure Data Factory and Azure Databricks is preferred.
- Proven experience in Python/PySpark and SQL/SparkSQL programming skills.
- At least 4 years of experience in Information Technology - specifically in data management.
- Strong knowledge of data management and storage solutions, including SQL Server Database, Azure Data Lake Storage or similar.
- Ability to lead and innovate in a fast-paced and evolving technology landscape.
- Strong communication and leadership abilities.
- Excellent attention to detail and problem solving skills related to data, data structures and algorithms.

**Key responsibilities will include**:

- Lead the design and implementation of scalable data solutions on the Microsoft Azure cloud platform, including Azure Databricks.
- Develop, maintain and optimise robust data pipelines for data ingestion, processing, and transformation to support analytics, machine learning and other data-driven services.
- Ensure data security, quality and integrity across all of the pipelines and related data processes.
- Define the mechanism through which skilled decentralized analytics teams can contribute to the engineering processes.
- Work closely with the Head of Data and enterprise architecture to ensure that the data engineering vision is aligned with the systems architecture and the data strategy.
- Collaborate with the data product owner, analysts, data scientists, and business stakeholders to understand data requirements and implement effective data workflows.
- Assist in data initiatives and support technical teams including architects, software developers, and data scientists.
- Provide leadership and mentoring to a small, skilled team of data engineers.

**What’s in it for you?**

Being South Africa’s largest company of its kind - IDM is continuously growing, with no signs of stopping.

One of our core values is ‘growing people’ and we take that very seriously. We have internal learning opportunities to better our people, and leaders who are experts in their fields and freely impart knowledge and are open to new ideas. As one of our people said, _“you can speak to anyone here. Your rank doesn’t matter. You are listened to._”

Our culture is one of collaboration, diversity, and helpfulness. That goes for our people internally and how we deal with our clients.

At IDM, you can play a part in educating and assisting real South Africans get out of tough financial situations. You can make a difference with the work you do. Our people believe this too - one said, _“I wake up each day knowing I am going to make a difference.”_

Other key benefits:

- We make sure our employees are mentally and physically healthy with Healthy Together campaigns throughout the year.
- We offer various rewards and awards as tokens of recognition for hard work.
- We offer company benefits - like a half day off on your birthday, medical aid, retirement annuity, and further study opportunities should you meet relevant requirements.
- We have a culture of growth, meaning you have access to move both upwards or across in the business if you want to.

  • Data Engineer

    7 months ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Data Engineering Lead

    3 weeks ago

    Cape Town, Western Cape, South Africa Salt South Africa Full time

    Job Title: Data Engineering LeadWe are seeking a skilled Data Engineering Lead to join our team at Salt South Africa. This is a unique opportunity to work on cutting-edge projects and contribute to the growth of our data-driven organization.About the RoleThe Data Engineering Lead will be responsible for designing, building, and maintaining scalable data...

  • Lead Data Engineer

    4 weeks ago

    Cape Town, South Africa IOCO Full time

    We are seeking a highly skilled and experiencedLead Data Engineerto join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business. As a Lead Data Engineer, you will lead a team of data professionals, drive data...

  • Lead Data Engineer

    4 months ago

    Cape Town, South Africa IOCO Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business. As a Lead Data Engineer, you will lead a team of data professionals, drive data...

  • Lead Data Engineer

    4 months ago

    Cape Town, South Africa IOCO Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business. As a Lead Data Engineer, you will lead a team of data professionals, drive data...

  • Data Engineering Lead

    3 months ago

    Cape Town, South Africa iLaunch Full time

    Build a configurable data ingestion platform to collect and protect data Monitor team success Identify the capabilities and capacities from data science and research to design and engineering Matric/ Grade 12 National Diploma in an Information Technology / Bachelor's Degree in computer science, Statistics, Informatics, Information Systems Min 7+ years'...

  • Leading Data Centre Design Manager

    4 weeks ago

    Cape Town, Western Cape, South Africa Vantage Data Centers Full time

    Vantage Data Centres is a leading provider of hyperscale data centre infrastructure, operating across North America, EMEA and Asia Pacific. We power, cool, protect and connect the technology of the world's well-known hyperscalers, cloud providers and large enterprises.We are committed to being a workplace of inclusion, equity, respect and acceptance. Our...

  • Technical Lead

    2 months ago

    Cape Town, Western Cape, South Africa IOCO Full time

    **Job Title:** Technical Lead - Data Engineering**About IOCO:**iOCO is a consultancy that solves complex real-world problems with innovative software solutions. We believe that anything is possible with modern technology, software, and development expertise. We are continuously pushing the boundaries of innovative solutions across multiple industries using...

  • Strategic Data Engineering Lead

    2 days ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Datonomy Solutions is seeking a highly skilled Strategic Data Engineering Lead to join our team in Cape Town. As a key member of our data analytics team, you will play a crucial role in designing and implementing data solutions that drive business growth and decision-making.About the RoleAs a Strategic Data Engineering Lead, you will be responsible for...

  • Data Engineer Lead

    5 days ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    At Datonomy Solutions, we are seeking a highly skilled Data Engineer Lead to support and manage our BI analytics solutions. As a key member of our team, you will have a background in data and business intelligence.About the RoleThe successful candidate will be analytical, an excellent communicator, and possess a problem-solving aptitude. Your primary...

  • Data Engineer Lead

    5 days ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Lead to join our team at Datonomy Solutions. As a key member of our business intelligence team, you will be responsible for designing and implementing data solutions that drive business growth and decision-making.ResponsibilitiesDesign and Implement Data Solutions: Develop and deploy data...

  • Data Engineering Team Lead

    4 weeks ago

    Cape Town, Western Cape, South Africa IOCO Full time

    We are seeking an experienced and skilled Data Engineering Team Lead to join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business.As a Data Engineering Team Lead, you will lead a team of data professionals, drive data...

  • Technical Data Centre Lead

    3 weeks ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    **Job Overview**Data Centrix is seeking a highly skilled Technical Data Centre Lead to join our team. As a key member of our infrastructure team, you will be responsible for the design, implementation, and maintenance of our data centre infrastructure.About the RoleThe Technical Data Centre Lead will be responsible for leading the proactive management of our...

  • Technical Lead

    5 days ago

    Cape Town, Western Cape, South Africa People Solved Full time

    As a Technical Lead - Data Engineering at People Solved, you will play a key role in shaping the company's data engineering strategy and creating innovative solutions. This role requires strong technical skills, leadership abilities, and business acumen.You will work closely with the team to design and implement data products that drive business growth and...

  • Data Engineering Team Lead

    1 month ago

    Cape Town, Western Cape, South Africa wePlace Full time

    About the RoleWe are seeking an experienced Data Engineering Team Lead to lead our data warehouse team responsible for the full product lifecycle of software components in our central warehouse. The successful candidate will be responsible for ensuring the successful delivery of required functionality and maintenance-related tasks within Bank Data...

  • Big Data Engineering Lead

    4 days ago

    Cape Town, Western Cape, South Africa E-Merge Full time

    About the RoleWe are looking for an experienced Data Engineer to lead our data engineering efforts. The successful candidate will be responsible for designing and implementing scalable data solutions to meet the evolving needs of various stakeholders.Key responsibilities include:Data Solution Design: Design and implement scalable data solutions using data...

  • Data Engineering Lead

    3 weeks ago

    Cape Town, Western Cape, South Africa Sanlam Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team and lead the development of cloud-based data services. As a key member of our engineering organization, you will be responsible for designing, implementing, and maintaining scalable and secure data platforms.ResponsibilitiesLead the development of cloud-based data services,...

  • Data Centre Support Lead

    4 days ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    OverviewWe are looking for a highly skilled Technical Team Lead to join our team at Data Centrix in Stellenbosch. In this role, you will be responsible for managing technical escalations, driving process improvements, and developing technical documentation.As a seasoned IT professional with over 10 years of experience, you will have a deep understanding of...

  • Lead Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer - Cloud Expert to join our progressive team at Progressive IT Resourcing.This is a fantastic opportunity for an experienced data engineer looking to take on a leadership role in designing, building, and maintaining large-scale cloud-based data systems.

  • Data Lead

    6 months ago

    Cape Town, South Africa e-Merge IT Recruitment Full time

    A dynamic startup leveraging alternative data to provide unique insights into consumer behaviour for investors and corporate clients with a mission to deliver differentiated and in-depth consumer research, shaping investment decisions and strategic moves in the market. As a small yet ambitious team, they are seeking a talented individual to join as a **Data...