Senior Data Engineer

2 weeks ago

Cape Town, South Africa Progressive IT Resourcing Full time

Our Client

Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company

.What will you do?

A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.

The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.

What will make you successful in this role?

What success will look like for you 12 months into the role.

  • Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
  • Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the system’s internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
  • Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platform’s adherence to security and privacy standards, with minimal compliance overhead for users.
  • Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
  • Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
  • Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
  • Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.

Qualification

  • Matric
  • National Diploma in an Information Technology related discipline or a bachelor's degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.

Experience

  • 5+ years' experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
  • Track record of high impact and investing in your own development.

Skills and Thinking Preference

  • Ability to act independently and to deal with high levels of ambiguity.
  • You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
  • Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
  • You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because you’re moving fast enough to correct course.
  • You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; it’s about exceeding the needs of millions. And working through small and mighty teams is way we’ll do it.
  • You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.

Personal Attributes

  • Plans and aligns - Contributing through others
  • Optimises work processes - Contributing through others
  • Collaborates - Contributing strategically
  • Resourcefulness - Contributing strategically
  • Tech savvy - Contributing strategically

Core Competencies

  • Cultivates innovation - Contributing through others
  • Customer focus - Contributing through others
  • Drives results - Contributing through others
  • Collaborates - Contributing through others
  • Being resilient - Contributing through others

  • Senior Data Engineer

    5 days ago

    Cape Town, South Africa PARK Senior Villas Chandler Full time

    Lula is a FinTech company focused on optimizing cash flow for small businesses. The Senior Data Engineer role involves implementing and maintaining data models to improve data reliability and quality. This position requires creating consistent formats from raw information and developing architectures for data extraction and transformation. The role also...

  • Senior SCCM Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryThe Senior SCCM Engineer is a key member of the Dimension Data team, responsible for ensuring the smooth operation of our End User Compute environment. This role requires a high level of technical expertise, as well as excellent problem-solving and communication skills.Key ResponsibilitiesInfrastructure ManagementThe Senior SCCM Engineer is...

  • Data Engineer

    5 months ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Senior Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Accounting and Financial Advisory Ltd Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have a strong background in data engineering, data processing, and data modeling. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and other data...

  • Senior Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa The Skills Mine Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at The Skills Mine. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining robust data pipelines that ensure the efficient and reliable flow of data across our systems.Key Responsibilities:Design and Implement Data...

  • Senior Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Accounting and Financial Advisory Ltd Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have a strong background in data engineering, data processing, and data modeling.Key Responsibilities:Design, develop, and maintain data pipelines and data warehouses.Conduct unit testing and troubleshooting to ensure data...

  • Senior Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa CodeConnect Staffing (Pty) Ltd Full time

    About the Role:CodeConnect Staffing (Pty) Ltd is seeking a talented Senior Data Engineer to join their team and contribute to their exciting journey. As a Senior Data Engineer, you will lead the design, development, and maintenance of scalable data pipelines and architectures. Your role will be pivotal in driving the strategic direction of data initiatives,...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Progressive IT Resourcing. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining our data platforms and services.About the RoleThe Senior Data Engineer will be responsible for:Designing and implementing data ingestion...

  • Senior Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Acuity Consultants. As a Senior Data Engineer, you will be responsible for designing and building scalable data pipelines using Apache Spark, developing high-quality code in Java and Scala, and modernizing legacy pipelines to ensure smooth...

  • Avaya Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Avaya Engineer - Dimension DataWe are seeking a highly skilled Avaya Engineer to join our team at Dimension Data. As an Avaya Engineer, you will be responsible for providing technical support and expertise to our clients and internal teams.Key Responsibilities:Proactively monitor and resolve technical incidents and problems to ensure minimal...

  • Senior Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa The Skills Mine Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at The Skills Mine. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining robust data pipelines that ensure the efficient and reliable flow of data across our systems.Key Responsibilities:Design and Implement Data...

  • Senior Network Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionDimension Data is seeking a highly skilled Senior Network Engineer to join our team. As a Senior Network Engineer, you will be responsible for designing, implementing, and maintaining complex network infrastructure to support our clients' business needs.Key ResponsibilitiesDesign and implement network architecture to meet client...

  • Senior Data Engineer

    2 days ago

    Cape Town, South Africa Aculocity Full time

    Description Aculocity Data Team: Senior Data Engineer, Job description Premise: The Senior Data Engineer is to be a lead resource in building and developing the Aculocity Data capabilities. As Senior Data Engineer, you will play a pivotal role in our agile Data Engineering team, leading the design, development, and optimization of complex data...

  • Senior Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job DescriptionThis is a fantastic opportunity for a Senior Data Engineer to work on a global leader in music streaming services, designing and building scalable data pipelines for the algorithmic music recommendation feature of the streaming service.This is a Cape Town-based (hybrid working) role.The CTC on offer for this role is R1,4 – R1,6 million per...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Network Recruitment. As a Senior Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Apache Spark, Scala, and Java.Key Responsibilities:Data Pipeline Development: Design and implement scalable data pipelines...

  • Senior Network Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionJob SummaryWe are seeking a highly skilled and experienced Senior Network Engineer to join our team at Dimension Data. As a Senior Network Engineer, you will be responsible for designing, implementing, and maintaining complex network infrastructure solutions for our clients.Key ResponsibilitiesDesign and implement network infrastructure...

  • Senior Avaya Support Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Senior Avaya Support EngineerDimension Data is seeking a highly skilled Senior Avaya Support Engineer to join our team. As a Senior Avaya Support Engineer, you will be responsible for providing technical support and expertise to our clients, ensuring that their Avaya systems are running smoothly and efficiently.Key Responsibilities:Provide...

  • Senior Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Acuity Consultants Full time

    Job DescriptionThis is a fantastic opportunity for a Senior Data Engineer to work on the global leader in music streaming services, designing & building scalable data pipelines for the algorithmic music recommendation feature of the streaming service.This is a Cape Town-based (hybrid working) role.The CTC on offer for this role is R1,4 – R1,6 million per...

  • Senior Data Engineer

    2 days ago

    Cape Town, Western Cape, South Africa Aculocity Full time

    Job Title: Senior Data EngineerDescriptionAculocity Data Team: Senior Data Engineer, Job descriptionPremise:The Senior Data Engineer is to be a lead resource in building and developing the Aculocity Data capabilities.As Senior Data Engineer, you will play a pivotal role in our agile Data Engineering team, leading the design, development, and optimization of...

  • Senior Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Datonomy Solutions Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Datonomy Solutions. As a key member of our data analytics team, you will play a crucial role in designing, developing, and maintaining our business intelligence systems.Key ResponsibilitiesDesign and Develop BI Solutions: Utilize your expertise in data engineering to...