Data Engineer –

2 days ago

Cape Town, South Africa 5th Dimension Consulting Full time

Data Engineer: Ingestions Squad (Group Data & ML Platform)

We’re a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.

The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.

Responsibilities

- Build configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team will build and assemble a tool suite of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineer the platform for observability and performance. Make your systems observable from the outside, taking ownership of their performance. Facilitate real-time tracking of the system’s internal state through logs, metrics, and traces. Define clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secure the platform through compliance engineering initiatives that reduce the time and cognitive load related to compliance. Implement our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platform’s adherence to security and privacy standards, with minimal compliance overhead for users.
- Leverage containerization and infrastructure as code. Implement containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilize tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contribute to technology decisions. Engage in technology spikes to clarify needs and articulate solution criteria. Evaluate different options through hands-on experimentation, leading to documented evaluations and recommendations that are understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.

Requirements

Qualifications

- Matric
- National Diploma in an Information Technology related discipline or a Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field is recommended.

Experience

- 5+ years experience as a Data Engineer in a data platform or service engineering team with at least 2 in a modern context with cloud technologies.
- Track record of high impact and investing in your own development.

Skills/Attributes

- You look for ways to do, instead of reasons not to.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and you turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often; when you fail, you learn and go again. You know that speed gives you the license to fail, because you’re moving fast enough to correct course.
- You love creating more with less.
- You seek out and value different perspectives.

If you would like to submit your CV for consideration, please fill out this form and we will get in touch with you shortly.

#J-18808-Ljbffr

  • Data Engineer

    5 months ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Avaya Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Avaya Engineer - Dimension DataWe are seeking a highly skilled Avaya Engineer to join our team at Dimension Data. As an Avaya Engineer, you will be responsible for providing technical support and expertise to our clients and internal teams.Key Responsibilities:Proactively monitor and resolve technical incidents and problems to ensure minimal...

  • Network Engineer

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About the RoleWe are seeking a highly skilled Network Engineer to join our team at Dimension Data. As a Network Engineer, you will play a critical role in ensuring the smooth operation of our IT infrastructure.Key ResponsibilitiesDesign, implement, and maintain network infrastructure, including hardware and software components.Configure and troubleshoot...

  • Data Architect

    1 week ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Data EngineerAt Dimension Data, we're seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you'll play a critical role in designing and building the data architecture of our products.Key Responsibilities:Analyze business requirements and design databases, reports, and tools for analytical needs.Build reports with analysis...

  • Data Architect

    3 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job Title: Data EngineerAt Dimension Data, we're seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you'll play a critical role in designing and building the data architecture of our products.Key Responsibilities:Analyze business requirements to design and implement data solutionsDevelop and maintain databases, reports, and tools...

  • Data Center Electrical Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking an experienced Electrical Engineer to join our team at Amazon Data Services South Africa (Pty) Ltd. As a Data Center Electrical Engineer, you will play a critical role in the design, construction, and operation of our data centers.Key ResponsibilitiesDesign and implement electrical systems for data centers, including power...

  • Data Center Electrical Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking an experienced Electrical Engineer to join our team at Amazon Data Services South Africa (Pty) Ltd. As a Data Center Electrical Engineer, you will play a critical role in the design, planning, and operation of our data centers.Key ResponsibilitiesDesign and implement electrical systems for data centers, including power...

  • Data Center Operations Specialist

    1 week ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Data Center Operations RoleWe are seeking a skilled Data Center Operations professional to join our team at Dimension Data. As a Data Center Operations Specialist, you will be responsible for managing the day-to-day operations of our data centers, ensuring the smooth delivery of services to our clients.Key ResponsibilitiesManage and monitor the...

  • Data Center Operations Specialist

    3 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Data Center Operations RoleWe are seeking a skilled Data Center Operations professional to join our team at Dimension Data. As a Data Center Operations person, you will be responsible for managing the day-to-day operations of our data centers, ensuring the smooth delivery of services to our clients.Key ResponsibilitiesPerform daily inspections of data center...

  • Senior Data Center Electrical Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking an experienced Electrical Engineer to join our team at Amazon Data Services South Africa (Pty) Ltd. As a Senior Data Center Electrical Engineer, you will be responsible for providing full life-cycle support to our data centers from design inception through site improvement and maintenance.Key ResponsibilitiesPerform design and...

  • Senior Data Center Electrical Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleWe are seeking an experienced Electrical Engineer to join our team at Amazon Data Services South Africa (Pty) Ltd. As a Data Center Electrical Engineer, you will be responsible for providing technical support and expertise to our data center operations team.Key ResponsibilitiesDesign and implement electrical systems for our data centers,...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Network Recruitment Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Network Recruitment. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data...

  • Data Engineer

    4 days ago

    Cape Town, Western Cape, South Africa Sanlam Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Sanlam. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and develop efficient data pipelines using SAS, SQL, and cloud technologies.Create and optimize data models to support...

  • Data Engineer

    5 days ago

    Cape Town, South Africa Creative CFO Full time

    The position: As a Data Engineer at Creative CFO, you will be at the forefront of architecting, building, and maintaining our data infrastructure, supporting data-driven decision-making processes. We are dedicated to optimising data flow and collection to enhance our financial clarity services for high-growth businesses. Join our dynamic and rapidly...

  • Data Engineer

    3 weeks ago

    Cape Town, Western Cape, South Africa West Coast Personnel Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at West Coast Personnel. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and implement data models and reporting techniques to support business intelligence initiativesDevelop and...

  • Data Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa takealot Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Takealot Group. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures using BigQuery, DataForm, and Looker.Develop...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job DetailsWe are seeking a highly skilled Data Engineer to join our team at Progressive IT Resourcing. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data platforms and services.About UsOur company, Progressive IT Resourcing, is a leading provider of digitally enabled technology services. We operate across...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa West Coast Personnel Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at West Coast Personnel. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key Responsibilities:Design and implement data models and reporting techniques to support business intelligence initiativesDevelop and...

  • Data Center Operations

    5 months ago

    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site Manager/ Senior Operations Manager in operational tasks such as budgeting,...

  • Data Engineer/Senior Data Engineer

    4 days ago

    Cape Town, South Africa Tbwa ChiatDay Inc Full time

    Inizio, the world’s leading healthcare and communications group providing marketing and medical communications services to healthcare clients. We have 5 main divisions within the group Medical, Advisory, Engage, Evoke and Biotech. Our Medical Division focuses on communicating evidence on new scientific and drug developments and educating healthcare...