Data Engineer –

2 months ago

Cape Town, South Africa 5th Dimension Consulting Full time

Data Engineer: Ingestions Squad (Group Data & ML Platform)

We’re a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.

The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.

Responsibilities

- Build configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team will build and assemble a tool suite of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineer the platform for observability and performance. Make your systems observable from the outside, taking ownership of their performance. Facilitate real-time tracking of the system’s internal state through logs, metrics, and traces. Define clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secure the platform through compliance engineering initiatives that reduce the time and cognitive load related to compliance. Implement our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platform’s adherence to security and privacy standards, with minimal compliance overhead for users.
- Leverage containerization and infrastructure as code. Implement containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilize tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contribute to technology decisions. Engage in technology spikes to clarify needs and articulate solution criteria. Evaluate different options through hands-on experimentation, leading to documented evaluations and recommendations that are understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.

Requirements

Qualifications

- Matric
- National Diploma in an Information Technology related discipline or a Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field is recommended.

Experience

- 5+ years experience as a Data Engineer in a data platform or service engineering team with at least 2 in a modern context with cloud technologies.
- Track record of high impact and investing in your own development.

Skills/Attributes

- You look for ways to do, instead of reasons not to.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and you turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often; when you fail, you learn and go again. You know that speed gives you the license to fail, because you’re moving fast enough to correct course.
- You love creating more with less.
- You seek out and value different perspectives.

If you would like to submit your CV for consideration, please fill out this form and we will get in touch with you shortly.

#J-18808-Ljbffr

  • Data Engineer

    7 months ago

    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Data Engineer

    2 months ago

    Cape Town, South Africa Axis Data Full time

    Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Engineer at Axis Data, you will lead the development and deployment of data solutions, leveraging your expertise in...

  • Principal Data Architect

    2 months ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to design and build the data architecture of our products. The Data Engineer will use technical knowledge to help develop new products by taking an idea from concept to reality. The role involves working on projects across multiple teams to achieve company goals and objectives. The Data Engineer will...

  • Highly Skilled Network Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionWe are seeking a highly skilled network engineer to join our team at Dimension Data. As a network engineer, you will be responsible for designing, implementing and supporting new IT projects in modern networks, security solutions and cloud technologies.The ideal candidate will have at least 2 years' experience in networking field and possess...

  • Data Architect

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Are you a skilled Data Engineer looking to take your career to the next level?We're seeking an experienced Data Architect to join our team at Dimension Data!About the Role:We're looking for a highly skilled Data Architect to design and build the data architecture of our products. As a key member of our team, you will use your technical knowledge to help us...

  • Data Centrix Senior Virtualization Engineer

    4 weeks ago

    Cape Town, Western Cape, South Africa Data Centrix Full time

    Data Centrix is seeking a highly skilled VMware Server Engineer to join our team. As a critical member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our virtualized environments.The ideal candidate will have extensive experience supporting Microsoft Exchange 2010 or higher, Active Directory, and Hyper-V....

  • Enterprise Data Architect

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an exceptional Enterprise Data Architect to join our team. We are looking for someone with a strong background in data architecture and experience in designing and implementing data exploitation systems.The successful candidate will be responsible for coordinating and managing changes to the MIS database, streamlining MIS...

  • Data Architectural Specialist

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    **Job Summary**We are seeking a skilled Data Architectural Specialist to join our team at Dimension Data. As a key member of our data engineering team, you will design and build the data architecture of our products, utilizing your technical knowledge to develop new products from concept to reality.**Key Responsibilities:**Analyzing business requirements to...

  • Senior Data Center Electrical Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the Role:As a Senior Data Center Electrical Engineer at Amazon Data Services South Africa (Pty) Ltd, you will play a critical role in ensuring the high availability and reliability of our data centers. Your expertise will be instrumental in designing, implementing, and maintaining electrical systems that meet the stringent requirements of our...

  • Data Center Operations Specialist

    1 month ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    About Dimension DataWe are a global technology company that provides innovative solutions to our clients. Our Data Center Operations team is responsible for ensuring the smooth operation of our data centers, providing a secure and reliable environment for our clients' data.Job SummaryWe are seeking an experienced Data Center Operations specialist to join our...

  • Electrical Engineer

    2 months ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    About the RoleAs an Electrical Engineer - Data Center Specialist at Amazon Data Services South Africa (Pty) Ltd, you will play a vital role in ensuring the design, construction, and operation of our data centers. You will be responsible for performing design and equipment submittal reviews, troubleshooting site/equipment failures, and providing full...

  • Data Engineer

    2 months ago

    Cape Town, South Africa MSP Staffing LTD Full time

    Our client is excited to be on the lookout for a talented Data Engineer who will be at the forefront of architecting, building, and maintaining their data infrastructure, supporting data-driven decision-making processes. Join this dynamic and rapidly expanding team, committed to building a world where more SMEs thrive. Key Requirements · Bachelor's degree...

  • Data Center Operations

    7 months ago

    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site Manager/ Senior Operations Manager in operational tasks such as budgeting,...

  • Data Center Electrical Engineer

    6 months ago

    Cape Town, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    As an Amazon Field Engineer, you will provide full life-cycle support to AWS Data Centers from design inception through site improvement and maintenance. You will be the ‘go to’ engineering resource for your region when technical advice is needed, and will use your subject matter expertise and engage with diverse teams to:• Perform design and equipment...

  • Data Center Electrical Engineer Expert

    1 month ago

    Cape Town, Western Cape, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    Company OverviewAmazon Data Services South Africa (Pty) Ltd is a leading provider of cloud computing services. We empower businesses to innovate and grow by providing a robust suite of products and services.Job SummaryWe are seeking an experienced Data Center Electrical Engineer Expert to join our team. As a key member of our AWS Infrastructure Services, you...

  • Highly Skilled Network Engineer for Dimension Data

    4 weeks ago

    Cape Town, Western Cape, South Africa Dimension Data Full time

    Job SummaryWe are seeking an experienced Network Engineer to join our team at Dimension Data. As a key member of our technical staff, you will be responsible for ensuring the smooth operation of our IT infrastructure.Your primary focus will be on managing hardware, software, and networks to guarantee optimal performance. You should have extensive knowledge...

  • Data Engineer

    3 weeks ago

    Cape Town, South Africa Santam Insurance Full time

    Job title : Data EngineerJob Location : Western Cape, BellvilleDeadline : December 25, 2024Quick Recommended Links Jobs by Location Job by industries What will you do? Santam Ltd has a vacancy within the Group Underwriting division for a Data Engineer.  The role reports to the Head: Data Analytics and will ideally based in Belville, Cape Town. What will...

  • Data Engineer

    4 weeks ago

    Cape Town, South Africa Qetello Holdings Full time

    Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seamless integration and accessibility of data across the organisation.Responsibilities:• Data Reporting:o...

  • Data Engineer

    3 weeks ago

    Cape Town, South Africa Qetello Holdings Full time

    Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seamless integration and accessibility of data across the organisation.Responsibilities:• Data Reporting:o...

  • Data Engineer

    4 weeks ago

    Cape Town, South Africa Qetello Holdings Full time

    Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seamless integration and accessibility of data across the organisation. Responsibilities: • Data...