Senior Data Engineer

5 days ago

Bellville, Western Cape, South Africa Sanlam Full time

Sanlam Life and Savings (SLS) is focused on serving our retail and corporate clients in South Africa and further developing our strategic advantages in the South African market. Sanlam Life and Savings consists of three clusters - Sanlam Corporate, Sanlam Retail Mass and Sanlam Retail Affluent. The Sanlam Life and Savings Office provides strategic direction, coordination and support to the three clusters, as well as performing governance oversight that includes assurance provided by second line of defense functions in SLS, to enable us to meet our business objectives.

Role Description

As the Product Data Hub (PDH) Senior Data Engineer, your focus will be on designing, building, and optimizing data infrastructure to support business needs, analytics, data science, and business intelligence within the organization. This role is a blend of technical and strategic responsibilities, and you will act as both a builder and an architect of data systems while also guiding the team and aligning data engineering efforts with business objectives. The role requires a deep understanding of several key areas, combining technical, architectural, and strategic knowledge to build and maintain high-quality data infrastructure. Critical areas where in-depth expertise is required include Data Architecture and Modeling, ETL Processes and Data Pipelines, Database and Storage Technologies, Programming and Performance Optimisation.

Key Responsibilities

Data Architecture and design

  • Lead the design, development, implementation and maintaining of innovative and scalable data pipelines and solutions tailored to client requirements to enable our key projects to deliver on time.
  • Leverage Wherescape to build, deploy, and automate data pipelines for efficient data ingestion and transformation.
  • Architect scalable and maintainable data solutions that meet business requirements and performance benchmarks.
  • Stay updated with the latest industry trends and technologies.
  • Optimize and manage data storage solutions.
  • Analyze solution performance and gather feedback to identify areas for improvement.
  • Implement changes and enhancements based on client feedback and industry best practices.

Ensure data governance and compliance with data policies

  • Ensure high standards of data quality, accuracy, and consistency across multiple data sources and pipelines.
  • Implement data governance best practices, including metadata management and data lineage, in line with organizational requirements.
  • Develop and enforce data validation and quality control mechanisms across data sources.

ETL Development and Automation

  • Develop, implement, and manage ETL processes using Wherescape and other relevant tools to ensure efficient data extraction, transformation, and loading.
  • Optimize data workflows and troubleshoot issues to enhance data processing efficiency and reliability.
  • Implement and maintain scheduling, monitoring, and alerting for data pipelines to ensure consistent data availability.

Collaboration and Support

  • Collaborate closely with Data Scientists, Data Analysts, and Business Intelligence teams to support data needs and ensure alignment with analytics goals.
  • Work with cross-functional teams to troubleshoot, diagnose, and resolve data-related issues in a timely manner.
  • Mentor and guide junior data engineers, fostering a culture of knowledge sharing and technical excellence.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.
  • 8+ years of experience in data engineering or a related field.

Required skills

  • Strong understanding of data architecture, ETL processes, software development and architecture.
  • Expert in SQL and advanced data warehousing techniques.
  • Proficiency in relevant technologies and platforms.
  • Hands-on experience with Wherescape for ETL automation and data warehousing solutions.
  • Proficiency in SAP HANA, with experience in designing, managing, and optimizing HANA data models and architecture.
  • Proficiency with big data technologies such as Hadoop, Spark, or Kafka.
  • Understanding of data warehousing principles (Kimball and Data Vault patterns are preferred) and dimensional data modelling (e.g., OLAP).
  • Extensive experience with Python or other programming languages.
  • Experience with object-oriented/functional/scripting languages, e.g., Python and Java.
Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

#J-18808-Ljbffr

  • Senior Data Engineer

    7 days ago

    Bellville, Western Cape, South Africa Sanlam Limited Full time

    Senior Software Engineer - Data, Group Data & ML Platform Tribe Location: Bellville, Western Cape, ZAWho are we?Sanlam Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms...

  • Data Engineering Lead

    5 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    As a Senior Data Engineer at Sanlam, you will play a key role in designing and building innovative data infrastructure solutions to support business needs. This involves collaborating with cross-functional teams to architect scalable and maintainable data systems that meet performance benchmarks.You will leverage your expertise in ETL processes, data...

  • Senior Data Solutions Architect

    5 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Sanlam Life and Savings (SLS) is a leading provider of financial services in South Africa, serving retail and corporate clients through its three clusters: Sanlam Corporate, Sanlam Retail Mass, and Sanlam Retail Affluent. As a Senior Data Engineer, you will contribute to the strategic direction of SLS by designing and implementing data infrastructure...

  • Strategic Data Infrastructure Manager

    5 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Sanlam is a leading financial services provider in South Africa, offering a wide range of products and services to its clients. The company is committed to innovation and excellence, and its data engineering team plays a critical role in supporting these efforts.As a Senior Data Engineer, you will work closely with cross-functional teams to design and...

  • Enterprise Data Integration Specialist

    5 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Sanlam's Product Data Hub (PDH) team is seeking an experienced Senior Data Engineer to join its ranks. As a key member of this team, you will design, build, and optimize data infrastructure to support business needs, analytics, data science, and business intelligence within the organization.This role offers a unique blend of technical and strategic...

  • Senior Clinical Data Manager

    4 days ago

    Bellville, Western Cape, South Africa IQVIA Full time

    Job Title: Senior Clinical Data ManagerAbout the Role:We are seeking a highly experienced Senior Clinical Data Manager to join our team at IQVIA.About the Role:The successful candidate will take the lead with trial customers and other internal and external partners to establish, align, and confirm data management expectations.They will create, plan, and...

  • Senior Control Engineer

    4 days ago

    Bellville, Western Cape, South Africa RNB Placements Full time

    We are looking for a highly skilled Senior Control Engineer to lead our electrical control systems design team in Bellville. The ideal candidate will have extensive experience in PLC programming and control loop tuning, with a strong understanding of industrial control environments.ResponsibilitiesEstimate and prepare proposals for electrical and...

  • Senior Civil Engineer

    1 day ago

    Bellville, Western Cape, South Africa Ayanda Mbanga Communications Full time

    Job OverviewWe are seeking a Senior Civil Engineer to join our Planning Section at Ayanda Mbanga Communications. As a key member of our Bulk Water Branch, you will be responsible for managing, guiding, and mentoring personnel, as well as coordinating meetings and providing comments/opinions on matters affecting Bulk Water Planning.Key...

  • Senior IT Engineer Position

    4 days ago

    Bellville, Western Cape, South Africa Sintrex Full time

    Job DescriptionWe are seeking an experienced Associate Engineer to join our team in a highly pressured environment. As an Associate Engineer, you will be responsible for various tasks including:Compiling advanced reports and analyzing data from management systems to identify areas of improvement and risk.Planning and performing special investigations based...

  • Senior Data Scientist

    1 day ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Santam Ltd has a vacancy within the Group Underwriting division for a Senior Data Scientist. The role reports to the Head: Data Analytics and will ideally be based in Belville, Cape Town. This role is also open to candidates who are willing to relocate to the Western Cape.JOB DESCRIPTIONThe role requires a candidate with the ability to leverage the knowledge...

  • Senior Structural Engineer

    2 days ago

    Bellville, Western Cape, South Africa Edifice Consulting Engineers Full time

    We are searching for a dynamic and motivated Structural Engineer / Engineering Technologist to join an established medium-sized Consulting Engineering firm located in Bellville (Cape Town). The candidate must have 7 - 10 years post-graduation design experience as a Structural Engineer / Structural Engineering Technologist in Structural Consulting...

  • Data Analyst

    4 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Job DescriptionData Preparation:Independently acquire data from various data sources and combine & transform data into interpretable datasets, reports, or dashboards.Assess the effectiveness and accuracy of new data sources and data gathering techniques, and extend the company's data with third-party sources of information when required.Independently...

  • Senior Civil Engineer

    2 days ago

    Bellville, Western Cape, South Africa Edifice Consulting Engineers Full time

    We are searching for a dynamic and motivated Professional Civil Engineer/ Civil Engineering Technologist to join an established medium-sized Consulting Engineering firm located in Bellville (Cape Town). The candidate must have 7-10 years experience as a Civil Engineering Consultant with post-graduation design experience in municipal infrastructure projects...

  • Data Insights Developer

    7 days ago

    Bellville, Western Cape, South Africa Sanlam Limited Full time

    We are seeking an experienced Data Insights Developer to join our Business Intelligence department. The successful candidate will be responsible for developing and implementing data insights solutions to drive business growth.Main Responsibilities:This role will be responsible for developing and implementing data insights solutions using various data tools...

  • Data Analyst Professional

    7 days ago

    Bellville, Western Cape, South Africa Sanlam Limited Full time

    An exciting opportunity exists to join our Business Intelligence department as a highly skilled Data Analyst. The successful candidate will be responsible for assisting in the impact and data dependency analysis between data sources within the BI environment.Key Responsibilities:Guided by senior management, this role will be responsible for performing...

  • Data Analyst Position

    4 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Job OverviewWe are seeking a highly skilled Data Analyst to join our team at Sanlam.About the RoleThe successful candidate will be responsible for independently acquiring data from various sources, processing, and verifying its integrity. They will also analyze results using analytical techniques, provide reports, and maintain dashboards.Key...

  • Senior Python Developer

    4 weeks ago

    Bellville, Western Cape, South Africa Kontak Recruitment Full time

    Senior Python Developer (Django) (JB5138) Bellville, Cape Town (Hybrid) R80 000 - R100 000 CTC per month Permanent An exciting opportunity awaits an experienced Senior Python Developer to lead the modernization of an insurance platform. This role involves designing and implementing scalable APIs, improving system architecture, and mentoring a development...

  • Senior Contracts Engineer Position

    4 days ago

    Bellville, Western Cape, South Africa Afpol Full time

    Our manufacturing client in Cape Town seeks a seasoned Contracts Engineer to oversee projects and maintain relationships with customers.Key ResponsibilitiesDefine project objectives, track progress, and update programmes regularly.Meet with clients to discuss project status and address concerns.Maintain strong working relationships with clients to ensure...

  • Mechanical/Mechatronic Engineer

    3 weeks ago

    Bellville, Western Cape, South Africa Hire Resolve Full time

    Job Title: Mechanical/Mechatronic Engineering Candidates (Engineer/Technologist/Technician) Location: Bellville, South Africa Industry: Mechanical/Mechatronic Engineering Job Overview: Hire Resolve is seeking skilled Mechanical/Mechatronic Engineering professionals (Engineers, Technologists, and Technicians) with 2 to 8 years of experience to join our...

  • Actuary - MI Data Analysis and Strategy

    4 days ago

    Bellville, Western Cape, South Africa Sanlam Full time

    Actuary - MI Data Analysis and StrategyThis role involves working as an Actuary in MI data analysis and strategy, focusing on delivering high-quality reporting solutions.Key Accountabilities:Analyse MI data to identify trends and insights, informing business decisions.Design and develop MI reporting processes, incorporating data from various...