Senior Data Engineer

7 days ago


Durban, South Africa Old Mutual Full time
Job title : Senior Data Engineer Job Location : KwaZulu-Natal, Durban Deadline : December 28, 2024 Quick Recommended Links
  • Jobs by Location
  • Job by industries

Job Description

  • Senior Data Engineer will lead the development and optimization of our data infrastructure, playing a critical role in shaping the future of our data architecture. They will be responsible for designing and implementing complex data solutions, mentoring team members, and collaborating with stakeholders to drive innovative data initiatives for Old Mutual. 
  • This position requires extensive experience in data engineering, a deep understanding of advanced data technologies, and the ability to provide strategic guidance.
  • Architectural Leadership: Lead the design and implementation of scalable, high-performance data architectures.
  • Provide strategic input into the evolution of the company's data infrastructure and technology stack.
  • Advanced Data Modelling: Design and implement advanced data models to meet complex business requirements. Optimize data storage and retrieval mechanisms for optimal performance.
  • Big Data and Advanced Analytics: Champion the use of advanced analytics and big data technologies to derive valuable insights.
  • Work on advanced analytics solutions, including machine learning pipelines and predictive modelling.
  • Performance Optimization: Oversee the optimization of data pipelines, databases, and ETL processes for maximum efficiency. Conduct in-depth performance tuning and troubleshooting of complex data workflows.
  • Team Leadership and Mentorship: Lead a team of data engineers, providing technical guidance and mentorship. Foster a culture of continuous learning and collaboration within the data engineering team.
  • Cross-functional Collaboration: Collaborate with data scientists, analysts, software developers, and other stakeholders to understand business needs and deliver comprehensive data solutions.
  • Act as a key liaison between the data engineering team and other business units.
  • Data Governance and Compliance: Establish and enforce data governance policies, ensuring data quality, integrity, and compliance with regulatory requirements.
  • Stay abreast of industry best practices and emerging trends in data governance.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 10+ years of experience in data engineering with a focus on complex data solutions.
  • Expert proficiency in programming languages such as Python, SQL, and advanced scripting languages.
  • In-depth knowledge of data warehousing concepts, big data technologies, and cloud platforms (e.g., AWS, Azure, Google Cloud).
  • Proven experience in leading and mentoring a team of data engineers.
  • Strong analytical and problem-solving skills with a strategic mindset.
  • Excellent communication and collaboration skills.

Preferred Skills:

  • Certifications in relevant data engineering, cloud, or advanced analytics technologies.
  • Experience with real-time data processing and streaming technologies.
  • Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with data security and privacy considerations.

Skills

  • Advanced Analytics, Agile Methodology, Amazon Web Services (AWS), Analytical Thinking, Data Engineering, Data Lakehouse Architecture, Data Modeling, Machine Learning, Microsoft Power Business Intelligence (BI), PySpark, Python (Programming Language), Scaled Agile Framework (SAFe), Structured Query Language (SQL)

  • Research / Data Analysis  jobs

  • Senior Data Engineer

    2 weeks ago


    Durban, South Africa Old Mutual Full time

    Job title : Senior Data EngineerJob Location : KwaZulu-Natal, DurbanDeadline : December 28, 2024Quick Recommended Links Jobs by Location Job by industries Job Description Senior Data Engineer will lead the development and optimization of our data infrastructure, playing a critical role in shaping the future of our data architecture. They will be...


  • Durban, KwaZulu-Natal, South Africa beBee Professionals Full time

    BeBee Professionals is a leading organization in the field of data recovery, with a presence in Durban. We are seeking a highly skilled Senior Data Recovery Engineer to join our team.Job OverviewThe successful candidate will be responsible for recovering data from damaged or corrupted storage media, including hard drives, flash drives, and other digital...


  • Durban, South Africa Tampa Gardens Senior Living Full time

    Gauteng: Senior Mechanical Engineer posted by AtripleA recruitment & temps The Mechanical Engineer will be responsible for all activities related to the effective and professional compilation of proposals / tenders as well as cost-effective, compliant, fit-for-purpose, safe engineering, design, construction support and commissioning assistance during the...


  • Durban, KwaZulu-Natal, South Africa Carlysle Human Capital Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Carlysle Human Capital. As a key member of our IT department, you will be responsible for designing and developing scalable data pipelines and related systems in a research-focused environment.Job DescriptionDesign and develop end-to-end technical aspects of...

  • Data Centre Operations

    6 months ago


    Durban South, South Africa Dimension Data Full time

    FunctieomschrijvingData Centre Operations (KZN)LOCATIONDurban, South AfricaTYPEPermanentDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site...


  • Durban, KwaZulu-Natal, South Africa Goldman Tech Resourcing Full time

    At Goldman Tech Resourcing, we are on the lookout for a skilled Senior Data Engineer to spearhead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing cutting-edge data pipelines that drive business growth and customer engagement.We are seeking an experienced professional with a strong background...


  • Durban, KwaZulu-Natal, South Africa LexisNexis (Proprietary) Limited Company Full time

    About the RoleAs a Senior Data Engineer with LexisNexis (Proprietary) Limited Company, you will be responsible for designing, developing, and maintaining analytical solutions using Amazon Redshift and Tableau. You will apply your expertise in data modeling, SQL querying, data analysis, and data presentation techniques to drive business insights and...


  • Durban, South Africa Carlysle Human Capital Full time

    This role is for a Senior Data Engineer to help build and maintain scalable data pipelines and related systems in a research focused environment. You will be responsible for designing, developing, testing, and deploying technical platforms and data solutions that meet the business requirements and align with the scientific goals. You will collaborate with...


  • Durban North, KwaZulu-Natal, South Africa Communicate Recruitment Full time

    Company Overview: We are a reputable recruitment agency in Cape Town, specializing in IT careers and developer job placements. Our team is dedicated to connecting talented professionals with exciting opportunities that drive businesses forward. Job Summary: We are seeking an experienced Senior Software Engineer to join our team as a Data Management...


  • Durban, KwaZulu-Natal, South Africa OfferZen Ltd Full time

    Job Description:Are you looking for a challenging role as a Data Engineer? OfferZen Ltd is seeking a talented professional with experience in handling large data sets and working with big data tools such as Hadoop, Spark, and Kafka. Key Responsibilities:Design and develop data pipelines and workflow management toolsWork with SQL and NoSQL...


  • Durban, KwaZulu-Natal, South Africa Goldman Tech Resourcing Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Goldman Tech Resourcing.About the Role:The ideal candidate will have strong proficiency with data extraction, transformation, and loading (ETL) processes. They should be familiar with data modeling and schema design for efficient data storage and retrieval. Good...


  • Durban, KwaZulu-Natal, South Africa Communicate Recruitment Full time

    About Our CompanyCommunicate Recruitment is a leading staffing agency that specializes in matching top talent with innovative companies.Job SummaryWe are seeking an experienced Senior Software Engineer to join our team as a Data Management Specialist. In this role, you will play a key part in building cutting-edge solutions that drive business forward with...


  • Durban, KwaZulu-Natal, South Africa NTT DATA Full time

    About the RoleWe are seeking a talented Managed Services Engineer to join our team at NTT DATA.Job DescriptionThe Managed Services Cross Technology Engineer (L1) is an entry-level engineering role, responsible for providing a managed service to clients to ensure their IT infrastructure and systems remain operational.Your Key ResponsibilitiesMonitor client...


  • Durban North, KwaZulu-Natal, South Africa Communicate Recruitment Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team in La Lucia, working on innovative real-time reporting tools that drive business growth. As part of this role, you will have the opportunity to shape the future of data management using cutting-edge technologies.Key ResponsibilitiesDesign and develop software solutions...

  • Network Engineer

    2 weeks ago


    Durban, KwaZulu-Natal, South Africa NTT Data Full time

    NTT Data: A Leader in Digital TransformationWe are seeking a highly skilled Network Engineer to join our team at NTT Data. This is an exceptional opportunity for a motivated and experienced professional to take their career to the next level.About the Role:This position is responsible for providing advanced infrastructure support for our network...


  • Durban, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Durban, KwaZulu-Natal, South Africa Edge Executives Full time

    Job OverviewWe are seeking a highly skilled and experienced Senior Data Centre Maintenance Manager to lead our critical data center infrastructure maintenance, operation, and reliability efforts. This includes HVAC systems, electrical supply, and mechanical systems, ensuring optimal performance and minimal downtime.Key Responsibilities:Maintenance Strategy...


  • Durban, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Durban, KwaZulu-Natal, South Africa LexisNexis (Proprietary) Limited Company Full time

    About LexisNexis (Proprietary) Limited CompanyWe are seeking a highly skilled Senior Data Engineer to join our team. This role offers an attractive salary of $115,000 per annum.Job DescriptionIn this position, you will be responsible for designing, developing, and maintaining analytical solutions using Amazon Redshift and Tableau.You will apply your solid...


  • Durban, KwaZulu-Natal, South Africa Data Centrix Full time

    **Job Title:** Senior Business AnalystCritical RequirementsHold a Matric or Grade 12 qualificationPossess an IT qualification, such as a certification, diploma, or degreeHold a BA certification, preferably a FTI DiplomaExperienceMinimum 3-5 years of experience as a Business Analyst in projectsOpenText product experience is an advantageCompetenciesEffective...