Data Engineering Director

14 hours ago

Johannesburg, Gauteng, South Africa Deka Minas (Pty) Ltd Full time

We are excited to introduce an exceptional opportunity for a Data Engineering Director In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data processing patterns, such as ELT, and strategically utilizing Operational Data Stores (ODS) to meet our evolving data requirements in a dynamic technological landscape.

Duties and Responsibilities include but are not limited to:

  • Lead the architectural design and implementation of scalable data engineering solutions, leveraging advanced cloud data warehouse technologies (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, or Azure Synapse Analytics). This includes promoting the adoption of ELT patterns over traditional ETL processes to enhance data agility and efficiency.
  • Champion the development and evaluation of proof of concept (POC) initiatives for the adoption of an Operational Data Store (ODS) and other modern data processing frameworks, such as the Medallion Architecture, ensuring our approach remains technology-agnostic and aligned with best practices.
  • Oversee the optimization of data flows, utilizing ELT processes to streamline data loading and transformation in cloud data warehouses, ensuring high data quality and accessibility.
  • Direct and refine CI/CD processes for seamless data pipeline deployments, incorporating best practices in version control with git.
  • Collaborate with cross-functional teams to capture and address comprehensive data requirements, ensuring robust support for business analytics and decision-making.
  • Uphold rigorous data security and compliance standards, aligning with financial industry regulations and evolving data privacy best practices.

Key Requirements

  • Experience: Minimum of 5 years in Data Engineering, including 2+ years in a senior or leadership role, with a preference for experience in the financial services sector.
  • Technical Expertise: Proficiency in at least one major cloud data warehouse solution (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, Azure Synapse Analytics), with a strong emphasis on implementing ELT patterns and familiarity with modern data architecture frameworks like the Medallion Architecture.
  • Leadership and Innovation: Demonstrated leadership in driving the adoption of modern data processing strategies, with the ability to manage complex projects and innovate within the data engineering space.
  • Programming Skills: Strong proficiency in programming languages such as Python or Java and can demonstrate advanced knowledge of SQL on a cloud data warehouse solution, essential for developing and managing ELT processes.
  • Certifications: Cloud platform certification (e.g., AWS Solutions Architect, Google Cloud Professional Data Engineer, Snowflake SnowPro) is highly desirable.
  • Communication: Excellent verbal and written communication skills, essential for effective collaboration across teams and with stakeholders.

Minimum Qualifying Attributes:

  • Hands-on experience with CDC-based data ingestion tools and methodologies.
  • Comprehensive understanding of data modeling, ETL/ELT processes, and ensuring data security and privacy, especially within the financial industry.

The successful candidate will have the opportunity to work with a highly skilled team and enjoy a competitive salary of R1,200,000 per annum. We offer a range of benefits, including health insurance, retirement fund contributions, and generous annual leave.

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Data Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our Data Engineering team at Data Centrix. In this role, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing and data ingestion environments.You will work closely with our data architects to design and implement data models, and...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...

  • Cloud Data Engineer: Designing Scalable Data Pipelines

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...

  • Global ABM Programs Director

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleWe are seeking a highly skilled and experienced Global ABM Programs Director to join our team at NTT DATA. This is an exciting opportunity to drive business growth and development across the globe.Job DescriptionThe Global ABM Programs Director will be responsible for executing our ABM methodology, driving engagement with NTT DATA worldwide,...

  • Cloud Data Architect

    1 month ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging cloud-based...

  • Transformation Analytics Director

    4 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a skilled Transformation Analytics Director to lead our team in driving business growth through data-driven insights. As a key member of our Global Business Services (GBS) team, you will be responsible for developing and implementing analytics strategies to measure and improve user adoption and consumption of digital...

  • Director of Platform Engineering

    1 week ago

    Johannesburg, Gauteng, South Africa Black Pen Recruitment Full time

    Job Title: Director of Platform EngineeringAbout the Role:We are seeking a highly experienced and visionary Director of Platform Engineering to lead our platform engineering team in building a scalable payment system for global merchants expanding into Africa.This is an exciting opportunity for a technical leader who is passionate about building...

  • Strategic Data Insights Director

    5 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge, one of South Africa's leading investment, savings, insurance and banking groups, is seeking a highly skilled Strategic Data Insights Director to join their team. This role will involve working with a talented group of individuals across analytics, data engineering, and partnering to improve how information is leveraged for analytics and...

  • Data Architect

    1 week ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Data Discipline ExpertiseData Centrix seeks a seasoned Scrum Master - Data Discipline professional to support our ever-evolving strategy in person-centred health and care. This role demands substantial expertise in software development, programming, and data analysis, as well as knowledge of data structures, algorithms, and distributed computing.Key...

  • Data Management Director

    2 weeks ago

    Johannesburg, Gauteng, South Africa HR Genie Full time

    Job SummaryWe are seeking a skilled Data Management Director to lead our clinical trials data management efforts. The ideal candidate will have expertise in Redcap, data analysis, and CTMS.Key ResponsibilitiesDesign and manage research databases.Oversee the implementation and maintenance of CTMS.Collaborate with clinical and research teams to define database...

  • Electrical Design Engineering Director

    14 hours ago

    Johannesburg, Gauteng, South Africa The Legends Agency Full time

    We are seeking a highly skilled Electrical Design Engineering Director to join our team at The Legends Agency. This is an exciting opportunity for a seasoned professional to lead our design engineering team and drive business growth.

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa TransEra Solutions Full time

    Job Title: **Data Engineer**:We are seeking a skilled Data Engineer to join our team at TransEra Solutions. The successful candidate will be responsible for designing, building, and maintaining robust data infrastructure and systems. This includes developing data models, maintaining data warehouses, and writing scripts for data integration and analysis....

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa JCM Consultants Full time

    At JCM Consultants, we're on the hunt for a talented Data Engineer to join our dynamic team!As a Data Engineer, you'll be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    Job Title: Junior Data EngineerWe are seeking a highly motivated and detail-oriented Junior Data Engineer to join our team at Planet10. As a Junior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support business growth and innovation.Key Responsibilities:Design and implement data pipelines to...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Pepkor Lifestyle Full time

    Job Title: Data EngineerAbout the Role:We are seeking an experienced Data Engineer to join our team at Pepkor Lifestyle. The successful candidate will play a critical role in the development and maintenance of our data infrastructure, working closely with cross-functional teams to ensure data availability, quality, and accessibility for analysis.Main...

  • Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa Psybergate Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Psybergate. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop scalable data pipelines using Ab Initio.Develop ETL processes to extract, transform, and load data from...

  • Data Scientist

    4 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleJob SummaryNTT DATA is seeking a seasoned Data Scientist to join our team. As a Data Scientist, you will be responsible for participating in the adoption of data science and analytics within the organization.Key ResponsibilitiesDesign and develop methods, processes, and systems to consolidate and analyze unstructured, diverse "big data" sources...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    We are currently seeking a highly skilled Data Engineer to join our team at PBT Group.About the Role:As a Data Engineer, you will be responsible for designing, developing, testing, and deploying ETL solutions for our ODS and data mart projects. You will also provide technical support and troubleshooting for ETL and database-related issues.Key...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Puma Energy Full time

    Main Purpose:Puma Energy seeks a highly skilled Data Engineer to collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.The ideal candidate will ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop...