Senior Data Engineer

3 months ago

Johannesburg, South Africa Deka Minas Pty Ltd Full time

We are excited to introduce an exceptional opportunity for a Senior Data Engineer In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data processing patterns, such as ELT, and strategically utilizing Operational Data Stores (ODS) to meet our evolving data requirements in a dynamic technological landscape. Join us and lead the charge in shaping the future of our data infrastructure

Duties and Responsibilities (Include but are not limited to):

  • Lead the architectural design and implementation of scalable data engineering solutions, leveraging advanced cloud data warehouse technologies (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, or Azure Synapse Analytics). This includes promoting the adoption of ELT patterns over traditional ETL processes to enhance data agility and efficiency.
  • Champion the development and evaluation of proof of concept (POC) initiatives for the adoption of an Operational Data Store (ODS) and other modern data processing frameworks, such as the Medallion Architecture, ensuring our approach remains technology-agnostic and aligned with best practices.
  • Oversee the optimization of data flows, utilizing ELT processes to streamline data loading and transformation in cloud data warehouses, ensuring high data quality and accessibility.
  • Direct and refine CI/CD processes for seamless data pipeline deployments, incorporating best practices in version control with git.
  • Collaborate with cross-functional teams to capture and address comprehensive data requirements, ensuring robust support for business analytics and decision-making.
  • Uphold rigorous data security and compliance standards, aligning with financial industry regulations and evolving data privacy best practices.

Key Requirements

  • Experience: Minimum of 5 years in Data Engineering, including 2+ years in a senior or leadership role, with a preference for experience in the financial services sector.
  • Technical Expertise: Proficiency in at least one major cloud data warehouse solution (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, Azure Synapse Analytics), with a strong emphasis on implementing ELT patterns and familiarity with modern data architecture frameworks like the Medallion Architecture.
  • Leadership and Innovation: Demonstrated leadership in driving the adoption of modern data processing strategies, with the ability to manage complex projects and innovate within the data engineering space.
  • Programming Skills: Strong proficiency in programming languages such as Python or Java and can demonstrate advanced knowledge of SQL on a cloud data warehouse solution, essential for developing and managing ELT processes.
  • Certifications: Cloud platform certification (e.g., AWS Solutions Architect, Google Cloud Professional Data Engineer, Snowflake SnowPro) is highly desirable.
  • Communication: Excellent verbal and written communication skills, essential for effective collaboration across teams and with stakeholders.

Minimum Qualifying Attributes:

  • Hands-on experience with CDC-based data ingestion tools and methodologies.
  • Comprehensive understanding of data modeling, ETL/ELT processes, and ensuring data security and privacy, especially within the financial industry.

Please note that by submitting your personal information to Deka Minas you free-willingly issue the business consent to make use of such data for the specific purpose of securing you either permanent or temporary employment. Our business makes use of a POPIA compliant database and you have the right to access, right to correction and right to deletion of your personal information.

  • Cloud Data Engineer

    7 months ago

    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Senior Software Engineer

    7 months ago

    Johannesburg, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of being micro-managed? Are you looking for a company where no-one tells you how to do your job? Do you want to work in a team, but not be told what to do and when to do it? If so, we believe this Senior Software Engineer role is perfect for you!As a Senior Software Engineer, you'll be responsible for building and maintaining...

  • Senior Business Data Analyst

    1 month ago

    Johannesburg, South Africa Axis Data Full time

    Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...

  • Cloud Data Engineer: Designing Scalable Data Pipelines

    1 month ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...

  • Senior ISP Network Engineer

    7 months ago

    Johannesburg, South Africa Dimension Data Full time

    FunctieomschrijvingThe Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their...

  • Senior Data Engineer

    3 months ago

    Johannesburg, South Africa Deka Minas (Pty) Ltd Full time

    We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data...

  • Senior Data Engineer

    3 months ago

    Johannesburg, South Africa Deka Minas Pty Ltd Full time

    We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data...

  • Senior Data Engineering Lead

    1 month ago

    Johannesburg, Gauteng, South Africa Deka Minas Pty Ltd Full time

    We are seeking a highly skilled Senior Data Engineer to lead our data engineering team. In this role, you will be responsible for designing and implementing scalable data engineering solutions using advanced cloud data warehouse technologies. You'll play a crucial role in guiding our transition towards more flexible and scalable data processing patterns,...

  • Senior Cloud Data Engineer

    2 months ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Senior Cloud Data EngineerE-Merge is seeking a highly skilled Senior Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and delivering large-scale, critical data solutions on AWS.Key Responsibilities:Design and implement data models from various sources and store them in a...

  • Senior Network Services Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa NTT Data Full time

    Job Title:Senior Network Services EngineerNTT Data seeks a skilled and experienced Senior Network Services Engineer to join our team.Job Summary:The successful candidate will be responsible for providing expert-level support for network infrastructure, including design, implementation, and troubleshooting. The role requires strong technical knowledge of...

  • Senior Cloud Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    At E-Merge, we seek a seasoned Senior Cloud Data Engineer to spearhead our innovative data engineering initiatives. The ideal candidate will have a strong passion for Azure Cloud and a proven track record of designing robust data engineering solutions.Key Responsibilities:Analyzing and organizing raw data to unlock business insights.Designing and...

  • Senior Data Engineer: Data Lake Solutions

    1 month ago

    Johannesburg, Gauteng, South Africa People Source Full time

    Data Lake Solutions are critical components of our IoT Platform. As a Senior Data Engineer, you will be responsible for designing, developing, and testing software to meet the requirements of our data ingestion, integration, and processing needs. We are looking for someone with experience in wireless and network communication technologies, data lake and...

  • Senior Data Strategist

    4 weeks ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job Title: Senior Data Strategist - Health SectorAbout Us:Data Centrix is a leading provider of data-driven solutions for the healthcare industry. We are committed to helping our clients make informed decisions through the effective use of data analytics.Job Summary:We are seeking an experienced Senior Data Strategist to join our team. The successful...

  • Senior Data Scientist/Engineer

    2 months ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    We are seeking a highly skilled Senior Data Scientist/Engineer to lead our data science and engineering efforts. The ideal candidate will have a robust background in data science and engineering, a proven track record of working with large datasets, and the ability to lead projects and mentor junior team members.Key Responsibilities:Data Analysis and...

  • Senior Data Engineer Lead

    4 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    We are E-Merge, a leading company in the retail industry seeking a highly skilled Senior Data Engineer to join our team. This is a permanent hybrid position in Johannesburg.The salary for this position is approximately R950k per annum, negotiable based on experience.As a Senior Data Engineer at E-Merge, you will be responsible for designing and developing...

  • Senior Test Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Senior Test Analyst to join our team at Dimension Data. As a Senior Test Analyst, you will play a key role in ensuring the quality of our software solutions.ResponsibilitiesCreate and execute test plans within an agile environmentManage testing throughout the SDLCMap functional requirements to test casesAutomate...

  • Software Engineering Expert

    4 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team. As a key member of our development team, you will be responsible for designing and implementing software systems that meet the needs of our clients.The ideal candidate will have a strong background in software engineering, with experience in developing...

  • Data Engineering Innovator

    3 weeks ago

    Johannesburg, Gauteng, South Africa Deka Minas Pty Ltd Full time

    Are you a data engineering expert looking for a challenging role in a dynamic environment? We are seeking a highly skilled Senior Data Engineer to lead the development and optimization of our data engineering solutions. In this pivotal position, you will spearhead the modernization of our data warehousing and processing strategies.Data Warehousing and...

  • Senior Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    NEW WORK IN at a leading innovator in the tech industry, dedicated to providing cutting-edge solutions that drive business success with clients globally. The current need is for a Senior Data Engineer with a passion for Azure Cloud. This role involves working with the industry's best players, analysing and organising raw data, designing robust data...

  • Senior Data Architect

    2 months ago

    Johannesburg, Gauteng, South Africa Deka Minas Pty Ltd Full time

    We are seeking a highly skilled Senior Data Engineer to lead the development and optimization of our data engineering solutions. In this pivotal role, you will spearhead the modernization of our data warehousing and processing strategies, focusing on cloud-based technologies and ELT patterns.Key Responsibilities:Design and implement scalable data engineering...