Senior Data Engineer

3 days ago

Johannesburg, South Africa Deka Minas Pty Ltd Full time

We are excited to introduce an exceptional opportunity for a Senior Data Engineer In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data processing patterns, such as ELT, and strategically utilizing Operational Data Stores (ODS) to meet our evolving data requirements in a dynamic technological landscape. Join us and lead the charge in shaping the future of our data infrastructure

Duties and Responsibilities (Include but are not limited to):

  • Lead the architectural design and implementation of scalable data engineering solutions, leveraging advanced cloud data warehouse technologies (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, or Azure Synapse Analytics). This includes promoting the adoption of ELT patterns over traditional ETL processes to enhance data agility and efficiency.
  • Champion the development and evaluation of proof of concept (POC) initiatives for the adoption of an Operational Data Store (ODS) and other modern data processing frameworks, such as the Medallion Architecture, ensuring our approach remains technology-agnostic and aligned with best practices.
  • Oversee the optimization of data flows, utilizing ELT processes to streamline data loading and transformation in cloud data warehouses, ensuring high data quality and accessibility.
  • Direct and refine CI/CD processes for seamless data pipeline deployments, incorporating best practices in version control with git.
  • Collaborate with cross-functional teams to capture and address comprehensive data requirements, ensuring robust support for business analytics and decision-making.
  • Uphold rigorous data security and compliance standards, aligning with financial industry regulations and evolving data privacy best practices.

Key Requirements

  • Experience: Minimum of 5 years in Data Engineering, including 2+ years in a senior or leadership role, with a preference for experience in the financial services sector.
  • Technical Expertise: Proficiency in at least one major cloud data warehouse solution (e.g., Snowflake, AWS Redshift, Google BigQuery, Databricks, Azure Synapse Analytics), with a strong emphasis on implementing ELT patterns and familiarity with modern data architecture frameworks like the Medallion Architecture.
  • Leadership and Innovation: Demonstrated leadership in driving the adoption of modern data processing strategies, with the ability to manage complex projects and innovate within the data engineering space.
  • Programming Skills: Strong proficiency in programming languages such as Python or Java and can demonstrate advanced knowledge of SQL on a cloud data warehouse solution, essential for developing and managing ELT processes.
  • Certifications: Cloud platform certification (e.g., AWS Solutions Architect, Google Cloud Professional Data Engineer, Snowflake SnowPro) is highly desirable.
  • Communication: Excellent verbal and written communication skills, essential for effective collaboration across teams and with stakeholders.

Minimum Qualifying Attributes:

  • Hands-on experience with CDC-based data ingestion tools and methodologies.
  • Comprehensive understanding of data modeling, ETL/ELT processes, and ensuring data security and privacy, especially within the financial industry.

Please note that by submitting your personal information to Deka Minas you free-willingly issue the business consent to make use of such data for the specific purpose of securing you either permanent or temporary employment. Our business makes use of a POPIA compliant database and you have the right to access, right to correction and right to deletion of your personal information.

  • Senior Technical Lead

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Job SummaryWe are seeking a highly experienced and skilled Technical Manager to lead our Control & Instrumentation (C&I) Engineering Department. The successful candidate will be responsible for overseeing the technical management of the department, ensuring all deliverables are executed to the required quality and schedule.Key ResponsibilitiesTechnical...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time

    Senior Full Stack Data EngineerHire Resolve is seeking a seasoned Senior Full Stack Data Engineer to drive data solutions and contribute to the success of our organisation.Key ResponsibilitiesDesign and implement data solutions using modern data engineering technologies and frameworksCollaborate with cross-functional teams to understand business requirements...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Senior Data EngineerE-Merge is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, implementing, and delivering large-scale data solutions using AWS.Key Responsibilities:Design and implement data models from various sources and store them in a usable format.Lead the design,...

  • Data Engineer

    3 months ago

    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Cloud Data Engineer

    4 months ago

    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Senior Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Senior Data EngineerE-Merge is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and data warehouses.Key Responsibilities:Design and implement data engineering solutions to meet business requirementsBuild...

  • Senior Software Engineer

    4 months ago

    Johannesburg, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of being micro-managed? Are you looking for a company where no-one tells you how to do your job? Do you want to work in a team, but not be told what to do and when to do it? If so, we believe this Senior Software Engineer role is perfect for you!As a Senior Software Engineer, you'll be responsible for building and maintaining...

  • Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...

  • Senior Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Luminary Talent Sourcing Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to contribute to our team at Luminary Talent Sourcing in Johannesburg. The ideal candidate will possess expertise in SQL coding, particularly in Redshift and PostgreSQL, and a deep understanding of data warehousing principles. Experience in AWS Redshift and S3 is essential, while...

  • Senior Systems Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Systems Engineer to join our team at NTT DATA. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining complex systems and infrastructure to support our business operations.Key ResponsibilitiesDesign and implement scalable and secure systems...

  • Senior Software Engineer

    7 days ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Dimension Data. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining our software systems.Key ResponsibilitiesDesign and develop software applications using C#, Java, and other programming languagesWork with our agile team...

  • Senior Data Engineer

    2 months ago

    Johannesburg, South Africa Network Recruitment Full time

    Senior Data Engineer Location: SandtonEmployment Type: Full-timeExperience Level: SeniorAbout Us: This is at the forefront of innovation, leveraging data to drive strategic decisions and fuel our growth. Were looking for a Senior Data Engineer to join our dynamic team and take a lead role in building and optimizing our data infrastructure.Key...

  • Senior Data Engineer

    2 months ago

    Johannesburg, South Africa Network Recruitment Full time

    Senior Data EngineerLocation: SandtonEmployment Type: Full-timeExperience Level: SeniorAbout Us: This is at the forefront of innovation, leveraging data to drive strategic decisions and fuel our growth. Were looking for a Senior Data Engineer to join our dynamic team and take a lead role in building and optimizing our data infrastructure.Key...

  • Senior Data Engineer

    4 weeks ago

    Johannesburg, South Africa Network Recruitment Full time

    Join this dynamic and innovative team as a Senior Data Engineer at one of the Big 4 Banks!

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a critical role in developing best practices and driving improvements in data engineering across the business.Key ResponsibilitiesAnalyzing and organizing raw data to meet business requirementsDesigning data...

  • Senior ISP Network Engineer

    4 months ago

    Johannesburg, South Africa Dimension Data Full time

    FunctieomschrijvingThe Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their...

  • Senior Security Platform Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleThe Senior Security Platform Engineer is a highly skilled professional responsible for ensuring the security and integrity of NTT DATA's technology infrastructure. This role involves advanced security technologies, including Cisco ISE, and requires a strong understanding of security architecture, networking, and Linux concepts.Key...

  • Senior Data Engineer

    3 days ago

    Johannesburg, South Africa Deka Minas Pty Ltd Full time

    We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data...

  • Senior Data Engineer

    4 days ago

    Johannesburg, South Africa Deka Minas (Pty) Ltd Full time

    We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data...

  • Senior Data Engineer

    3 days ago

    Johannesburg, South Africa Adzuna ZA B C2 Full time

    We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing strategies. You'll play a crucial role in guiding our transition towards more flexible and scalable data...