Data Engineer

2 weeks ago


Cape Town, Western Cape, South Africa Datonomy Solutions Full time

Job Overview:
We are seeking an experienced Data Engineer with strong Solution Architecture expertise to lead the data engineering efforts for a financial data migration project. The role focuses on designing, building, and optimizing data pipelines to support the transition from an on-premise Hyperion system to OneStream in the cloud. The ideal candidate will have deep expertise in AWS data engineering services, cloud architecture best practices, and financial data processing.

Key Responsibilities:

  • Design and develop scalable, secure, and efficient data pipelines for financial data migration.

  • Architect and implement data integration strategies to facilitate seamless transition from Hyperion (on-prem) to OneStream (cloud).

  • Collaborate with stakeholders, including data analysts, finance teams, and cloud architects, to define data transformation and reporting requirements.

  • Ensure data quality, governance, and compliance with industry standards.

  • Optimize ETL/ELT processes for performance, cost-efficiency, and scalability within the AWS ecosystem.

  • Implement best practices for data storage, transformation, and retrieval using AWS cloud technologies.

  • Provide technical guidance on AWS data engineering and solution architecture strategies.

  • Troubleshoot data pipeline issues and optimize workflows for real-time and batch processing.

Required Skills & Experience:

  • Proven experience as a Data Engineer with strong Solution Architecture capabilities.

  • Hands-on expertise in building and optimizing ETL/ELT data pipelines.

  • Deep understanding of financial data structures and reporting requirements.

  • Experience with cloud-based data platforms, particularly AWS.

  • Strong proficiency with AWS data engineering tools (e.g., AWS Glue, Redshift, S3, Lambda, Kinesis, etc.).

  • Knowledge of database technologies (SQL, NoSQL) and data modeling.

  • Proficiency in programming languages such as Python or SQL.

  • Experience with data governance, security, and compliance frameworks.

  • Excellent problem-solving, communication, and stakeholder management skills.

Certifications:

  • AWS Certified Data Analytics Specialty (preferred)

  • AWS Certified Solutions Architect Associate or Professional (required)

  • Any relevant OneStream or Hyperion certification is a plus.

Preferred Qualifications:

  • Experience with financial consolidation and reporting tools like Hyperion and OneStream.

  • Familiarity with cloud migration strategies and best practices.

  • Background in financial services, accounting, or enterprise financial applications.


  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    A company that is built around innovative work, great people, and a singular focus on the world of commerce is seeking a Data Engineer. Candidates to be based in Cape Town, however there is a hybrid working model. Skills Required · BSc in Computer Science, Computer Engineering, or a related field. · 3 years of experience in data engineering or software...


  • Cape Town, Western Cape, South Africa Data Centrix Full time

    Data Centrix is committed to delivering exceptional customer service, and we are seeking a talented Technical Support Engineer to join our team. As a key member of our technical operations group, you will be responsible for providing high-level support to our customers, ensuring that their technical queries are resolved efficiently and effectively.Key...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    7 days ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Goldman Tech Resourcing Full time

    An innovative retail media solutions provider is looking for a Data Engineer to join their team. This company specializes in dynamic digital display networks and strategic in-store advertising, empowering brands to maximize visibility and customer engagement through cutting-edge technology and impactful campaigns. Skills Required · BSc in Computer Science,...

  • Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Job DetailsWho are we?Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as...


  • Cape Town, Western Cape, South Africa Data Centrix Full time

    Qualifications:Matric qualificationTertiary qualification (Computer Science or IT related)Certifications CCNA, CCNP, JNCIAValid Drivers License and own vehicleExperience: Must have professional OME certification, working knowledge and experience of 5+ yearsSolid background in network administration and architectureIn-depth understanding of TCPIP and the...


  • Cape Town, Western Cape, South Africa BADRI Management Consultancy Full time

    Data Architecture and Engineering LeadershipWe are looking for a Director of Data Engineering who can champion data mesh principles and enable decentralized data ownership across the organization. The successful candidate will have strong leadership skills and experience in modern data architectures, cloud infrastructure, and automation.

  • Data Engineer

    1 day ago


    Cape Town, Western Cape, South Africa Swan iT Recruitment Ltd Full time

    Duties & ResponsibilitiesDesign and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and...


  • Cape Town, Western Cape, South Africa Lycopodium Full time

    Job Description:Lycopodium is seeking a highly skilled Data Engineer to join its team in Cape Town. The successful candidate will be responsible for designing, developing, and maintaining data structures, as well as developing and maintaining data pipelines to collect, transform, store, and share/integrate data across platforms.Responsibilities:Design and...

  • Cloud Data Engineer

    4 days ago


    Cape Town, Western Cape, South Africa Goodwall SA Full time

    Data Engineering Role at Goodwall SA: A Mission-Driven OpportunityAre you passionate about using data to drive social impact? Do you want to work on a mission-driven project that empowers youth globally? Look no further than Goodwall SA's Data Engineer role.In this position, you will work closely with our Programs and Product teams to develop and execute...

  • Senior Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    The successful candidate will be responsible for building, optimizing, and maintaining complex data pipelines and databases. They will collaborate with data scientists and analysts to ensure seamless data accessibility and quality while developing ETL processes and scalable storage solutions. The role involves implementing best practices for data security,...

  • Data Engineer

    1 week ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineer will be responsible for designing, building, and optimising data pipelines and ensuring the efficient movement and transformation of data across various systems. The ideal candidate will have expertise in SQL, data modelling, and experience with cloud-based or on-premises data solutions. Additionally, knowledge of ML and statistical...


  • Cape Town, Western Cape, South Africa BigTalent Full time

    BigTalent, a leading organization in the financial services sector, is seeking an exceptional Data Engineering Lead to drive their technical vision and strategy.Job OverviewThe successful candidate will lead the design and implementation of scalable data pipelines, platforms, and infrastructure to support business objectives.The ideal candidate will be a...


  • Cape Town, Western Cape, South Africa Top Recruitment Full time

    Data Insights Engineer Job SummaryWe are seeking a highly skilled Data Insights Engineer to join our team in Cape Town. As a key member of our data analytics team, you will be responsible for designing and developing data sets and reports for business analytic requirements using advanced technologies such as Apache Airflow, Google BigQuery, and Google Looker...

  • Data Engineer Lead

    2 days ago


    Cape Town, Western Cape, South Africa Gomag Full time

    We are looking for a seasoned Data Engineer Lead to join our team at Gomag. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Lead the design and development of data pipelines and architectureCollaborate with cross-functional teams to...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...