Senior Data Engineer

1 week ago

Johannesburg, South Africa IDBASE SOFTWARE Full time

About the Role We are seeking a highly skilled Senior Data Engineer to join our dynamic data team. You will be responsible for designing, building, and maintaining robust and scalable data pipelines and architectures that enable analytics and business intelligence at enterprise scale. This role is ideal for professionals who thrive in complex data environments, value clean, efficient, and secure data engineering practices, and enjoy collaborating with cross-functional teams to deliver high-quality, reliable data solutions. Key Responsibilities Data Architecture & Pipeline Development Design, develop, and maintain scalable data pipelines and ETL/ELT processes Implement data modeling and architecture solutions including Data Vault, dimensional modeling, and normalized structures Optimize data storage and retrieval to support analytics, reporting, and machine learning workloads Integrate structured and unstructured data from multiple sources, including cloud and on-premises systems Develop and maintain data warehouses, data lakes, and cloud-native data platforms Cloud & Big Data Engineering Work with cloud platforms such as AWS, Azure, or GCP for data storage, processing, and orchestration Implement and manage data processing frameworks such as Spark, Databricks, or Hadoop Develop scalable, automated, and reliable batch and real-time data workflows Ensure data pipelines meet performance, security, and compliance standards Collaboration & Process Improvement Collaborate with data analysts, data scientists, software engineers, and business stakeholders to understand requirements and deliver solutions Mentor junior and intermediate data engineers, promoting best practices and code quality standards Participate in Agile/Scrum ceremonies, including sprint planning, stand-ups, and retrospectives Continuously research and recommend new tools, technologies, and approaches to improve data engineering efficiency, reliability, and scalability Requirements & Qualifications Must-Have Skills: 6+ years of professional experience in data engineering or software engineering with a focus on data Strong expertise in SQL, relational databases (PostgreSQL, MSSQL, MySQL), and NoSQL databases (MongoDB, Cassandra, DynamoDB) Experience with Data Vault modeling and implementation Hands-on experience with ETL/ELT tools and processes Proficiency in programming/scripting languages such as Python, Scala, or Java Experience building data pipelines and architectures in cloud platforms (AWS, Azure, GCP) Strong understanding of data warehousing, data lakes, and cloud-native storage solutions Experience with CI/CD for data pipelines and automation of data workflows Highly Desirable Skills: Experience with big data frameworks: Spark, Hadoop, Kafka Familiarity with orchestration tools such as Airflow, Prefect, or Azure Data Factory Knowledge of machine learning pipelines and integrating data for analytics Understanding of data governance, security, and compliance best practices Exposure to containerization (Docker, Kubernetes) in data workloads Strong communication skills to present complex data concepts to technical and business stakeholders Education Bachelor’s degree, higher certificate, or diploma in Data Engineering, Computer Science, Information Systems, or a related field Additional Information Contract Duration: 12 Months (with possibility of renewal) Salary: Negotiable Location Options: Johannesburg / Cape Town / Remote Must be located in South Africa or have a valid work permit for South Africa

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Changing the way the world works @ Gig Engineer | Founder | MBA | Engineer | Jedi Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation,...

  • Senior Process Engineer.

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation, and scaling of processes across the Nuclear Fuel Cycle, utilising proprietary ASP...

  • Senior Data Management Security Engineer

    4 weeks ago

    Johannesburg, South Africa Ntt Data, Inc. Full time

    Senior Data Management Security Engineer NTT DATA, Inc. is hiring for a Senior Data Management Security Engineer. The role focuses on defining and enforcing data security strategies, policies, and controls across the organization's data landscape to protect data assets while enabling secure and compliant data usage across analytics, operations, and digital...

  • Senior Professional Engineer: Civil

    20 hours ago

    Johannesburg Metropolitan Area, South Africa Gig Engineer Full time R1 200 000 - R2 400 000 per year

    Gig Engineeris seeking aSenior Professional Civil Engineeron behalf of its client based in Johannesburg.As aSenior Airport Civil Engineer, you will form part of theSouth African Aviationteam and will work with our colleagues in Airport Asset Design based in the Netherlands. With your background and knowledge in civil engineering, you would lead our Airports...

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    A leading technology company in Johannesburg is looking for a Senior Process Engineer to enhance nuclear energy solutions. You will lead process development and optimization, ensuring compliance with safety regulations. The ideal candidate has over 7 years of experience in process engineering and strong leadership skills. This full-time role offers...

  • Senior Process Engineer – Nuclear Tech Leader

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    A consulting firm is seeking an experienced Senior Process Engineer to lead process development in Johannesburg, focusing on advancing nuclear fuel technologies for next-generation reactors. Responsibilities include overseeing process design, optimisation, and compliance with safety regulations. Candidates should have substantial experience in chemical or...

  • Senior Data Engineer

    4 weeks ago

    Johannesburg, South Africa Austell Full time

    Are you a Data Engineering leader with a passion for shaping modern, scalable cloud data platforms? Join our Business Intelligence team and play a key role in driving the transition from legacy SSIS-based ETL systems to a cutting-edge Azure cloud data warehouse . As a Senior Data Engineer , you’ll take ownership of enterprise data architecture, governance,...

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, South Africa Austell Full time

    Are you a Data Engineering leader with a passion for shaping modern, scalable cloud data platforms? Join our Business Intelligence team and play a key role in driving the transition from legacy SSIS‑based ETL systems to a cutting‑edge Azure cloud data warehouse. As a Senior Data Engineer, you'll take ownership of enterprise data architecture, governance,...

  • Senior Data Engineer

    6 days ago

    Johannesburg, South Africa Liyema Consulting Full time

    Job Title: Senior Data Engineer Reference: JHB -FE-1 Type: PermanentLocation: Gauteng, JohannesburgAbout Us: We're a leading data solutions firm in South Africa, dedicated to fostering equality through actionable insights.Responsibilities: As a Senior Data Engineer, you'll be tasked with designing robust data architectures, managing seamless pipelines,...

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, South Africa Firsttech Full time

    First Technology Digital is a future enablement partner specializing in product and software development, digital transformation consulting, and the design, development, and deployment of enterprise solutions to international clients. As a subsidiary of First Technology Group, and a Microsoft Gold partner, First Technology Digital proudly roots its...