Senior Data Engineer

1 week ago

Johannesburg, South Africa CloudSmiths Full time

Overview Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic, cloud-driven environment? We're looking for a pivotal team member to design, develop, and maintain cutting-edge data solutions, ensuring scalability, reliability, and top-tier performance. If you have a strong background in data engineering, a proven track record in leading technical teams, and thrive in an agile setting, we want to hear from you. What You'll Be Doing Building and maintaining efficient ETL/ELT pipelines using tools like Apache Airflow and PySpark. Developing robust database schemas, dimensional models (Kimball/Inmon), and supporting data normalisation for both relational and NoSQL databases. Contributing to the development and maintenance of our data warehouses, data lakes, and data lakehouses. Working with diverse database systems, including Azure SQL, PostgreSQL, Google BigQuery, MongoDB, and Google Firestore. Handling structured, semi-structured, and big data file formats such as Avro, CSV, Parquet, ORC, and Delta. Developing and maintaining APIs for seamless data integration and workflows, with a solid understanding of REST and microservices architectures. Overseeing codebase maintenance and optimisation, leveraging Git for version control. Implementing thorough integration testing and ensuring high-quality deliverables for all new data processing scenarios. Providing technical design and coding assistance to team members, ensuring successful project milestones. Assessing and integrating new data sources to meet evolving business needs. What We're Looking For Strong proficiency in Python and SQL (PostgreSQL or SQL Server preferred). Hands-on experience with Apache Airflow and PySpark. Familiarity with Databricks is essential Working knowledge of cloud platforms such as Azure, GCP, or AWS. Experience with data warehousing concepts, dimensional modelling, and database normalisation. Understanding of big data file formats like Avro, Parquet, ORC, and Delta. Proficiency in working with APIs, REST, and microservices architectures. Education & Experience A Bachelor’s degree in Computer Science, Data Science, or related fields. 5+ years of progressive experience in data engineering, cloud computing, and technology implementation. Experience managing multi-shore projects and working within cloud ecosystems (SaaS/PaaS). Proven experience leading technical teams and mentoring team members. What you will get out You'll get to develop your skill set A competitive, industry benchmark compensation Flexible working hours and a remote office setting You'll be part of a rapidly growing business Work with the absolute masters in the industry and catch some of their energy, vibe, and passion for what we do Great coffee every day, and samoosa Fridays (in-office of course) Plenty of company-sponsored learning; certifications and incentives Work Hard. Play Hard. Work-Life Balance No working on your birthday (free day off) #J-18808-Ljbffr

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Changing the way the world works @ Gig Engineer | Founder | MBA | Engineer | Jedi Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation,...

  • Senior Process Engineer.

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation, and scaling of processes across the Nuclear Fuel Cycle, utilising proprietary ASP...

  • Senior Data Management Security Engineer

    3 weeks ago

    Johannesburg, South Africa Ntt Data, Inc. Full time

    Senior Data Management Security Engineer NTT DATA, Inc. is hiring for a Senior Data Management Security Engineer. The role focuses on defining and enforcing data security strategies, policies, and controls across the organization's data landscape to protect data assets while enabling secure and compliant data usage across analytics, operations, and digital...

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    A leading technology company in Johannesburg is looking for a Senior Process Engineer to enhance nuclear energy solutions. You will lead process development and optimization, ensuring compliance with safety regulations. The ideal candidate has over 7 years of experience in process engineering and strong leadership skills. This full-time role offers...

  • Senior Process Engineer – Nuclear Tech Leader

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    A consulting firm is seeking an experienced Senior Process Engineer to lead process development in Johannesburg, focusing on advancing nuclear fuel technologies for next-generation reactors. Responsibilities include overseeing process design, optimisation, and compliance with safety regulations. Candidates should have substantial experience in chemical or...

  • Senior Data Engineer

    4 weeks ago

    Johannesburg, South Africa Austell Full time

    Are you a Data Engineering leader with a passion for shaping modern, scalable cloud data platforms? Join our Business Intelligence team and play a key role in driving the transition from legacy SSIS-based ETL systems to a cutting-edge Azure cloud data warehouse . As a Senior Data Engineer , you’ll take ownership of enterprise data architecture, governance,...

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, South Africa Austell Full time

    Are you a Data Engineering leader with a passion for shaping modern, scalable cloud data platforms? Join our Business Intelligence team and play a key role in driving the transition from legacy SSIS‑based ETL systems to a cutting‑edge Azure cloud data warehouse. As a Senior Data Engineer, you'll take ownership of enterprise data architecture, governance,...

  • Senior Data Engineer

    5 days ago

    Johannesburg, South Africa Liyema Consulting Full time

    Job Title: Senior Data Engineer Reference: JHB -FE-1 Type: PermanentLocation: Gauteng, JohannesburgAbout Us: We're a leading data solutions firm in South Africa, dedicated to fostering equality through actionable insights.Responsibilities: As a Senior Data Engineer, you'll be tasked with designing robust data architectures, managing seamless pipelines,...

  • Senior Specialist

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Overview Gig Engineer is seeking a Senior Specialist : Hydrology for its client. Location Woodmead Johannesburg, Gauteng, South AfricaPlattekloof Cape Town, Western Cape, South Africa Description Technical expertise : Design and lead technical expertise required in flood and stormwater projects. Provide knowledge and experience-based competency to perform...

  • Senior Specialist: Hydrology

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Overview Gig Engineer is seeking a Senior Specialist: Hydrology for its client. Location Woodmead Johannesburg, Gauteng, South Africa Plattekloof Cape Town, Western Cape, South Africa Description Technical expertise: Design and lead technical expertise required in flood and stormwater projects Provide knowledge and experience-based competency to perform...