Senior Data Engineer

3 days ago

Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R1 200 000 - R2 400 000 per year


Job purpose: 

As a Senior Data Engineer, you'll have the opportunity to work with our datacenter team on building and maintaining an operational data pipeline. You will be responsible for creating, testing, debugging and documenting infrastructure components as well as managing its performance. You should have experience in writing python code that interacts with databases such as MySQL or Postgres..

Requirements: 

  • Develops, tests and deploys information extraction, analysis and management solutions
  • Provides direct and responsive support for urgent analytical needs
  • Collaborates with the development team to address issues within the framework of the project requirements
  • Participates in architecture, design, testing and deployment of the applications
  • Uses coding languages, scripting methodologies and sophisticated tools to solve a problem with a custom workflow
  • Performs incremental testing actions on code, processes and deployments to identify ways to streamline execution and minimize errors Installs and maintains Spark, Apache Spark, Erlang, Spark cluster
  • Manages the day to day operations of a Spark environment from provisioning, maintenance and monitoring
  • Use Python for debugging and custom data mining

Minimum requirements: 

  • Bachelors degree in Computer Science or related field required
  • 8 years of experience in a technical role with an emphasis on data and algorithm development and implementation, server-side programming, database administration, web development and design
  • Knowledge of Databricks, SQL and Python preferred
  • 8 years of software development experience with a strong background in databases and data modeling; 5 years of experience designing and implementing high performance applications for cloud platforms such as AWS preferred
  • Core capability is on Databricks and Synapse
  • The core capability is on Databricks and Synapse, although it is evolving to Databricks only given the cost.

  • Senior Data Management Security Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Senior Microsoft Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time R900 000 - R1 200 000 per year

    Job Summary:The Senior Microsoft Engineer is responsible for designing, implementing, and maintaining Microsoft-based infrastructure solutions, both on-premises and in the cloud (primarily Azure). This role ensures the stability, integrity, and efficiency of IT systems and supports automation, security, and compliance...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Harambee Youth Employment Accelerator Full time R120 000 - R240 000 per year

    We're Hiring: Senior Data Engineer – JohannesburgAre you ready to build technology that changes lives?Harambee Youth Employment Accelerator is looking for an exceptionalSenior Data Engineerto join our Software Development team. You'll work on collecting, storing, and processing large datasets to deliver optimal solutions—while partnering with our Head of...

  • Senior Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Harambee Full time R800 000 - R1 200 000 per year

    Senior Data Engineer - JohannesburgHelp build technology that changes lives.About the RoleThe Harambee Software Development team is looking for an exceptional Senior Data Engineer to join our dynamic team based in Johannesburg.This role is focused on collecting, storing, and processing large sets of data to deliver optimal solutions-along with their...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Harambee Youth Employment Accelerator Full time R600 000 - R1 200 000 per year

    Senior Data Engineer – JohannesburgHelp build technology that changes lives.About the RoleThe Harambee Software Development team is looking for an exceptional Senior Data Engineer to join our dynamic team based in Johannesburg.This role is focused on collecting, storing, and processing large sets of data to deliver optimal solutions—along with their...

  • Senior Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R800 000 - R1 200 000 per year

    Hire Resolve's client is looking for a Senior Data Engineer to join their team in Johannesburg, GP. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines to support telecommunications CDR processing, real-time data ingestion, and analytical workloads. This role requires expertise in data modeling, ETL...

  • Senior Data Integration Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Indsafri Full time R2 000 000 - R2 500 000 per year

    Job Description:Job Title: Senior Data Integration Engineer (Salesforce, Databricks & MuleSoft)Location: Johannesburg (Hybrid)Employment Type: ContractContract Tenure: 6 to 12 monthsJob SummaryWe are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer...

  • Senior Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R1 200 000 - R2 400 000 per year

    Hire Resolve's client is seeking a highly skilled Senior Data Engineer to join their dynamic team within the telecommunications domain. The ideal candidate will be responsible for designing, developing, and maintaining scalable and reliable data pipelines to support the ingestion, processing, and analysis of Call Detail Records (CDRs) and real-time data...

  • Senior Data Engineer/Analyst

    3 days ago

    Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R1 000 000 - R3 000 000 per year

    Senior Data Engineer/Analyst - 3 Year ContractQualifications & Experience:Must-Have:Bachelors or Masters degree in Computer Science, Data Science, Engineering, Mathematics, or a related field.5+ years of experience in data engineering, analytics, or BI development.Strong proficiency in SQL and Python for data manipulation and transformation.Experience with...

  • Senior Full Stack Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R120 000 - R260 000 per year

    Hire Resolve is currently seeking a driven and experienced Senior Full Stack Data Engineer to join our dynamic software company. As a Senior Full Stack Data Engineer, you will be responsible for designing, developing, and implementing data solutions to support our business needs. You will work with cross-functional teams to gather requirements, design data...