Senior Data Engineer

4 days ago

Johannesburg, Gauteng, South Africa Hire Resolve Full time R1 200 000 - R2 400 000 per year

Hire Resolve's client is seeking a highly skilled Senior Data Engineer to join their dynamic team within the telecommunications domain. The ideal candidate will be responsible for designing, developing, and maintaining scalable and reliable data pipelines to support the ingestion, processing, and analysis of Call Detail Records (CDRs) and real-time data streams.

This role demands advanced technical expertise in stream processing frameworks such as Apache Kafka, Apache NiFi, Apache Flink, and Apache Druid, along with strong collaboration skills and a passion for data-driven solutions.

Responsibilities: 

  • Design and implement robust ETL/ELT pipelines for ingesting and transforming CDRs and telecom log data across multiple network types (2G/3G/4G/5G).
  • Develop and maintain real-time data pipelines using Apache Kafka, NiFi, and Flink.
  • Structure and integrate data for analytics platforms such as Apache Druid, Hudi, and Superset.
  • Manage large-scale distributed file systems and ensure efficient batch/stream data processing.
  • Build and manage CI/CD pipelines for data workflow deployments.
  • Optimize data performance, cost-efficiency, and reliability through continuous monitoring and enhancement.
  • Enforce data governance best practices including schema validation, access control, and regulatory compliance (e.g. GDPR).
  • Collaborate with development, DevOps, and analytics teams to deliver query-ready datasets for machine learning models and BI dashboards.
  • Implement role-based access control, data encryption, and secure identity management.
  • Design and maintain metadata repositories, data lineage, and asset discovery frameworks.
  • Build quality assurance and anomaly detection tools to monitor data integrity across all pipeline stages.
  • Support analytical modelling using OLAP systems and columnar databases.

 Requirements: 

  • Bachelor's Degree in Computer Science, Software Engineering, Computer Engineering, or related field.
  • Minimum of 5–8 years of experience in data engineering, preferably in telecom or large-scale distributed systems.
  • Strong expertise in Apache stack tools: Kafka, NiFi, Flink, Spark, Hive, Druid, Hudi.
  • Proficiency in Python, SQL, Shell scripting, and Linux-based systems.
  • Experience in database management: PostgreSQL, MySQL, and analytical querying.
  • Familiarity with data serialization formats (JSON, Avro, etc.) and secure data transfer protocols (SFTP).
  • In-depth knowledge of data quality control, lineage tracking, and data discovery tools.
  • Experience in full-text search and indexing of structured/unstructured data using Apache or similar tools.
  • Excellent problem-solving abilities, multitasking, and a fast-learning attitude.
How To Apply:
  • Contact Hire Resolve today for your next career-changing move
  • Our client is offering a highly competitive salary for this role based on experience.
  • Send your CV to: [email protected] or connect with Mischa Bornman via LinkedIn.
  • Alternatively, you can also contact me directly at Hire Resolve [email protected] 
We will contact you telephonically in 3 days should you be suitable for this vacancy. If you are not suitable, we will put your CV on file and contact you regarding any future vacancies that arise.

  • Senior Data Management Security Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Senior Azure Engineer

    10 hours ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.We are looking for a highly...

  • Senior Microsoft Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time R900 000 - R1 200 000 per year

    Job Summary:The Senior Microsoft Engineer is responsible for designing, implementing, and maintaining Microsoft-based infrastructure solutions, both on-premises and in the cloud (primarily Azure). This role ensures the stability, integrity, and efficiency of IT systems and supports automation, security, and compliance...

  • Senior Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Harambee Youth Employment Accelerator Full time R120 000 - R240 000 per year

    We're Hiring: Senior Data Engineer – JohannesburgAre you ready to build technology that changes lives?Harambee Youth Employment Accelerator is looking for an exceptionalSenior Data Engineerto join our Software Development team. You'll work on collecting, storing, and processing large datasets to deliver optimal solutions—while partnering with our Head of...

  • Senior Data Engineer

    6 days ago

    Johannesburg, Gauteng, South Africa Harambee Full time R800 000 - R1 200 000 per year

    Senior Data Engineer - JohannesburgHelp build technology that changes lives.About the RoleThe Harambee Software Development team is looking for an exceptional Senior Data Engineer to join our dynamic team based in Johannesburg.This role is focused on collecting, storing, and processing large sets of data to deliver optimal solutions-along with their...

  • Senior Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Harambee Youth Employment Accelerator Full time R600 000 - R1 200 000 per year

    Senior Data Engineer – JohannesburgHelp build technology that changes lives.About the RoleThe Harambee Software Development team is looking for an exceptional Senior Data Engineer to join our dynamic team based in Johannesburg.This role is focused on collecting, storing, and processing large sets of data to deliver optimal solutions—along with their...

  • Senior Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa Hire Resolve Full time R800 000 - R1 200 000 per year

    Hire Resolve's client is looking for a Senior Data Engineer to join their team in Johannesburg, GP. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines to support telecommunications CDR processing, real-time data ingestion, and analytical workloads. This role requires expertise in data modeling, ETL...

  • Senior Azure Integrations Engineer

    10 hours ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.We are looking for a highly...

  • Senior Data Integration Engineer

    6 days ago

    Johannesburg, Gauteng, South Africa Indsafri Full time R2 000 000 - R2 500 000 per year

    Job Description:Job Title: Senior Data Integration Engineer (Salesforce, Databricks & MuleSoft)Location: Johannesburg (Hybrid)Employment Type: ContractContract Tenure: 6 to 12 monthsJob SummaryWe are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer...

  • Lead Forward Deployed Engineer

    10 hours ago

    Johannesburg, Gauteng, South Africa RANGR Data Full time R1 200 000 - R2 400 000 per year

    RANGR Data is an advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir FoundryRole OverviewAs Lead Engineer, you are responsible for driving the technical success of client solutions by leading a team of engineers in designing,...