Senior Big Data Engineer Lead

2 weeks ago


Pretoria, Gauteng, South Africa Communicate Recruitment Full time

Job Description

We are looking for a highly experienced Senior Data Engineer to lead the development of scalable data pipelines, mentor junior team members, and drive best practices in data engineering. As a key member of our data engineering team, you will work closely with data scientists and analysts to ensure they have access to the right data for generating insights.

Key Responsibilities:

  • Develop and maintain scalable data pipelines using Python, Java, or Scala
  • Mentor junior team members and drive best practices in data engineering
  • Work closely with data scientists and analysts to ensure data availability and quality

Requirements:

  • Minimum 5 years of experience as a Data Engineer
  • Advanced proficiency in SQL and database optimization
  • Experience with data warehousing solutions (e.g., Databricks, Snowflake, Redshift)
  • Strong knowledge of distributed systems and big data technologies (e.g., Hadoop, Spark)
  • Experience with cloud platforms (AWS, Azure, GCP) and ETL tools (e.g., Apache Kafka, Airflow)


  • Pretoria, Gauteng, South Africa Betway Group Full time

    We are looking for a highly skilled Senior Big Data Specialist to join our team. As a senior member of our data engineering department, you will be responsible for designing, developing, and maintaining large-scale big data systems and solutions that drive business growth and innovation.The ideal candidate will have a strong background in big data...


  • Pretoria, Gauteng, South Africa Dimension Data Full time

    We are looking for an experienced Azure Big Data Developer to join our team at Dimension Data. As a key member of our big data team, you will be responsible for designing, developing, and deploying large-scale data processing systems on Azure.Key Responsibilities:Design and develop data processing systems using Azure HDInsight and Azure Databricks.Develop...


  • Pretoria, Gauteng, South Africa Mediro Ict Recruitment Full time

    About the RoleWe are seeking a Big Data Engineering Manager to lead our team in Pretoria.The successful candidate will have extensive experience in managing data engineering teams, designing and implementing big data pipelines using AWS Glue or Data Pipeline, and working with data stores such as AWS S3, AWS RDS, or DynamoDB.ResponsibilitiesLead a team of...

  • Big Data Engineer

    1 day ago


    Pretoria, Gauteng, South Africa Ciba Industries Full time

    Job SummaryWe're seeking an experienced Big Data Engineer to join our team at Ciba Industries. In this role, you'll be responsible for designing and implementing robust data pipelines and architectures to support advanced analytics and reporting.Key ResponsibilitiesDevelop big data solutions using tools like Databricks, Spark, or Kafka.Work closely with...


  • Pretoria, Gauteng, South Africa Findojobs South Africa Full time

    Findojobs South Africa, a leading autonomous Namibian bank, seeks a highly skilled Senior Azure Data Engineer to join our team.About the RoleThis role offers deep insight into compliance, IT methodologies, and best practices within the group while ensuring data integrity and governance.Key Responsibilities:Big Data Pipelines: Design, develop, and maintain...


  • Pretoria, Gauteng, South Africa Datafin Full time

    We are seeking a highly skilled professional to join our team as a Cloud Data Engineering Lead. In this role, you will be responsible for leading the development and implementation of cutting-edge data engineering and analytics solutions.As a key member of our team, you will provide technical leadership and guidance to ensure the successful delivery of...


  • Pretoria, Gauteng, South Africa Mediro ICT Recruitment Full time

    We are seeking an experienced AWS engineer to join our team in Pretoria. The successful candidate will have extensive experience in designing, developing, and deploying scalable and efficient big data systems using AWS services.About the Role:Design, develop, and deploy scalable and efficient big data systems using AWS servicesCollaborate with...

  • Data Engineering Lead

    2 weeks ago


    Pretoria, Gauteng, South Africa Betway Group Full time

    Betway Group is seeking a highly skilled and experienced Data Engineering Lead to join our team. As a key member of our data engineering department, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems that drive business growth and innovation.The ideal candidate will have a strong background in data...

  • Senior Data Engineer

    4 weeks ago


    Pretoria, Gauteng, South Africa Communicate Recruitment Full time

    As a Senior Data Engineer, you will lead the development of scalable data pipelines, mentor junior team members, and drive best practices in data engineering. You will work closely with data scientists and analysts to ensure they have access to the right data for generating insights.Skills & Experience: Minimum 5+ years of experience as a Data Engineer with...

  • Senior Data Engineer

    2 weeks ago


    Pretoria, Gauteng, South Africa Communicate Recruitment Full time

    As a Senior Data Engineer, you will lead the development of scalable data pipelines, mentor junior team members, and drive best practices in data engineering. You will work closely with data scientists and analysts to ensure they have access to the right data for generating insights.Skills & Experience: Minimum 5+ years of experience as a Data Engineer...


  • Pretoria, Gauteng, South Africa Findojobs South Africa Full time

    About the Role:This position is based in South Africa and is an excellent opportunity for a skilled Data Engineer to join our team.Main Responsibilities:Develop and implement data pipelines and ETL processes to extract, transform, and load data from various sources into data warehouses or data lakesCollaborate with data scientists and analysts to understand...

  • Senior Data Engineer

    3 weeks ago


    Pretoria, Gauteng, South Africa Communicate Recruitment Full time

    We are recruiting for a Senior Data Engineer to join a company that is reshaping the future of physical retail. This role offers the opportunity to design and optimize data infrastructure, enabling advanced analytics and machine learning.As a Senior Data Engineer, you will lead the development of scalable data pipelines, mentor junior team members, and drive...


  • Pretoria, Gauteng, South Africa Standard Bank Group Full time

    We are seeking a talented Data Engineer to join our team at Standard Bank Group.The successful candidate will be responsible for developing and maintaining complete data architecture across several application platforms, providing capability across application platforms.This includes designing, building, operationalising, securing, and monitoring data...


  • Pretoria, Gauteng, South Africa MSP Staffing (PTY) LTD Full time

    We are looking for a highly skilled Senior Machine Learning Engineer to join our team at MSP Staffing (PTY) LTD. The ideal candidate will have a strong background in machine learning and data engineering, with experience in software development and cloud computing.About the PositionThe Senior Machine Learning Engineer will be responsible for designing and...

  • Senior Data Engineer

    3 weeks ago


    Pretoria, Gauteng, South Africa Communicate Recruitment Full time

    As a Senior Data Engineer, you will lead the development of scalable data pipelines, mentor junior team members, and drive best practices in data engineering. You will work closely with data scientists and analysts to ensure they have access to the right data for generating insights. Skills & Experience: Minimum 5 years of experience as a Data Engineer with...


  • Pretoria, Gauteng, South Africa Kamo Placements Full time

    About the JobWe are seeking a highly skilled Big Data Solutions Specialist to join our team at Kamo Placements. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data solutions.Key Responsibilities:Design and develop scalable big data architectures to support business...

  • Senior Data Engineer

    2 weeks ago


    Pretoria, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...


  • Pretoria, Gauteng, South Africa Datafin Full time

    Are you a talented data engineer and analyst looking for a new challenge? We are seeking a seasoned professional to join our team as a Senior Data Engineer and Analyst.In this role, you will be responsible for providing technical leadership and guidance to ensure the successful delivery of projects. Your expertise in cloud platforms, big data technologies,...


  • Pretoria, Gauteng, South Africa Communicate Recruitment Full time

    Required Skills and QualificationsTo be successful in this role, you will need to possess the following qualifications and skills:Minimum 5 years of experience as a Data Engineer with expertise in Python, Java, or ScalaAdvanced proficiency in SQL and database optimizationExperience with data warehousing solutions (e.g., Databricks, Snowflake, Redshift)Strong...


  • Pretoria, Gauteng, South Africa Sita Soc Full time

    We're looking for a seasoned Senior Software Architect to join our team at Sita Soc. As a key member of our IT department, you'll play a critical role in designing and implementing large-scale data systems that meet the needs of our clients.In this role, you'll be responsible for:Designing and developing data warehouse architectures using SITA's software...