Data Engineer Lead

1 day ago


Randburg, Gauteng, South Africa Liberty Group Limited Full time
Job Summary

We are seeking a highly skilled Data Engineer Lead to join our team and lead the design, implementation, and support of our big data infrastructure.

Key Responsibilities:

  1. Big Data Solutions: Collaborate with cross-functional teams to design and implement large-scale enterprise data solutions using AWS Glue, PySpark, and other technologies.
  2. Cloud Services: Experience with AWS services such as EC2, EMR, RDS, DynamoDB, and data pipeline and workflow management tools like AWS StepFunctions and Control-M.
  3. Software Development: Proficient in SQL, Python, and PySpark, with a strong focus on software engineering best practices.
Requirements

To be successful in this role, you will need:

  1. Advanced Data Engineering Knowledge: Experience working with modern data practices, building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
  2. Cloud Services: Proficiency in AWS services such as EC2, EMR, RDS, DynamoDB, and experience with data pipeline and workflow management tools like AWS StepFunctions and Control-M.
  3. Programming Skills: Strong analytic skills related to working with unstructured datasets, proficient in SQL, Python, and PySpark.
  4. Collaboration: Experience supporting and working with cross-functional teams in a dynamic environment.
About Us

Liberty Group Limited is an equal opportunity employer. We actively encourage and welcome people with various disabilities to apply.


  • Azure Data Engineer

    4 hours ago


    Randburg, Gauteng, South Africa Dimension Data Full time

    Are you tired of micro-managing your Azure servers? Do you want to work with one of the best teams in the region? Apply for this Azure Data Engineer roleOur client requires an Azure Data Engineer to develop, deploy and monitor data pipelines across the Data Lake and into Synapse. Develop PowerBI data sets and data flows and develop curated data sets for...


  • Randburg, Gauteng, South Africa Capitec Bank Full time

    At Capitec Bank, we are seeking a skilled Data Engineering Lead to play a pivotal role in designing and managing scalable data pipelines. As the holder of this position, you will be responsible for ensuring efficient analytics operations to empower data-driven decision-making.This is an exciting opportunity for a Senior Data and Analytics Professional who...


  • Randburg, Gauteng, South Africa Goldman Tech Resourcing Full time

    Are you a seasoned leader in data engineering with a passion for mentoring teams and driving technical excellence? We're looking for a Data Engineering Team Lead to take charge of a talented team of engineers and analysts, helping to develop and maintain cutting-edge data solutions that solve real business needs. In this role, you will lead, grow, and...


  • Randburg, Gauteng, South Africa PBT Group Full time

    We are seeking a highly skilled Enterprise Data Engineering Lead to join our team at PBT Group in Johannesburg.The ideal candidate will be responsible for leading the design, development, and maintenance of robust data solutions that support business intelligence and analytics needs.This role requires a deep understanding of database management, ETL...


  • Randburg, Gauteng, South Africa Golden Rule Full time

    Job DescriptionThe Data Engineer will be responsible for collecting and validating business information, which can then be used by data scientists and business stakeholders. This includes designing and implementing data models and architectures that enable business stakeholders to gain insights from large-scale datasets.To achieve this goal, the Data...


  • Randburg, Gauteng, South Africa Goldman Tech Resourcing Full time

    At Goldman Tech Resourcing, we're looking for a seasoned data engineering leader to take charge of our talented team of engineers and analysts. This role involves developing and maintaining cutting-edge data solutions that solve real business needs. As a Data Engineering Team Lead, you'll lead, grow, and support the data team, guiding them through the full...

  • Azure Data Engineer

    6 hours ago


    Randburg, Gauteng, South Africa Dimension Data Full time

    Are you looking to advance your career in cloud computing?About the RoleWe are seeking an experienced Azure Data Engineer to join our team, who can design and develop data pipelines across the Data Lake and into Synapse.Key ResponsibilitiesDeveloping and deploying data marts and transformations using Azure services.Creating PowerBI data sets and data flows...


  • Randburg, Gauteng, South Africa Goldman Tech Resourcing Full time

    The Data Engineering Team Lead plays a critical role in driving technical excellence at Goldman Tech Resourcing. As a seasoned data engineering leader, you'll guide a talented team of engineers and analysts in developing and delivering high-quality data solutions. Key responsibilities include prioritizing work, implementing best practices, and ensuring data...

  • Data Analyst

    6 days ago


    Randburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg.The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions.Utilize technical expertise to ensure data is accurate and high-quality.Key ResponsibilitiesTranslate business...

  • Data Engineer

    1 week ago


    Randburg, Gauteng, South Africa Ananzi Full time

    Data EngineerCrossBoundary EnergyAbout the FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $M, the company boasts over MW of solar PV and wind generation, approximately MWh of battery...


  • Randburg, Gauteng, South Africa Goldman Tech Resourcing (Pty) Ltd Full time

    Technical Lead in AI and Data ScienceGoldman Tech Resourcing (Pty) Ltd is seeking a highly skilled Technical Lead to join their team in Johannesburg. This is an exciting opportunity for an experienced professional to take on a key role in the development of data-driven solutions.Job Description:Company OverviewGoldman Tech Resourcing (Pty) Ltd is a leading...


  • Randburg, Gauteng, South Africa NTT Data Full time

    We are seeking a skilled DevOps engineer to join our team at NTT Data. As a DevOps engineer, you will play a key role in ensuring the smooth operation of our infrastructure and applications. You will be responsible for designing, implementing, and maintaining our cloud-based systems, as well as collaborating with cross-functional teams to deliver...

  • Data Engineer

    1 week ago


    Randburg, Gauteng, South Africa Crossboundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements.With a secured portfolio exceeding $M, the company boasts over MW of solar PV and wind generation,...


  • Randburg, Gauteng, South Africa Indsafri Full time

    Job OverviewIndsafri, a leading company in the heart of Johannesburg, is seeking an experienced Data Engineer to join our team. This role offers a unique opportunity to leverage your data expertise and contribute to the company's Data Architecture Roadmap.Key ResponsibilitiesMaintenance, improvement, cleaning, and manipulation of data in operational and...

  • Data Engineer

    1 week ago


    Randburg, Gauteng, South Africa Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer Lead

    1 day ago


    Randburg, Gauteng, South Africa Plus1X Solutions (Pty) Ltd Full time

    Company OverviewWe are Plus1X Solutions (Pty) Ltd, a leading provider of innovative data solutions. Our mission is to deliver cutting-edge technology that drives business growth and success.


  • Randburg, Gauteng, South Africa Dimension Data Full time

    The Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their network challenges....

  • Big Data Engineer

    6 days ago


    Randburg, Gauteng, South Africa Iqbusiness Full time

    We believe in fostering a culture of learning and growth.As a Big Data Engineer, you will have the opportunity to work on large-scale data projects and develop expertise in big data technologies such as Hadoop, Spark, and NoSQL databases.Your key responsibilities will include designing and developing big data solutions, ensuring data quality and integrity,...

  • Technical Lead

    6 days ago


    Randburg, Gauteng, South Africa Iqbusiness Full time

    We value innovation and creativity in everything we do.As a Technical Lead - Data Services, you will have the opportunity to lead a team of data engineers and develop cutting-edge data solutions that drive business growth.Your key responsibilities will include leading cross-functional teams, mentoring junior engineers, and driving innovation through new...


  • Randburg, Gauteng, South Africa Salt Employee Benefits Full time

    Salt Employee Benefits is looking for a talented Data Solutions Lead to spearhead the development of our data infrastructure. This individual will be responsible for working with various stakeholders across the organization to understand data requirements and apply technical knowledge of data management to solve key business problems.Key...