Big Data Engineer Lead

7 days ago


Cape Town, Western Cape, South Africa Ringier South Africa Full time
About Us

We are Ringier South Africa, a technology company driving innovation for international marketplaces. We believe in delivering high-quality solutions that meet the needs of our customers and stakeholders.

Job Description

We are seeking a Senior Data Systems Developer to join our team. In this role, you will be responsible for designing and implementing data architectures, integrating data systems, and supporting analytics use cases.

Key Responsibilities
  • Data Architecture: Develop and maintain data architectures, including processes for data transformation, structures, metadata, dependencies, and workload management.
  • Data Integration: Design and implement data integrations, a data quality framework, and enhancements/new features for data warehousing, reporting, visualization, and master data management.
  • Analytics Support: Design and implement data architecture to support analytics use cases and drive internal process improvements through automation, optimization, and infrastructure redesign.
Requirements
  • Bachelor's degree in Computer Science/information systems/Engineering or related technical field or equivalent work experience
  • 7+ years related work experience
  • 4 years experience in Python
  • 4 years experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Experience in leading projects i.e. migrations
  • Experience in leading data teams highly desirable
  • Proficiency in managing data life cycle
  • Proficiency in manipulating, processing and architecting large disconnected data sets for analytical requirements


  • Cape Town, Western Cape, South Africa iqbusiness Full time

    About You and the Key Skills We're Looking ForWith your expertise in creating scalable and secure data solutions, you stand out as a strong candidate. Proficiency in AWS and Big Data technologies such as EC2, S3, Lambda, and Spark/SparkSQL enables you to handle massive amounts of data efficiently. Your skills with programming languages like Java, C#,...


  • Cape Town, Western Cape, South Africa Amazon Full time

    Are you passionate about cloud computing and big data? Do you want to work with cutting-edge technologies like Hadoop and Spark? Look no further! As a Cloud Support Engineer at Amazon, you will be responsible for supporting customers who are running ETL workloads or analyzing large amounts of data using AWS services.You will work on various services...


  • Cape Town, Western Cape, South Africa DVT Full time

    DVT is a global software development, technology consulting, and services company with a strong presence in various regions. We are seeking an experienced Senior Data Engineer to join our team and contribute to the design, development, and maintenance of scalable data solutions and infrastructure for our clients.This position requires a deep understanding of...


  • Cape Town, Western Cape, South Africa Skill Smiths Full time

    About the PositionWe are seeking a Senior Technical Lead - Data Engineering to join our team at Skill Smiths. As a key member of our Central Data Team, you will lead the technical direction of our data platform and collaborate with leaders, senior engineers, and architects of the broader Engineering team.Key Responsibilities:Drive the technical data platform...


  • Cape Town, Western Cape, South Africa Ozow group. Full time

    Ozow group is seeking a Technical Lead for Data Solutions to oversee the expansion and optimization of our data architecture. This includes designing, building, and maintaining large-scale data systems. The ideal candidate will have 3+ years of experience in developing data solutions and a strong background in data application/software...

  • AWS Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...


  • Cape Town, Western Cape, South Africa DVT Full time

    DVT is a leading provider of software development, technology consulting, and services with a presence in several countries. We are seeking an experienced Senior Data Engineer to join our team and contribute to the design, development, and maintenance of scalable data solutions and infrastructure for our clients.This position requires a deep understanding of...

  • Data Analyst Lead

    5 days ago


    Cape Town, Western Cape, South Africa MBA-Exchange Full time

    **Overview of the Role:**We are looking for a highly skilled Data Analyst Lead to join our team at MBA-Exchange.The successful candidate will be responsible for leading the development and implementation of business intelligence solutions, working closely with stakeholders to turn data into critical information and knowledge that can be used to make sound...


  • Cape Town, Western Cape, South Africa Tbwa ChiatDay Inc Full time

    As the head of our data engineering team, you will lead the development and maintenance of our data platforms. You will collaborate with stakeholders across the organization to design scalable systems that enable data-driven decision-making. Your responsibilities include managing and mentoring a team of engineers, ensuring they have the necessary skills and...


  • Cape Town, Western Cape, South Africa 5th Dimension Consulting Full time

    About This OpportunityWe're seeking an experienced Data Engineer to join our Ingestions Squad at 5th Dimension Consulting. As a key member of our team, you'll be responsible for designing and deploying high-performance data ingestion platforms that meet our stringent reliability and security standards.The ideal candidate will have a strong background in data...


  • Cape Town, Western Cape, South Africa Intellinexus Full time

    Company OverviewIntellinexus is a leading business-led data and business intelligence consultancy that empowers organisations with data-driven decision-making capabilities. Our team combines innovation and expertise to help organisations become smarter, more agile, and more resilient to the changes in their operating environments.Duties &...


  • Cape Town, Western Cape, South Africa DVT Full time

    DVT is a leading software development, technology consulting, and services company with a presence in several countries. We employ highly skilled professionals in various fields, including software development, business intelligence, business analysis, agile consulting, solution architecture, and project management.We are currently seeking an experienced...

  • Lead Data Engineer

    2 days ago


    Cape Town, Western Cape, South Africa IOCO Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our growing business. As a Lead Data Engineer, you will lead a team of data professionals, drive data...


  • Cape Town, Western Cape, South Africa Morae Global Corporation Full time

    Job DetailsAbout the JobWe are seeking an experienced Azure DevOps Engineer to join our team. The successful candidate will lead the design and implementation of our data infrastructure, with a focus on solution design, automating data pipelines from diverse sources, and Azure environment setup and optimization.This is an exciting opportunity for a hands-on...


  • Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    The successful candidate will be responsible for building, optimizing, and maintaining complex data pipelines and databases. They will collaborate with data scientists and analysts to ensure seamless data accessibility and quality while developing ETL processes and scalable storage solutions. The role involves implementing best practices for data security,...


  • Cape Town, Western Cape, South Africa Intellinexus Full time

    As a data engineer at Intellinexus, you will play a crucial role in designing, building, and maintaining the data infrastructure that supports our organization's data needs. You will work closely with various teams to gather requirements, design, and develop data pipelines, ensuring data quality and availability for analysis and reporting.Duties &...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    2 days ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...