Senior Data Engineer

4 weeks ago

Johannesburg, Gauteng, South Africa Betway Group Full time

Kick-start your career in the online gaming world and experience the very latest in technology and innovation.

Data Pipeline Design and Development

Senior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and load (ETL) data from various sources into a data warehouse or data lake.

Database Management

They have expertise in working with relational and non-relational databases like SQL Server, Oracle, CosmosDB, MongoDB, or Cassandra. They optimize database performance, ensure data consistency, and implement data security measures.

Data Modeling

Senior Data Engineers have a strong understanding of data modeling techniques and practices. They design and maintain data models that support efficient data retrieval and analysis, ensuring data consistency and integrity.

They are familiar with big data technologies such as Apache Hadoop, Apache Hive, or Apache HBase. They can handle and process large datasets efficiently, leveraging distributed computing frameworks like Apache Spark or MapReduce.

Data Quality and Governance

Senior Data Engineers establish data quality frameworks and implement data governance practices to ensure data accuracy, completeness, and consistency. They collaborate with data stewards and data owners to define and enforce data quality standards.

They have experience working with cloud platforms like AWS, Azure, or Google Cloud Platform. They leverage cloud services and infrastructure to build scalable and cost-effective data solutions.

Programming and Scripting

Senior Data Engineers are proficient in programming languages like Python, SQL, or Scala. They write efficient code to process and transform data, automate data workflows, and develop data-driven applications.

Monitoring and Performance Optimization

Senior Data Engineers monitor data pipelines and systems for performance issues, troubleshoot and resolve them to ensure smooth data flow. They optimize query performance, tune database configurations, and implement caching strategies.

They collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to understand data requirements and provide data engineering support. They communicate effectively and participate in project planning and execution.

Mentoring and Knowledge Transfer

The Senior Data Engineer is accountable for the technical guidance and mentoring of Junior Data Engineers. They are also expected to share business and technical knowledge within the greater team.

Continuous Learning and Innovation

They stay updated with the latest advancements in data engineering, big data technologies, and industry trends. They explore new tools, frameworks, and techniques to improve data processing efficiency and drive innovation.

This position requires trust and honesty as it has access to customers' financial details; therefore, a credit and criminal record check will be conducted. The qualifications identified herein are an inherent job requirement; therefore, a qualification verification check will be done. By applying for this role and supplying the necessary details, you hereby grant us permission to apply for these checks. This will be done in a confidential manner and solely for the purposes of verification.

Should you not hear from us within 2 weeks, please deem your application as unsuccessful.

The perfect place to work, play, and grow

About Us

Our journey started in 1999 with a handful of brilliant individuals and some very big picture thinking. Now, we are an ever-growing community of 1,000+ talented and exceptional people at the forefront of the vast and competitive world.

Betway has become ingrained in African soil, having set down early roots in markets such as Ghana and South Africa. From there, Betway has weaved its way across the landscape, incorporating regions in East, West, and Southern Africa. This growth also shows no signs of slowing, as Betway continues to be embraced by fans of sports betting in more and more African regions.

Whether it's a career in banking and finance, marketing, development, or customer care, our people cover a broad range of dedicated specializations, all under one Betway Africa roof.

#J-18808-Ljbffr

  • Senior Data Engineer/Analyst

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data engineering, analytics, and cloud-based...

  • Senior Data Science and Engineering Leader

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a seasoned Senior Data Engineer/Analyst to lead our data engineering efforts.About the RoleThe ideal candidate has strong experience in data engineering, analytics, and cloud-based technologies, with expertise in SQL, Python, ETL processes, and big data platforms.ResponsibilitiesDesign and implement data pipelines for data ingestion,...

  • Senior Data Engineer/Analyst

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year contractHybrid RoleJohannesburgJob Summary We are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data...

  • Senior Data Science Specialist

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    As a Senior Data Science Specialist at Gig Engineer, you will play a critical role in driving data-driven decision-making across the organization. This senior-level position requires expertise in designing, building, and maintaining scalable and efficient ETL pipelines for data ingestion, transformation, and storage.Data Engineering & ArchitectureDesign and...

  • Data Engineer/Analyst Position

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer seeks a highly skilled Senior Data Engineer/Analyst to join our dynamic team.Job DescriptionThis role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable and efficient ETL pipelines...

  • Big Data Architect and Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are seeking a highly skilled Senior Data Engineer/Analyst to join our team of data professionals.About the JobThis role will focus on designing, building, and maintaining data pipelines, as well as analyzing large datasets to provide key insights.Key ResponsibilitiesDesign and develop ETL pipelines for data ingestion, transformation, and storage.Build and...

  • Data Science Engineer Lead

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is hiring a Senior Machine Learning Engineer to lead the development of cutting-edge machine learning models.The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing scalable AI solutions.Key Responsibilities:Develop and optimize machine learning models for...

  • Senior Machine Learning Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year ContractHybrid RoleJohannesburgJob Summary:We are seeking an experienced Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models. The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing...

  • Data Engineering and Analytics Lead

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    The Cloud Data Architect will be responsible for designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureEnsure data quality, integrity, and security across all data processing workflows.Implement data governance,...

  • Cloud-Based Data Solutions Expert

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a talented Senior Data Engineer/Analyst to join our team.Role OverviewThe successful candidate will be responsible for designing, building, and maintaining data pipelines, as well as analyzing large datasets to provide key insights.Main ResponsibilitiesDevelop and implement ETL pipelines for data ingestion, transformation, and...

  • Cloud Data Architect

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a skilled Big Data and AI Developer to join our team. The ideal candidate has strong experience in data engineering, analytics, and BI development, with expertise in SQL, Python, ETL processes, and big data platforms.Data Engineering & ArchitectureDesign, develop, and maintain scalable and efficient ETL pipelines for data ingestion,...

  • Senior AI Developer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is looking for an experienced Senior Machine Learning Engineer to join our team.The successful candidate will have a strong background in machine learning, deep learning, and software engineering, as well as experience in designing scalable AI solutions.Job Summary:Design, develop, and optimize machine learning models for real-world...

  • Big Data and AI Developer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a talented Cloud Data Architect to lead our cloud-based data solutions. The successful candidate will have experience in designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureCollaborate with Data...

  • Senior Data Network Specialist

    5 days ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the RoleThe Senior ISP Network Engineer at Dimension Data designs and implements complex data networks across multiple locations. This role involves close collaboration with business teams to provide innovative solutions to their network challenges. Additionally, the engineer works with partners on vendor projects or in-house engineering...

  • Senior Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Liyema Consulting Full time

    Job Title: Senior Data EngineerReference: JHB001499-FE-1Type: PermanentLocation: Gauteng, JohannesburgAbout Us:We're a leading data solutions firm in South Africa, dedicated to fostering equality through actionable insights.Responsibilities:As a Senior Data Engineer, you'll be tasked with designing robust data architectures, managing seamless pipelines,...

  • Senior Data Engineers

    3 weeks ago

    Johannesburg, Gauteng, South Africa DVT Full time

    DVT is a software development, technology consulting and related services company, with offices in Cape Town, Johannesburg, Durban, UK, Kenya, Ireland and Switzerland with over 600 staff. We employ highly - skilled individuals in the fields of Software Development (.Net, Mobile and Java), Business Intelligence, Business Analysis, Agile Consulting, Solution...

  • Senior ISP Network Engineer

    6 days ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    The Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their network challenges....

  • Machine Learning Specialist

    2 weeks ago

    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models.The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing scalable AI solutions.Key Responsibilities:Model...

  • Senior Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Indsafri Full time

    Indsafri City of Johannesburg, Gauteng, South AfricaExp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...

  • Senior Data Engineering Lead

    3 days ago

    Johannesburg, Gauteng, South Africa DVT Full time

    About the RoleThe Senior Data Engineer will collaborate closely with cross-functional teams to ensure data pipelines are efficient, reliable, and aligned with business objectives within our clients.Develop and maintain optimal data pipeline architectureCollaborate with data scientists and business analysts to meet functional data requirementsAssist the Lead...