Senior Data Engineer

3 days ago


Johannesburg, Gauteng, South Africa Betway Group Full time

Kick-start your career in the online gaming world and experience the very latest in technology and innovation.

Data Pipeline Design and Development

Senior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and load (ETL) data from various sources into a data warehouse or data lake.

Database Management

They have expertise in working with relational and non-relational databases like SQL Server, Oracle, CosmosDB, MongoDB, or Cassandra. They optimize database performance, ensure data consistency, and implement data security measures.

Data Modeling

Senior Data Engineers have a strong understanding of data modeling techniques and practices. They design and maintain data models that support efficient data retrieval and analysis, ensuring data consistency and integrity.

They are familiar with big data technologies such as Apache Hadoop, Apache Hive, or Apache HBase. They can handle and process large datasets efficiently, leveraging distributed computing frameworks like Apache Spark or MapReduce.

Data Quality and Governance

Senior Data Engineers establish data quality frameworks and implement data governance practices to ensure data accuracy, completeness, and consistency. They collaborate with data stewards and data owners to define and enforce data quality standards.

They have experience working with cloud platforms like AWS, Azure, or Google Cloud Platform. They leverage cloud services and infrastructure to build scalable and cost-effective data solutions.

Programming and Scripting

Senior Data Engineers are proficient in programming languages like Python, SQL, or Scala. They write efficient code to process and transform data, automate data workflows, and develop data-driven applications.

Monitoring and Performance Optimization

Senior Data Engineers monitor data pipelines and systems for performance issues, troubleshoot and resolve them to ensure smooth data flow. They optimize query performance, tune database configurations, and implement caching strategies.

They collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to understand data requirements and provide data engineering support. They communicate effectively and participate in project planning and execution.

Mentoring and Knowledge Transfer

The Senior Data Engineer is accountable for the technical guidance and mentoring of Junior Data Engineers. They are also expected to share business and technical knowledge within the greater team.

Continuous Learning and Innovation

They stay updated with the latest advancements in data engineering, big data technologies, and industry trends. They explore new tools, frameworks, and techniques to improve data processing efficiency and drive innovation.

This position requires trust and honesty as it has access to customers' financial details; therefore, a credit and criminal record check will be conducted. The qualifications identified herein are an inherent job requirement; therefore, a qualification verification check will be done. By applying for this role and supplying the necessary details, you hereby grant us permission to apply for these checks. This will be done in a confidential manner and solely for the purposes of verification.

Should you not hear from us within 2 weeks, please deem your application as unsuccessful.

The perfect place to work, play, and grow

About Us

Our journey started in 1999 with a handful of brilliant individuals and some very big picture thinking. Now, we are an ever-growing community of 1,000+ talented and exceptional people at the forefront of the vast and competitive world.

Betway has become ingrained in African soil, having set down early roots in markets such as Ghana and South Africa. From there, Betway has weaved its way across the landscape, incorporating regions in East, West, and Southern Africa. This growth also shows no signs of slowing, as Betway continues to be embraced by fans of sports betting in more and more African regions.

Whether it's a career in banking and finance, marketing, development, or customer care, our people cover a broad range of dedicated specializations, all under one Betway Africa roof.

#J-18808-Ljbffr

  • Johannesburg, Gauteng, South Africa Dynexity Full time

    Our client is seeking an experienced senior data engineer to join their team. Candidate must hold the necessary tertiary qualification and have extensive experience with SQL/SSIS packages.


  • Johannesburg, Gauteng, South Africa Indsafri Full time

    Indsafri City of Johannesburg, Gauteng, South AfricaExp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloudJob Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)Company Name: IndsafriNotice Period: Immediate to 30 days of notice (More than 30 days of notice...

  • Senior Data Engineer

    21 hours ago


    Johannesburg, Gauteng, South Africa Standard Bank Group Full time

    At Standard Bank Group, we are passionate about creating growth in Africa. As a Mid-Senior Level Data Engineering professional, you will play a crucial role in designing, coding, verifying, testing, documenting, amending, and securing data pipelines and data stores according to agreed architecture, solution designs, standards, policies, and governance...


  • Johannesburg, Gauteng, South Africa Eqplus Technologies (Pty) Ltd Full time

    **Job Description:**Senior Data Engineer for AWSWe are looking for an experienced Senior Data Engineer to join our team at Eqplus Technologies (Pty) Ltd. The successful candidate will be responsible for designing and implementing data warehousing solutions using AWS services.Key Responsibilities:Design and develop data pipelines using AWS Lambda, Step...

  • Data Analyst

    3 days ago


    Johannesburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing and analytics systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    About the Job Data Centrix is looking for a seasoned professional to lead our security architecture efforts. As a Senior Security Solutions Architect, you will drive the development of comprehensive security strategies that protect our organization's assets. Your leadership skills will enable you to mentor and guide a team of security architects and...

  • Data Engineer

    3 days ago


    Johannesburg, Gauteng, South Africa CrossBoundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are looking for an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems and infrastructure.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to understand data...

  • Engineer, Data

    24 hours ago


    Johannesburg, Gauteng, South Africa Standard Bank Group Full time

    Get AI-powered advice on this job and more exclusive features.Company DescriptionStandard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities – plus the chance to work alongside some of the sector's most talented, motivated professionals. Our...


  • Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...


  • Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...


  • Johannesburg, Gauteng, South Africa Data Bene Full time

    About the RoleThe Data Analyst will play a crucial role in driving business growth by providing insights and recommendations based on data analysis.Key Responsibilities include:Collecting, organizing, analyzing, and disseminating information to support business decision-makingResolving data queries, report writing, and presenting findings to...


  • Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    Data Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...


  • Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    Data Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...


  • Johannesburg, Gauteng, South Africa Data Bene Full time

    About the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Key Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...


  • Johannesburg, Gauteng, South Africa Psybergate (Pty) Ltd Full time

    Senior Data Engineer RolePsybergate (Pty) Ltd is a leading provider of bespoke software solutions and skilled resources to its clients. We are seeking a highly skilled Senior Data Engineer to join our team in Sandton for a 12-month contract role.About the PositionThe successful candidate will be responsible for designing and implementing data integration...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Nedbank Full time

    Job title : Data EngineerJob Location : Gauteng, JohannesburgDeadline : April 05, 2025Quick Recommended LinksJobs by Location Job by industries Job PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought leadership for the...