Senior Data Engineer

5 days ago


Cape Town, Western Cape, South Africa Gomag Full time

Be among the first 25 applicants

com is the digital development arm of Media24, the largest media company in Southern Africa. At 24.com, we work on building the best experience for millions of users who visit our digital properties on a daily basis. We have a people-focused culture and we have a huge amount of fun while working together to execute fast. We keep our tech stack current and we're surrounded by plenty of opportunities for learning and growth. We're a happy team and we want to make the circle bigger

Why join us?

We have a people-focused culture and we have a huge amount of fun while working together to execute fast. We keep our tech stack current and we're surrounded by plenty of opportunities for learning and growth. We're a happy team and we want to make the circle bigger

What will you do?

You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from BigQuery and Dataproc to Kubernetes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it. We are in the game of taking data and turning it into amazing stories and pretty pictures that help the decision makers drive the business forward.

What should you have?
  • Tertiary qualification in Computer Science, IT or Informatics preferred
  • 5+ years development experience working with Python
  • Data skills (Traditional SQL and No-SQL)
  • Large scale ETL
  • High scale Restful Services
  • Cloud experience (Google Cloud Platform preferred)
  • Experience with source control (Git)
Beneficial Skills

You will be exposed to these in our environment, so it would be great if you had prior experience, but it's not a problem if you don't.

  • Scheduling and Orchestration (Airflow/Composer)
  • Containerisation (Kubernetes, Docker)
  • BigQuery
  • Elastic Search
  • Data Warehousing concepts
  • Data governance concepts.
  • Apache Beam (Cloud Dataflow)
  • Apache Spark (Dataproc)
Benefits Of Working At 24.com
  • Flexible working hours - core hours: 10am-3pm.
  • We welcome remote working.
  • Our department wide tech stack is diverse and includes: Android, iOS, React Native, .NET Core, Redis, ElasticSearch, SQL Server. We are 100% cloud based hosted in Azure.
  • Plenty of opportunities to learn and grow.
  • We are part of the Naspers group, which provides us with access to various technical training including free access to Udemy and similar platforms, as well as nanodegrees.
  • Free access to Microsoft certification training.
  • Opportunities for further study and skills development.
  • Opportunities to attend relevant tech events and expos.
  • Optional medical aid and flexible retirement funding.
Given the employment equity policy of Media24, preference will be given to suitable candidates from the designated groups.Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

Media Production

#J-18808-Ljbffr

  • Cape Town, Western Cape, South Africa Data Centrix Full time

    Qualifications:Matric qualificationTertiary qualification (Computer Science or IT related)Certifications CCNA, CCNP, JNCIAValid Drivers License and own vehicleExperience: Must have professional OME certification, working knowledge and experience of 5+ yearsSolid background in network administration and architectureIn-depth understanding of TCPIP and the...


  • Cape Town, Western Cape, South Africa Prisma Data, Inc. Full time

    At Prisma, we're redefining how developers work with databases. If you're fascinated by the cutting-edge data infrastructure powering companies like Twitter, Airbnb, and Facebook—but want the agility, ownership, and impact of a fast-moving startup—Prisma is the place for you.Backed by top-tier Silicon Valley investors like Amplify Partners, Kleiner...


  • Cape Town, Western Cape, South Africa Snap Analytics Full time

    About Snap AnalyticsWe are a leading data analytics consultancy with a presence in the UK and India. Our vision is to revolutionise the way businesses interact with data by leveraging cutting-edge cloud analytics solutions.The Job DescriptionThis Senior Data Consulting role involves leading the development of advanced Databricks solutions while fostering...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    About Dimension Data:Dimension Data is a global technology company that enables its clients to achieve their business outcomes by using innovative technology solutions.Job Description:We are seeking an experienced Electrical Projects Manager to lead and manage electrical construction projects. The ideal candidate will have a strong background in electrical...

  • Data Engineer

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    ? Join PBT Group as a Senior Data Engineer ?Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data engineering capability. This role is pivotal in advancing our cloud engineering and data management...

  • Senior Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    The successful candidate will be responsible for building, optimizing, and maintaining complex data pipelines and databases. They will collaborate with data scientists and analysts to ensure seamless data accessibility and quality while developing ETL processes and scalable storage solutions. The role involves implementing best practices for data security,...


  • Cape Town, Western Cape, South Africa E&D Recruiters Full time

    Senior Data and Vehicle Support Engineer (Telematics)  Cape Town  Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. Proficient in interpreting vehicle log data to support data analysis relevant...


  • Cape Town, Western Cape, South Africa TFB Hospitality Full time

    Triz Engineering Solutions is looking for a Senior Data and Vehicle Support Engineer to form part of our EV product development team. Candidates must fit the DNA of our company culture, be dynamic and embrace technologies in a competitive market. Apart from a contained and well-rounded person with a high EQ level, he/she will be required to deal with...

  • Data Engineering

    4 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    3 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Data Engineering

    1 week ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank's continued...

  • Senior Data Engineer

    3 weeks ago


    Cape Town, Western Cape, South Africa Progressive IT Resourcing Full time

    Our ClientCompany Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology...


  • Cape Town, Western Cape, South Africa BigTalent Full time

    BigTalent City of Cape Town, Western Cape, South AfricaPrincipal Lead: Data EngineerOur financial services client is looking for a Principal Lead Data Engineer to drive the Technical Vision, Strategy and Execution of their data engineering capability.The role will lead the design and implementation of scalable, high-performance data pipelines, data...


  • Cape Town, Western Cape, South Africa Three Ships Full time

    Job DescriptionThe successful candidate will be responsible for:Designing and building scalable data pipelines for the collection, transformation, and storage of data.Working with large, complex datasets to ensure efficient processing and integration.Developing data engineering solutions using Azure technologies and PySpark for distributed data...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    We are looking for a highly skilled Senior Cloud Engineer to join our team at PBT Group. As a Senior Cloud Engineer, you will be responsible for designing, building, and maintaining cloud-based data infrastructure to ensure scalability, security, and high performance.About the Role:You will work closely with the development team and business stakeholders to...


  • Cape Town, Western Cape, South Africa CapitalH Full time

    Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa's top digital, print, and ecommerce platforms.The client's team of engineers, data scientists, product managers and UX/UI design specialists develop exceptional digital...


  • Cape Town, Western Cape, South Africa CapitalH Full time

    Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa's top digital, print, and ecommerce platforms.The client's team of engineers, data scientists, product managers and UX/UI design specialists develop exceptional digital...


  • Cape Town, Western Cape, South Africa CapitalH Full time

    Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa's top digital, print, and ecommerce platforms. The client's team of engineers, data scientists, product managers and UX/UI design specialists develop exceptional digital...


  • Cape Town, Western Cape, South Africa Prisma Data, Inc. Full time

    About the JobWe are looking for a highly skilled ENGINEERING DIRECTOR - DATABASES to join our team at Prisma Data, Inc. As a Senior Engineering Manager, you will own the core commercial infrastructure and products, ensuring they scale to millions of users while maintaining performance and reliability.Your Key ResponsibilitiesLeadership: Empower your...


  • Cape Town, Western Cape, South Africa Ampstek Full time

    AWS Data Engineer Position at Ampstek:About the RoleThis role involves designing, developing and maintaining scalable data solutions on AWS Cloud.The ideal candidate will have experience in data pipelines, ETL processes and data lake/warehouse solutions using AWS services.ResponsibilitiesImplement data security, governance and compliance best...