Senior Data Engineer

1 week ago


Sandton, South Africa Yugantic Full time

3 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Yugantic

Principal Consultant: Business Intelligence & Data Analytics at Sambe Consulting

Yugantic is on the hunt for a talented Senior Data Engineer to join our innovative team. If you're passionate about designing large-scale enterprise data solutions and leveraging cutting-edge AWS technologies, we want to hear from you

Key Responsibilities:

  • Enterprise Data Solutions: Design and implement large-scale data solutions using AWS Glue, AWS Step Functions, AWS RedShift, AWS Lambda, AWS Athena, AWS Lake Formation, Spark, and Python.
  • Cloud Migration: Analyze, re-architect, and re-platform on-premise data warehouses to AWS cloud environments using both AWS and third-party services.
  • Data Pipeline Development: Build robust production data pipelines from ingestion to integration using PySpark, Python, and SQL.
  • Analytical Infrastructure: Develop and maintain an analytical data infrastructure that provides ad-hoc access to extensive datasets and computing power.
  • Collaborative Data Integration: Interface with cross-functional technology teams to extract, transform, and load data from diverse sources.
  • Innovation & Research: Stay ahead by researching and implementing the latest big data and visualization technologies to boost capabilities and efficiency.
  • Advanced Analytics: Collaborate to integrate advanced analytics, including statistical analysis, prediction, clustering, and machine learning.
  • Continuous Improvement: Enhance reporting and analysis processes by automating and simplifying self-service customer support.

Experience & Skills:

  • Core Expertise: Advanced knowledge in Data Engineering and modern data practices.
  • System Design: Proven experience in building/operating highly available, distributed systems for data extraction, ingestion, and processing of large datasets.
  • Data Analysis: Strong analytical skills with the ability to work with unstructured datasets and perform root cause analysis.
  • Technical Proficiency: Proficient in SQL, with the ability to write and optimize complex queries.
  • Hands-on experience with AWS Glue, PySpark, and SQL is a must.
  • Additional Assets: Experience with AWS cloud services (EC2, EMR, RDS, DynamoDB) and workflow management tools like AWS Step Functions or Control-M is beneficial.
  • Educational Background: Bachelor's Degree in Computer Science, Information Technology, or a related field.
  • Best Practices: Knowledge of agile methodologies, coding standards, code reviews, source management, build processes, testing, DevOps, and operations.

Why Join Yugantic?

At Yugantic, you'll have the opportunity to work on transformative projects in a dynamic and collaborative environment. We believe in empowering our team with the latest technology and providing the tools to drive success.

Salary Details:

The salary for this role will be presented to shortlisted candidates.

Ready to make an impact?

Apply now to join our forward-thinking team and drive the future of data engineering at Yugantic

Yugantic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Seniority level
  • Mid-Senior level
Employment type
  • Contract
Job function
  • Information Technology
#J-18808-Ljbffr

  • Sandton, South Africa Datacentrix Full time

    Senior Data EngineerManaged Talents Solutions' client is looking for a Senior Data Engineer with 5+ years lead analysts to design, build, and implement data and analytics products and solutions for various stakeholders to enable our journey in becoming an insights-led organisation. Will work with cross functional teams across product, technology, and subject...


  • Sandton, South Africa Innovation Group Full time

    About the JobThe Innovation Group is seeking an experienced Senior Data Engineer to lead our data engineering efforts. As a Senior Data Engineer, you will be responsible for developing and implementing data warehousing blueprints, evaluating hardware and software platforms, and integrating systems.Key ResponsibilitiesDevelop and implement data warehousing...


  • Sandton, South Africa Innovation Group Full time

    Responsible for developing data warehousing blueprints, evaluating hardware and software platforms and integrating systems. Manages the data environment which includes data design, database architecture, metadata and repository creation. Translates business needs into long-term architecture solutions. Defines, designs and builds dimensional databases....


  • Sandton, South Africa Datacentrix Full time

    Datacentrix Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to lead our data analytics team at Datacentrix. The ideal candidate will have a strong background in data engineering, data analytics, and experience working with cross-functional teams.The successful candidate will be responsible for designing, building, and...


  • Sandton, South Africa Innovation Group Full time

    Data Engineer Job SummaryWe are seeking an experienced Senior Data Engineer to join our team at the Innovation Group. The ideal candidate will have a strong background in data engineering, experience with cloud platforms, and excellent leadership skills.Key ResponsibilitiesDevelop and implement data warehousing blueprintsEvaluate hardware and software...

  • Data Engineer

    1 week ago


    Sandton, South Africa Brambles Full time

    CHEP helps move more goods to more people, in more places than any other organization on earth via our 347 million pallets, crates and containers. We employ approximately 13,000 people and operate in 60 countries. Through our pioneering and sustainable share-and-reuse business model, the world's biggest brands trust us to help them transport their goods more...


  • Sandton, South Africa DeARX Full time

    Exciting Opportunity: Data Engineer at a Leading BankRef: 4046Contract Period: 01/10/2024 to 30/09/2025Location: Hybrid (3 days onsite in Sandton, 2 days remote)Application Deadline: 12/09/2024Are you a talented Data Engineer with expertise in Ab Initio? Join a prestigious bank in Sandton and play a key role in transforming their data infrastructure. If...

  • Senior Data Scientist

    2 weeks ago


    Sandton, South Africa Fempower Personnel Full time

    Looking for a challenging and rewarding career opportunity as a Senior Data Scientist? Our client is currently seeking an experienced and driven individual to join their team based in Sandton. To be considered for this role, you must have a Bachelor's degree in Statistics, Mathematics, Data Science, Operations Research, or Engineering. A Master's degree in...


  • Sandton, South Africa DeARX Full time

    About DeARXWe are a leading bank in Sandton, and we're looking for a talented Data Engineer to join our team.You will be responsible for designing, developing, and optimizing data pipelines using Ab Initio. You will also work closely with data scientists, analysts, and stakeholders to address data needs and ensure seamless integration.Key...


  • Sandton, South Africa Redscreen World Full time

    RedScreen is a leading developer of software systems for the Financial Services sector. The products, solutions and services we create are developed and maintained by a team of highly skilled people, operating in a very competitive and increasingly sophisticated market **Role Description** This is a full-time on-site role for a Senior Technical Data...


  • Sandton, South Africa Steinmüller Africa Full time

    Job Title: Senior Piping Engineer - Design and AnalysisAbout Steinmüller AfricaWe are a leading provider of engineering services, seeking a seasoned Senior Piping Engineer - Design and Analysis to join our team.Key Responsibilities:Analyze technical and operational data, evaluating failures and proposing design changes.Check technical calculations performed...


  • Sandton, South Africa Copious Software Full time

    Drive Business Growth with Data InsightsCopious Software is dedicated to helping businesses grow by providing high-value technology services. As a Solution Engineer in the Data vertical, you will play a crucial role in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Your responsibilities will include creating and...


  • Sandton, South Africa DeARX Full time

    About the job Senior IT Process Engineer -BankingWere Hiring: Senior IT Process Engineers in BankingLocation: Sandton Offices (Full-time Onsite )Contract: 12 Months (with potential for extension)Hours: Extended hours may be required based for project demandsAre you a seasoned IT Process Engineer with a passion for driving complex business outcomes?Were on...


  • Sandton, South Africa Tech Sight (Pty) Ltd Full time

    About the Role:Join a technologically advanced bank as a Principal Ab Initio Data Engineer. We are seeking a highly skilled expert with extensive experience in coding complex rules, procedures, and processes to automate actions, optimize deployments, and extract data from intricate environments for end users.Key Responsibilities:Advanced Data Engineering:...


  • Sandton, South Africa Tech Sight (Pty) Ltd Full time

    About this Opportunity:Tech Sight (Pty) Ltd is seeking a highly skilled Principal Ab Initio Data Engineer to join their team. As a key member of the team, you will be responsible for designing, building, and maintaining scalable Ab Initio data pipelines and ETL processes that meet business requirements.Responsibilities:Design and implement advanced data...


  • Sandton, South Africa Core Group Full time

    As a Senior Business Intelligence Manager, you will lead our business intelligence efforts, managing a dynamic team while leveraging your expertise in various data tools. You will be responsible for designing and implementing robust BI solutions, overseeing the creation and management of data pipelines, and ensuring the team delivers valuable insights to...

  • Senior Data Analyst

    2 weeks ago


    Sandton, South Africa Datonomy Solutions Full time

    Wonderful, and exciting opportunties for 8 Data Analysts who want to get their "hands dirty" and "hit the ground runing." This is a fully remote role! Below is the qualifying criteria, hence you will need to clarify where you have gained this expeirence once your have applied for the role. - 5+ Years experience as a data analyst - BLOB Data Object...


  • Sandton, South Africa Datonomy Solutions Full time

    Job DescriptionWe are seeking a skilled Senior Software Engineer to join our team at Datonomy Solutions in Johannesburg.The successful candidate will be responsible for designing, developing, and maintaining high-performance server-side components using Node.js.You will work closely with front-end developers to integrate user-facing elements with server-side...


  • Sandton, South Africa Innovation Group Full time

    Job DescriptionThe Senior Data Engineer will be responsible for developing and implementing data warehousing blueprints, evaluating hardware and software platforms, and integrating systems. This individual must have a deep understanding of data design, database architecture, metadata, and repository creation.ResponsibilitiesDevelop and implement data...


  • Sandton, South Africa E-Merge IT Recruitment Full time

    About the RoleWe are seeking a highly skilled Senior React Developer to join our client's SA team. As a Senior React Developer, you will be responsible for aiding the migration of a core business product. You will be part of a fully integrated, multitenant web application operating globally, utilizing cutting-edge development practices and technologies such...