Data Engineer

5 days ago

Cape Town, Western Cape, South Africa Parvana Full time R900 000 - R1 200 000 per year

This is a remote position.

About our client:
Our client develops and supports software and data solutions across a variety of industries. They want you to get ahead of the market and stay there. They offer a combination of plug and play products that can be integrated with existing systems and processes and can also be customised to client needs. Their capabilities extend to big data engineering and bespoke software development, solutions are available as both cloud-based and hosted.

What you will be doing:

  • Analyzes complex customer data to determine integration needs.
  • Develops and tests scalable data integration/transformation pipelines using PySpark, SparkSQL, and Python.
  • Contributes to the codebase through coding, reviews, validation, and complex transformation logic.
  • Automates and maintains data validation and quality checks.
  • Collaborates with FPA, data engineers, and developers to align solutions with financial reporting and business objectives.
  • Participates in solution architecture and technical discussions, refining user stories and acceptance criteria.
  • Utilizes modern data formats/platforms (Parquet, Delta Lake, S3/Blob Storage, Databricks).
  • Partners with the product team to ensure accurate customer data reflection and provide feedback based on data insights.

What our client is looking for:

  • A Data Analytics Engineer with 5+ years of experience.
  • Must have strong Python, PySpark, Notebook, and SQL coding skills, especially with Databricks and Delta Lake.
  • Proven ability to build and deploy scalable ETL pipelines to cloud production environments using CI/CD.
  • Experience with Agile/Scrum, data quality concepts, and excellent communication is essential.
  • Cloud environment (Azure, AWS) and Infrastructure as Code (Terraform, Pulumi) experience beneficial.
  • Telecoms industry or consulting experience, plus accounting knowledge, is a plus.

Job ID:

  • J106998

For a more comprehensive list of opportunities that we have on offer, do visit our website -

Requirements

Data Engineer, PySpark, Python, SQL, Databricks, ETL, CI/CD, Cloud, Azure, AWS

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa Gig Engineer Full time R250 000 - R450 000 per year

    Position:Data EngineerLocation:Cape Town (Hybrid)Contract:12 MonthsRole DescriptionPerform code peer reviews of Junior Software Engineer buildsSupport the Technical Delivery Lead in translating requirements to Junior DevelopersSupport the Technical Delivery Lead in framework optimization initiativesSupport the Technical Delivery Lead in managing CI/CD...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Global One Full time R250 000 - R500 000 per year

    Job briefWe are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, youll create algorithms and conduct statistical analysis. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you...

  • Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa Boardroom Appointments Full time R240 000 - R3 000 000 per year

    Remote, Contract positionMinimum Requirements:BSc Engineering/ Computer Science/ relevant IT qualification4+ years experience in a Data domain role (Data engineering) / Data modelling experience in relevant environmentData warehouse technical experience definition /implementation/ integration.Strong programming skills in Python and DBA skills...

  • Data Engineer

    2 weeks ago

    Cape Town, Western Cape, South Africa The Career Network SA Full time R120 000 - R180 000 per year

    We're building one of Africa's strongest engineering teams — and we need an AWS-savvy Data Engineer to help power it.You'll design and run data pipelines that move fast, scale cleanly, and stay secure in the cloud. This means owning the full flow — from ingestion and storage to transformation and delivery — across a stack built mainly on AWS.What...

  • Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa AiR Full time R120 000 - R240 000 per year

    Data EngineerWe are seeking a skilled Data Engineer to design and build scalable, consistent data solutions across the business. This role focuses on developing and maintaining robust data pipelines, supporting data warehousing, and ensuring the delivery of clean, structured datasets for reporting, analytics, and integration with AI-driven systems. As part...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa Allan Gray Full time R900 000 - R1 200 000 per year

    Overview:We are a 77-member team consisting of Domain Owners, Development Managers, Architects, Business Analysts, Full Stack Developers, Data Engineers, DevOps Engineers and IT Operations specialists. Our team is responsible for the systems that support Allan Gray's asset management function, offering an exciting opportunity to grow within both the asset...

  • Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa PBT Group Full time R900 000 - R1 200 000 per year

    PBT Groupis seeking anexperienced Data Engineerto join our client's dynamic data team. The successful candidate will work closely with senior stakeholders to design, develop, and maintain robust data pipelines and cloud-based solutions.This role requires a strong understanding ofdata engineering principles,data lake management, andcloud...

  • Data Engineer

    1 week ago

    Cape Town, Western Cape, South Africa DLK Group Full time R120 000 - R180 000 per year

    Job DescriptionThe role of the Data Engineer encompasses many activities, including (but not limited to): Data Modeling: Designing logical and physical data models to support the data requirements of applications and analytics; ensuring data models meet business requirements and are optimized for performance and scalability.Data Integration: Designing and...

  • Data Engineer

    3 days ago

    Cape Town, Western Cape, South Africa Boardroom Appointments Full time R800 000 - R1 200 000 per year

    Contract position Minimum requirements:Tertiary qualification in Computer Science and/or Software Engineering and/or Information Systems and/or Information technology/or related technical certification in an IT field and /or International Data engineering QualificationMinimum of 5 years experience as Data Engineer working with:PowerBIMS SQLSSISAzure ADFGood...

  • Data Engineer

    5 days ago

    Cape Town, Western Cape, South Africa Lycopodium Full time R900 000 - R1 200 000 per year

    Leading EPCM/EPC organisationFast growing, fast paced companyGrow and accelerate your careerWith offices in Africa, Australia, Canada, Peru and the Philippines, Lycopodium proudly delivers high quality professional engineering and project delivery services globally, across the resources, infrastructure and industrial processes sectors. By joining our global...