Data Engineer

1 month ago


Cape Town City Centre, South Africa Jobted ZA C2 Full time

Qualifications:

- BSc Degree in Computer Science/Information Systems/Engineering or equivalent work experience
- 5+ years of relevant experience, including 2+ years in building and optimizing big data pipelines

Requirements:

- Proficiency in Python, SQL (PostgreSQL, MS SQL), and cloud services (AWS, Azure, or GCP)
- Strong skills in version control, CI/CD, and GitHub
- Experience with Palantir Foundry
- Expertise in managing data life cycle, large datasets, and data transformation processes
- Experience with Glue and PySpark is a plus
- Knowledge in data quality assurance, governance, and processing unstructured data
- Familiarity with message queuing and stream processing

KPAs:

- Propose and implement process improvements for automation, scalability, and efficiency
- Develop and enhance data systems and streamline CI/CD processes for optimal data pipelines
- Assemble complex data sets to meet business requirements and drive efficient ETL processes
- Conduct unit tests and ensure data consistency while building automated monitoring solutions
- Support reporting and analytics infrastructure and uphold data quality, governance, and infrastructure maintenance (e.g., AWS, database security)
- Maintain metadata, data catalogues, user documentation, and apply best practices in database management (collations, engines, indices)

Apply now and be a key contributor in revolutionizing data infrastructure

For more IT jobs, visit


  • Data Engineer

    7 months ago


    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...

  • Data Engineer

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seamless integration and accessibility of data across the organisation. Responsibilities: • Data...

  • Data Engineer

    2 months ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    As a Data Engineer at our client, youll play a pivotal role in expanding and optimizing their data architecture and data pipeline systems. Youll work with cutting-edge technology to build efficient data solutions that support cross-functional teams, improve processes, and unlock powerful insights for the business. If you enjoy tackling complex data...

  • Data Engineer

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Key Responsibilities: - Design, build, and maintain scalable data pipelines to support data integration, processing, and analytics. - Collaborate with cross-functional teams to understand business requirements and implement data solutions. - Work with large datasets, ensuring high-quality, reliable, and timely data delivery. - Optimize and troubleshoot data...

  • GCP Data Engineer

    2 months ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning...

  • SAP Data Engineer

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    What Youll Be Doing: - Data Pipelines: Design and maintain scalable pipelines with SAP tools (e.g., SAP HANA, SAP BW/4HANA) to ensure seamless data integration and transformation. - Data Architecture: Collaborate with architects to develop robust, business-aligned solutions. - Cloud Integration: Enable smooth data flow by integrating SAP data with platforms...

  • SAP Data Engineer

    2 months ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    As a SAP Data Engineer in a consulting team, youll drive impactful data solutions for clients in banking, insurance, investment, media, and tech. This urgent, hands-on role requires a high level of technical proficiency to design, manage, and optimize complex data systems using SAP and related technologies. Key Duties and Responsibilities: - Data...

  • Data Engineer SAP

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    A well-known company is on the lookout for a SAP Data Engineer to join their innovative team! This company drives innovation and excellence in data management and digital transformation. Their team is dedicated to harnessing the power of SAP technologies to deliver cutting-edge data solutions that support our dynamic business needs and empower our...

  • AWS Data Engineer

    3 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 4+ years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • Senior Data Engineer

    2 months ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    We are looking for a Senior Data Engineer to support and manage BI analytics solutions. In this role, you should have a background in data and business intelligence. You should be analytical; an excellent communicator and a problem-solving aptitude is needed in this role. Ultimately, you will enhance our business intelligence systems to help us make better...

  • Mid Data Engineer

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Responsibilities: - Data Reporting: Design and maintain insightful reports to support key business decisions. - Pipeline Development: Build and optimise scalable data pipelines for enhanced data accessibility. - Collaboration: Work closely with cross-functional teams to understand and deliver technical solutions. - Process Optimisation: Start with Excel and...

  • Senior Data Engineer

    1 month ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Key Responsibilities: - Automate workflows and optimise data delivery. - Build and maintain efficient CI/CD processes. - Design large, complex data sets for business needs. - Maintain data quality, governance, and infrastructure. Tech Stack: - Python, PySpark, Palantir/Palantir Foundry - SQL, AWS, Airflow, Docker, Terraform Requirements: - BSc in...

  • Data Engineer

    1 month ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    Are you an experienced Data Engineer with a passion for building robust data pipelines and centralizing data warehouses? Do you thrive in dynamic environments and love working with cutting-edge technologies? If so, we want YOU to join our innovative team! Key Responsibilities: - 5+ years experience in BI Data Engineer role or similar - Write efficient and...

  • SAP Data Engineer

    4 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    The company helps organizations improve efficiency, drive digital transformation, and foster innovation across various industries. With a global presence, it is known for its customer-focused approach and expertise in using technology to address complex business challenges. Responsible for designing, developing, and maintaining data solutions that integrate...

  • SAP Data Engineer

    3 weeks ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    The company helps organizations improve efficiency, drive digital transformation, and foster innovation across various industries. With a global presence, it is known for its customer-focused approach and expertise in using technology to address complex business challenges. Responsible for designing, developing, and maintaining data solutions that integrate...


  • Cape Town City Centre, South Africa Jobted ZA C2 Full time

    About the role To provide direction and lead a data warehouse team responsible for the full product lifecycle of the software components in the central warehouse, to ensure successful delivery of the required functionality and maintenance related tasks within the Bank Data Operations. Oversee the ongoing drive to increase efficiency, optimisation, innovation...

  • Data Engineer/Analyst

    2 months ago


    Cape Town City Centre, South Africa Jobted ZA C2 Full time

    - Degree in IT or Supply Chain/Logistics - 4 years in Data Engineering role - Ideally experience within a product-led environment, retail, ecommerce or Supply Chain background ideally - Data Analysis, Data Gathering - Google Big Query - Google Data/Looker - Automation experience - MS Office, Google Sheets, Docs and Slides


  • Cape Town City Centre, South Africa Jobted ZA C2 Full time

    We are seeking a highly skilled Data Support Engineer to join our team in a fully remote capacity. This role requires proficiency in SQL, UNIX, PHP, HTML, and Java, with a focus on ensuring the smooth operation and support of data systems. Key Responsibilities: - Provide technical support for data systems, ensuring optimal performance. - Troubleshoot and...


  • Cape Town, Western Cape, South Africa Dimension Data Full time

    Job DescriptionWe are seeking a highly skilled network engineer to join our team at Dimension Data. As a network engineer, you will be responsible for designing, implementing and supporting new IT projects in modern networks, security solutions and cloud technologies.The ideal candidate will have at least 2 years' experience in networking field and possess...

  • Data Architect

    4 weeks ago


    Cape Town, Western Cape, South Africa Dimension Data Full time

    Are you a skilled Data Engineer looking to take your career to the next level?We're seeking an experienced Data Architect to join our team at Dimension Data!About the Role:We're looking for a highly skilled Data Architect to design and build the data architecture of our products. As a key member of our team, you will use your technical knowledge to help us...