Intermediate Senior Data Engineer

12 hours ago

Centurion, South Africa AICA Consultancy Full time

Overview We are looking for a Data Engineer who is certified in Databricks (required) to join our team. In this role you will be designing, developing, and optimizing scalable data pipelines and workflows on Databricks. The engineer will work closely with stakeholders to make certain data reliability, performance, and alignment with business requirements. Responsibilities Data Pipeline Development Building efficient ETL / ELT pipelines using Databricks and Delta Lake for structured, semi-structured, and unstructured data. Transforming raw data into consumable datasets for analytics and machine learning. Data Optimization Improving performance by implementing best practices like partitioning, caching, and Delta Lake optimizations. Resolving bottlenecks and ensuring scalability. Data Integration Integrating data from various sources such as APIs, databases, and cloud storage systems (e.g., AWS S3, Azure Data Lake). Real-Time Streaming Designing and deploying real-time data streaming solutions using Databricks Structured Streaming. Data Quality and Governance Implementing data validation, schema enforcement, and monitoring to ensure high-quality data delivery. Using Unity CatLog to manage metadata, access permissions, and data lineage. Collaboration and Documentation Collaborating with data analysts, data scientists, and other stakeholders to meet business needs. Documenting pipelines, workflows, and technical solutions. Responsibilities Fully functional and documented data pipelines. Optimized and scalable data workflows on Databricks. Real-time streaming solutions integrated with downstream systems. Detailed documentation for implemented solutions and best practices. Qualifications Proficiency in Databricks(certified), Spark, and Delta Lake. Strong experience with Python, SQL, and ETL / ELT development. Familiarity with real-time data processing and streaming. Knowledge of cloud platforms (e.g., AWS, Azure, GCP). Experience with data governance and tools like Unity CatLog. Assumptions Access to necessary datasets and cloud infrastructure will be provided. Timely input and feedback from stakeholders. Success Metrics Data pipelines deliver accurate and consistent data. Workflows meet performance benchmarks. Real-time streaming solutions operate with minimal latency. Stakeholders are satisfied with the quality and usability of the solutions. #J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Centurion, South Africa Datonomy Solutions Full time

    We are seeking a Senior Data Engineer to join our team based in Centurion. Onsite, contract.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platforms to support advanced analytics, BI, and data-driven decision-making. This individual brings strong technical experience, shows leadership in...

  • Senior Data Engineer

    2 weeks ago

    Centurion, South Africa Datonomy Solutions Full time

    We are seeking a Senior Data Engineer to join our team based in Centurion. Onsite, contract. The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platforms to support advanced analytics, BI, and data-driven decision-making. This individual brings strong technical experience, shows leadership in...

  • Senior Data Engineer

    2 weeks ago

    Centurion, South Africa Datonomy Solutions Full time

    We are seeking a Senior Data Engineer to join our team based in Centurion. Onsite, contract. The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platforms to support advanced analytics, BI, and data‑driven decision‑making. This individual brings strong technical experience, shows leadership...

  • Software Engineer – QA

    3 weeks ago

    Centurion, South Africa Hello Group Full time

    Software Engineer – QA (Intermediate Level) Join to apply for the Software Engineer – QA (Intermediate Level) role at Hello Group Company Overview Hello Group is a leading fintech committed to delivering innovative products that create impact and drive customer success. We thrive in fast‑paced, collaborative environments where ideas turn into solutions...

  • Intermediate - Senior Data Engineer (Databricks)

    1 week ago

    Centurion, South Africa AICA Consultancy Remote Work Freelance Full time R400 - R900

    We are looking for a Data Engineer who is certified in Databricks (required) to join our team. In this role you will be designing, developing, and optimizing scalable data pipelines and workflows on Databricks. The engineer will work closely with stakeholders to make certain data reliability, performance, and alignment with business requirements.   Scope of...

  • Senior Data Engineer

    3 weeks ago

    Centurion, South Africa Network1 Full time

    Overview Are you a seasoned Data Engineer and visionary professional ready to lead high-impact projects in a dynamic data-driven environment? We’re looking for a technically strong Senior Data Engineer to join our client and drive innovation across their data platforms. Our client specializes in intelligent mobility solutions, thriving on solving complex...

  • Senior Data Engineer at Datonomy Solutions

    2 days ago

    Centurion, South Africa Datonomy Solutions Full time

    Senior Data Engineer at Datonomy Solutions We are seeking a Senior Data Engineer to join our team based in Centurion. Onsite, contract. Role Requirements A degree or diploma in Computer Science, Information Systems, Engineering, or a related field. 4-7 years of hands‑on data engineering experience. Advanced proficiency in Python and SQL. Strong database...

  • Senior Transport Engineer Centurion

    6 days ago

    Centurion, South Africa Xcede Group Full time

    Senior Transport Engineer (PrEng) Our client, a large international engineering consulting firm, is currently looking to add a Senior Transport Engineer (PrEng) to their team. Responsibilities: Develop and design cutting-edge road and highway projects, ensuring compliance with industry standards and local regulations. Conduct thorough site evaluations,...

  • Senior Data Engineer

    2 weeks ago

    Centurion, Gauteng, South Africa Momentum Full time R600 000 - R1 200 000 per year

    Through our client-facing brands Metropolitan and Momentum, with Multiply (wellness and rewards programme), and our other specialist brands, including Guardrisk and Eris Property Group, the group enables business and people from all walks of life to achieve their financial goals and life aspirations. We help people grow their savings, protect what matters to...

  • Senior Data Engineer — AWS Data Platform

    2 days ago

    Centurion, South Africa Datonomy Solutions Full time

    A leading IT consulting firm is seeking a Senior Data Engineer to join their team in Centurion. This full-time position involves designing and maintaining complex data pipelines, optimizing data flows, and supporting cloud-based data architecture primarily in AWS. The ideal candidate should have strong proficiency in Python and SQL, alongside significant...