Current jobs related to Senior Data Engineer - Pretoria, Gauteng - 7087caea-55c1-4426-b223-f722720d8411

  • Senior Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Contrast Technologies South Africa Full time R500 000 - R1 000 000 per year

    Company DescriptionContrast Technologies South Africa is a leading ICT agency specializing in innovative technology solutions for businesses. Our offerings include IT consulting, software development, cybersecurity, cloud computing, and data management, all tailored to optimize operations and support business growth. With a highly skilled team focused on...

  • Senior Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Mediro ICT Full time R1 200 000 - R2 400 000 per year

    To define business processes and value chains relevant to FinSurv (responsible for overseeing South Africa's exchange control regulations)Identify, optimise, and integrate business processes, value streams and operating modelsInterpret and implement industry process standards and frameworks (e.g., APQC, Togaf)Analysis, design, and development of business...

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa 7087caea-55c1-4426-b223-f722720d8411 Full time R120 000 - R180 000 per year

    Work with stakeholders to gather and translate requirements into actionable technical tasks.Define project scope and align business and technical teams.Design data pipelines, propose AI solutions, and support development cycles.Facilitate collaboration between business, engineering teas, and EDE team.Develop and maintain high-quality, efficient...

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Interfront SOC Ltd. Full time R500 000 - R1 200 000 per year

    Key Responsibilities:Data Engineering & Pipeline ManagementDesign, build, and optimize T-SQL stored procedures, functions, and scripts for high-volume data processing and ECM scoring.Develop, deploy, and monitor end-to-end ETL/ELT workflows (e.g., SQL Server Agent, SSIS, Azure Data Factory, or Airflow) with checkpoint/rollback, job tracking, and recovery...

  • Senior Data Scientist

    1 day ago

    Pretoria, Gauteng, South Africa X, bigly labs Full time R1 300 000 - R2 500 000 per year

    We are X, bigly labs, Dis-Chem's high-performance innovation hub; a place where bold ideas meet data, design, and radical customer focus to reimagine what healthcare can be.Our mission is to power the future of healthcare by lowering costs, unlocking new possibilities, and improving access to healthcare for all South Africans. We do this through cutting-edge...

  • Data Engineer

    3 days ago

    Pretoria, Gauteng, South Africa Boardroom Appointments Full time R600 000 - R1 200 000 per year

    This roles responsibility is to design, develop and maintain data-based solutions including ensuring that the operationalization of data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints.The Data Engineer will build and maintain secure and compliant data processing...

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Interfront Full time R800 000 - R1 200 000 per year

    Job Reference Number: Recruit198-199Department: TaxBusiness Unit:Industry: Information TechnologyJob Type: ContractPositions Available: 2Salary: Market RelatedPerform data cleansing, preparation & analysis to support business intelligence & machine learning. Design, build & maintain robust data pipelines, feature stores & scheduled workflows that power the...

  • Data Engineer

    3 days ago

    Pretoria, Gauteng, South Africa Boardroom Appointments Full time R600 000 - R1 200 000 per year

    REQUIRED MINIMUM EDUCATION/TRAINING:BCom or Bachelors degree in Information Technology / Computer Science / Engineering (IT) or similarData Engineering tools (Azure Data Engineer) certification will be an added advantageITIL or COBIT certification will be an added advantageREQUIRED MINIMUM WORK EXPERIENCE:2 - 4 years of working experience in an IT...

  • Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa Mediro ICT Full time R900 000 - R1 200 000 per year

    Design, develop, and maintain scalable data pipelines to ingest, process, and store structured and unstructured data from multiple sources.Develop ETL/ELT processes to transform raw data into clean, analysable formats for reporting, analytics and dashboards.Work with cloud data platformsEnsure data security and complianceIntegrate and consolidate data from...

  • Data Engineer

    7 days ago

    Pretoria, Gauteng, South Africa JorDan HR Full time R400 000 - R600 000 per year

    DATA ENGINEERLocation: GautengContract Type: 01 January December 2028 One of our clients in IT is looking to hire a Data Engineer to join their team.ESSENTIAL SKILLS Strong data engineering skills, including Python coding and data ingestion (ELT, Kafka, Apahe Spark)Familiarity with AI/ML frameworks (e.g Langchain, Langgraph, GAIA) and their integration into...

Senior Data Engineer

2 weeks ago

Pretoria, Gauteng, South Africa 7087caea-55c1-4426-b223-f722720d8411 Full time R1 200 000 - R2 400 000 per year

Advanced SQL Server Development: Strong proficiency in T-SQL, stored procedure design, query optimisation, indexing, and error handling.

ETL and Data Warehousing: Expertise in ETL/ELT pipeline design and orchestration for batch and near real-time processing using SQL Server Agent, SSIS, or Azure Data Factory.

Data Modelling: Solid understanding of normalised and dimensional modelling (3NF, star, snowflake) and scalable architecture design.

Feature Store Development: Ability to design and maintain reusable feature tables supporting machine learning and operational scoring.

Data Validation and Quality Assurance: Skilled in implementing validation rules, reconciliation checks, and QA frameworks to ensure data integrity.

Data Governance and Security: Strong knowledge of data governance, privacy, and compliance standards; experience maintaining data lineage documentation.

Workflow Orchestration: Experience building restartable, traceable workflows with checkpoint and rollback mechanisms.

Programming and Scripting: Proficiency in SQL and beneficial experience in Python or R for automation and data manipulation.

Cloud Platforms: Familiarity with Azure (preferred) or other cloud platforms such as AWS or GCP for data engineering workloads.

Version Control and CI/CD: Exposure to Git and CI/CD pipelines for managing data workflow deployment.

Visualisation and Reporting (Beneficial): Ability to prepare scored or curated data for BI tools such as Power BI.

Performance Optimisation: Expertise in performance tuning, query profiling, and indexing strategies to optimise large-scale data operations.

Collaboration and Communication: Ability to work effectively across technical and business teams, translating complex requirements into practical data solutions.

Education:

A tertiary qualification in Computer Science, Information Systems, Data Engineering, Analytics, Mathematics, or Statistics or Matric with 6-8 years of experience in data engineering, database development, or data management in production environments.

Proven hands-on experience with SQL Server, including advanced T-SQL development, ETL/ELT workflow design, and performance tuning.

Demonstrated delivery of production data solutions—both batch and near real-time—within enterprise environments.

Experience in building and maintaining data warehouses, feature stores, and reusable data products.

Track record of implementing data governance and quality frameworks, ensuring compliance and traceability.

Experience in orchestrating complex data pipelines using SQL Server Agent, SSIS, Airflow, or Azure Data Factory.

Familiarity with cloud-based data architectures (Azure preferred) and version control systems (Git).

Exposure to Power BI or equivalent visualisation tools for reporting and analytics enablement.

Strong understanding of data security, privacy, and regulatory compliance requirements.

Knowledge:

Data Engineering & Pipeline Management:

Design, build, and optimise T-SQL stored procedures, functions, and scripts for high-volume data processing and ECM scoring.

Develop, deploy, and monitor end-to-end ETL/ELT workflows (e.g., SQL Server Agent, SSIS, Azure Data Factory, or Airflow) with checkpoint/rollback, job

tracking, and recovery capabilities.

Perform data cleansing, preparation, and transformation to support business intelligence and machine learning workflows.

Engineer and maintain reusable feature store tables (per entity/tax type) for ML models and operational scoring.

Model and maintain data warehouse structures (3NF, dimensional/star/snowflake), ensuring proper documentation of data lineage.

Prepare and deliver curated, scored datasets for downstream consumption in Power BI dashboards and analytics environments.

Develop and maintain audit, telemetry, and job tracking tables to ensure data reliability, restart ability, and monitoring visibility.

Support and troubleshoot production pipelines, optimising query performance via indexing, tuning, and profiling tools.

Data Quality, Governance, and Compliance:

Implement and monitor data validation, reconciliation, and QA frameworks across the data lifecycle.

Enforce data security, privacy, and compliance controls in line with corporate and regulatory standards.

Support the implementation of data governance and lineage documentation, ensuring traceability and adherence to EDM policies.

Collaboration and Cross-functional Support:

Collaborate with data analysts, data scientists, software engineers, and business stakeholders to translate business problems into scalable data solutions.

Provide accessible, well-documented datasets to support analytics and reporting.

Contribute to all phases of the SDLC, including requirements, design, development, testing, deployment, and maintenance.

Between 3 - 5 Years