Data Engineer
1 week ago
Location: Gauteng
Contract duration: 01 January December 2028
Our client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights.
ESSENTIAL SKILLS:
- Expertise with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and SQL
- Strong programming skills in Python for data processing
- Experience with cloud data platforms (Azure) and their Databricks offerings; familiarity with object storage (ADLS)
- Proficient in building and maintaining ETL/ELT pipelines, data modeling, and performance optimization
- Knowledge of data governance, data quality, and data lineage concepts
- Experience with CI/CD for data pipelines, and orchestration tools (GitHub Actions, Asset Bundles or Databricks' jobs)
- Strong problem-solving skills, attention to detail, and ability to work in a collaborative, cross-functional team
- Experience with streaming data (Structured Streaming, Kafka, Delta Live Tables).
- Familiarity with materialized views, streaming tables, data catalogs and metadata management.
- Knowledge of data visualization and BI tools (Splunk, Power BI, Grafana).
- Experience with data security frameworks and compliance standards relevant to the industry.
- Certifications in Databricks or cloud provider platforms.
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
3+ years of hands-on data engineering experience.
Key Responsibilities:
- Design, develop, test, and maintain robust data pipelines and ETL/ELT processes on Databricks (Delta Lake, Spark, SQL, Python/Scala/SQL notebooks)
- Architect scalable data models and data vault/ dimensional schemas to support reporting, BI, and advanced analytics
- Implement data quality, lineage, and governance practices; monitor data quality metrics and resolve data issues proactively
- Collaborate with Data Platform Engineers to optimize cluster configuration, performance tuning, and cost management in cloud environments (Azure Databricks)
- Build and maintain data ingestion from multiple sources (RDBMS, SaaS apps, files, streaming queues) using modern data engineering patterns (CDC, event-driven pipelines, change streams, Lakeflow Declarative Pipelines)
- Ensure data security and compliance (encryption, access controls) in all data pipelines
- Develop and maintain CI/CD pipelines for data workflows; implement versioning, testing, and automated deployments
-
Data Engineer
1 day ago
Midrand, Gauteng, South Africa Decision Full time R750 000 - R1 800 000 per yearJob Description: We are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability...
-
Data Engineer
3 days ago
Midrand, Gauteng, South Africa Decision Inc Full time R900 000 - R1 200 000 per yearWe are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...
-
Data Engineer
3 days ago
Midrand, Gauteng, South Africa Decision Inc. Full time R450 000 - R750 000 per yearWe are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...
-
Data Officer
7 days ago
Midrand, Gauteng, South Africa Sanlam Group Full time R1 200 000 - R1 800 000 per yearWho are we?MiWay is a direct financial services company. We are passionate about service excellence, convenience and offering our clients superior value products. Our Vision is to be a world-class direct financial services business that offers a complete array of services under one convenient umbrella - all managed online. We are positive that with the right...
-
Data Officer
7 days ago
Midrand, Gauteng, South Africa Sanlam Full time R1 200 000 - R2 400 000 per yearWho are we?MiWay is a direct financial services company. We are passionate about service excellence, convenience and offering our clients superior value products. Our Vision is to be a world-class direct financial services business that offers a complete array of services under one convenient umbrella – all managed online. We are positive that with the...
-
Senior System Engineer
1 day ago
Midrand, Gauteng, South Africa Netstar Full timeWe are seeking a highly experienced Senior Systems Engineer to lead the design, integration, and evolution of Systems of Systems (SoS) within a fast-paced vehicle telematics environment. This role demands strategic thinking and technical expertise to architect and orchestrate complex, interconnected systems spanning vehicles, IoT devices, cloud services, and...
-
Data Architect
1 day ago
Midrand, Gauteng, South Africa PSG Konsult Full time R50 000 - R150 000 per yearDesignation:Data Architect | Midrand, Waterfall, Gauteng | PermanentCategory:Information TechnologyJob Level:Professionally qualified and experienced specialists and mid-managementPosted by:PSG Financial ServicesPosted on:04 Dec 2025Reference Number:POS02927Closing date:31-Dec-2025Position Type:PermanentLocation:Waterfall Magwa CrescentOverview:VACANCY |...
-
Strategic RAN Engineer
1 week ago
Midrand, Gauteng, South Africa Optimal Growth Technologies Full time R2 000 000 - R2 500 000 per yearAbout the job Strategic RAN Engineer Role title: Senior Specialist - Strategic RAN Engineering Contract : 6 months Location: MidrandRole purpose: This role is critical to support the end-to-end strategic planning process across the complete networkKey accountabilities and decision ownership Leading traffic impact studies to assess the effect of new services...
-
Microsoft AI Engineer
5 days ago
Midrand, Gauteng, South Africa SavageOne Pty Full time R1 200 000 - R2 400 000 per year*Onsite *SA Citizen only Job Summary:We are seeking a highly skilled and experienced Senior Microsoft AI Developer to join our dynamic team. The ideal candidate will have a strong background in developing and deploying AI solutions using Microsoft technologies. This role involves designing, developing, and implementing advanced AI models and systems to drive...
-
Strategic RAN Engineer
2 weeks ago
Midrand, Gauteng, South Africa Optimal Growth Technologies Full time R1 200 000 - R3 600 000 per yearRole title: Senior Specialist - Strategic RAN EngineeringContract : 6 monthsLocation: MidrandRole purpose:This role is critical to support the end-to-end strategic planning process across the complete networkKey Accountabilities And Decision OwnershipLeading traffic impact studies to assess the effect of new services on network infrastructure.Coordinating...