Data Engineer
5 days ago
Our client is seeking a hands‑on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end‑to‑end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights. ESSENTIAL SKILLS Expertise with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and SQL Strong programming skills in Python for data processing Experience with cloud data platforms (Azure) and their Databricks offerings; familiarity with object storage (ADLS) Proficient in building and maintaining ETL / ELT pipelines, data modeling, and performance optimization Knowledge of data governance, data quality, and data lineage concepts Experience with CI / CD for data pipelines, and orchestration tools (GitHub Actions, Asset Bundles or Databricks jobs) Strong problem‑solving skills, attention to detail, and ability to work in a collaborative, cross‑functional team ADVANTAGEOUS SKILLS Experience with streaming data (Structured Streaming, Kafka, Delta Live Tables). Familiarity with materialized views, streaming tables, data catalogs and metadata management. Knowledge of data visualization and BI tools (Splunk, Power BI, Grafana). Experience with data security frameworks and compliance standards relevant to the industry. Certifications in Databricks or cloud provider platforms. QUALIFICATIONS / EXPERIENCE Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field. 3+ years of hands‑on data engineering experience. Key Responsibilities Design, develop, test, and maintain robust data pipelines and ETL / ELT processes on Databricks (Delta Lake, Spark, SQL, Python / Scala / SQL notebooks) Architect scalable data models and data vault / dimensional schemas to support reporting, BI, and advanced analytics Implement data quality, lineage, and governance practices; monitor data quality metrics and resolve data issues proactively Collaborate with Data Platform Engineers to optimize cluster configuration, performance tuning, and cost management in cloud environments (Azure Databricks) Build and maintain data ingestion from multiple sources (RDBMS, SaaS apps, files, streaming queues) using modern data engineering patterns (CDC, event‑driven pipelines, change streams, Lakeflow Declarative Pipelines) Ensure data security and compliance (encryption, access controls) in all data pipelines Develop and maintain CI / CD pipelines for data workflows; implement versioning, testing, and automated deployments #J-18808-Ljbffr
-
Data Engineer
1 week ago
Midrand, South Africa Jordan HR Full timeOur client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights.ESSENTIAL...
-
Data Engineer
1 week ago
Midrand, South Africa Jordan HR Full timeOur client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights.ESSENTIAL...
-
Data Engineer
7 days ago
Midrand, Gauteng, South Africa JorDan HR Full time R140 000 - R200 000 per yearData Engineer Location: Gauteng Contract duration: 01 January December 2028Our client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics,...
-
Data Engineer
2 days ago
Midrand, Gauteng, South Africa Decision Inc. Full time R450 000 - R750 000 per yearWe are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...
-
Data Engineer
1 day ago
Midrand, Gauteng, South Africa Decision Inc Full time R900 000 - R1 200 000 per yearWe are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...
-
Data Engineer
5 days ago
Midrand, South Africa Jordan HR Full timeA recruitment agency is seeking a hands-on Data Engineer in South Africa. The position demands strong expertise in Databricks and Python for building scalable data pipelines and analytics solutions. Responsibilities include designing and maintaining ETL processes, ensuring data security, and collaborating with different stakeholders. A Bachelor's or Master's...
-
Data Engineer Midrand
5 days ago
Midrand, South Africa Cruze Control Technologies Full timeAWS Data Engineer The AWS Data Engineer will be responsible for building and maintaining Big Data Pipelines using Data Platforms and must ensure that data is shared in line with the information classification requirements on a need-to-know basis. Duties & Responsibilities Exceptional analytical skills analyzing large and complex data sets. Perform thorough...
-
Data Engineer
2 days ago
Midrand, South Africa Decision Inc Full timeWe are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...
-
Data Engineer Midrand
5 days ago
Midrand, South Africa Liyema Consulting Full timeJob Description Reference: JHB -KK-1 Join our team as a Data Engineer! We're on the lookout for someone savvy with Terraform, Python, SQL, and more. Dive into Big Data Pipelines, ETL magic, and cloud platforms. Bring your knack for collaboration tools and sprinkle some AWS flair. If you're ready to wrangle data and have a blast doing it, this gig's for you!...
-
AWS Data Engineer Market related
5 days ago
Midrand, South Africa Cruze Control Technologies Full timeAWS Data Engineer The AWS Data Engineer will be responsible for building and maintaining Big Data Pipelines using Data Platforms and must ensure that data is shared in line with the information classification requirements on a need-to-know basis. Duties & Responsibilities Exceptional analytical skills analyzing large and complex data sets. Perform thorough...
