data engineer - databricks

Purpose of the PositionTo collect and validate business information (which can then be used by data scientists and business stakeholders). To design and implement data models and architectures that enable business stakeholders to gain insights from large-scale datasets. To design and develop ETL processes, pipelines, and data validation processes to ensure...

What you will be doing: - Design, prototype, build, deploy, and support production-grade Machine Learning, AI, and Generative AI solutions. - Productionise and monitor Machine Learning models and pipelines using Databricks, including MLflow and Model Serving. - Develop and deploy AI agents, Generative AI solutions, and Retrieval-Augmented Generation (RAG)...

Badger & Bird Talent is seeking a Forward Deployed Engineer (Cloud & Data) to join our remote-first team. You will embed with clients to build scalable microservices and secure multi-cloud infra across AWS, Azure, or GCP while delivering real-time data pipelines. Expect hands-on work with Kafka, Spark, Databricks, Snowflake, dbt, and container platforms...

This is a 12 - month contract with our client in the banking sector Job Purpose To design, prototype, and build next-generation analytic engines and services by applying strong expertise in Artificial Intelligence (AI) Purpose Build, deploy, scale and support machine learning, AI and GenAI solutions in production. The role focuses on operationalising...

This is a 12 - month contract with our client in the banking sector Job Purpose To design, prototype, and build next-generation analytic engines and services by applying strong expertise in Artificial Intelligence (AI) Purpose Build, deploy, scale and support machine learning, AI and GenAI solutions in production. The role focuses on operationalising...

Masters degree in Software Engineering, Data Engineering, Computer Science or related field5 years of relevant work experienceStrong Scala and Python backgroundExperience with Apache Spark and/or RayKnowledge of AWS, GCP, Azure, or other cloud platformKnowledge of current principles and frameworks for ML OpsExperience with ML Ops technologies such as ML...

Masters degree in Software Engineering, Data Engineering, Computer Science or related field5 years of relevant work experienceStrong Scala and Python backgroundExperience with Apache Spark and/or RayKnowledge of AWS, GCP, Azure, or other cloud platformKnowledge of current principles and frameworks for ML OpsExperience with ML Ops technologies such as ML...

The Focus Group in Sandton, South Africa, is seeking an experienced Data Engineer to architect, build and maintain robust, scalable data pipelines, ingesting and transforming data from diverse sources using Ab Initio, Python/Scala, Spark and Databricks within Azure and on‑premises environments.You will collaborate with security, governance and analytics...

Job Title – Senior Data Scientist (ML Engineer) Company – TCS (MEA) Location – Johannesburg, South Africa Job type – Full time About Us: Tata Consultancy Services (TCS) is an IT services, consulting and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 50...

Azure Data EngineerAre you a skilled Azure Data Engineer with a passion for innovation and cutting-edge technology? Our client is seeking a talented Azure Data Engineer to join their dynamic team at their Midrand/Menlyn location. As a global leader in the automotive industry, they are committed to shaping the future of mobility through innovative solutions...

Azure Data EngineerAre you a skilled Azure Data Engineer with a passion for innovation and cutting-edge technology? Our client is seeking a talented Azure Data Engineer to join their dynamic team at their Midrand/Menlyn location. As a global leader in the automotive industry, they are committed to shaping the future of mobility through innovative solutions...

Senior Data Fabric Data EngineerJohannesburg (Hybrid) - Midrand | Full-time, Permanent | Senior LevelAbout the OpportunityAn established data and analytics consulting environment is seeking a Senior Data Fabric Data Engineer to lead the design, build and delivery of modern, end-to-end data solutions across multiple client engagements. The role has a strong...

My client is looking for a Cloud Data Platform Support Engineer, based in South Africa, with a Remote work model. Requirements 3+ years experience in cloud support engineering, cloud operations, or data engineering. Strong hands-on experience with Microsoft Azure cloud data platforms (data warehouses, pipelines, distributed compute). Ability to...

JOB OPPORTUNITY: SENIOR – FRAUD & FORENSICS DATA ENGINEER Location: Johannesburg / Hybrid-3 days in the office Industry: Telecommunications / Fintech / Financial Services Contract: 6 Months independent contract-Senior We are looking for an experienced senior: Fraud & Forensics Data Engineer to join a leading organisation and deliver data engineering...

Data Quality Assurance Engineer (MUST BE AVAILABLE IMMEDIATELY) Data Quality Assurance Engineer | Azure, Databricks, Advanced SQL & PySpark About the role We're looking for a hands-on Data Quality Assurance Engineer to join the growing Data and Integration team at Inference Group at Embelo in Cape Town. You’ll make sure the data flowing through our...

Penta Consulting are a technology service provider and leading outsourced partner helping to deliver professional and managed solutions across EMEA. We are supporting a well esteemed client of ours searching for an experienced Data Engineer to play a key role in designing, developing, and maintaining data pipelines, data warehouses and scalable data models...

The Senior Data Scientist will be responsible for designing, developing, and optimizing machine learning, AI, and decisioning solutions that drive customer, risk, and operational outcomes across Personal and Private Banking (PPB) and Digital channels. This role involves applying advanced analytics, machine learning, and AI techniques to solve complex...

X, bigly labs is seeking an Intermediate Analytics Engineer to build silver and gold data models in Databricks, with certified metrics and auditable lineage. You’ll define metrics, maintain quality, and ensure consistent, trusted analytics across BI and AI consumers. The role involves shipping changes via Git, Git Hub Actions, and Databricks Asset...

Get AI-powered advice on this job and more exclusive features. As a frontier partner, we grow through great people, smart tech, and teamwork between humans and AI. Cloud Direct is looking for a full-time Data Engineer to focus on designing and building consistent, scalable data solutions across the business. The role involves developing and maintaining data...

We are looking for an AI Data Engineer – Migration to join a specialist data modernisation initiative, combining traditional Data Engineering with emerging AI and agentic technologies. The role will focus on using AI-assisted and agent-based solutions to support complex data migration and modernisation, including data discovery, schema mapping,...