Data Engineer
3 weeks ago
•Data Pipeline Development: o Building efficient ETL/ELT pipelines using Databricks and Delta Lake for structured, semi structured, and unstructured data. o Transforming raw data into consumable datasets for analytics and machine learning. •Data Optimization: o Improving performance by implementing best practices like partitioning, caching, and Delta Lake optimizations. o Resolving bottlenecks and ensuring scalability. •Data Integration: o Integrating data from various sources such as APIs, databases, and cloud storage systems (e.g., AWS S3, Azure Data Lake). •Real-Time Streaming: o Designing and deploying real-time data streaming solutions using Databricks Structured Streaming. •Data Quality and Governance: o Implementing data validation, schema enforcement, and monitoring to ensure high-quality data delivery. o Using Unity CatLog to manage metadata, access permissions, and data lineage. ••Collaboration and Documentation: o Collaborating with data analysts, data scientists, and other stakeholders to meet business needs. o Documenting pipelines, workflows, and technical solutions. 3. Deliverables •Fully functional and documented data pipelines. ••Optimized and scalable data workflows on Databricks. •Real-time streaming solutions integrated with downstream systems. •Detailed documentation for implemented solutions and best practices.
-
Data Engineer
4 weeks ago
Centurion, Gauteng, South Africa Plus1X Solutions (Pty) Ltd Full timeJob Title: Data Engineer - Data ArchitectAbout Plus1X Solutions (Pty) LtdAt Plus1X Solutions (Pty) Ltd, we are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will play a critical role in designing and implementing secure and compliant data processing pipelines using various tools and...
-
Data Engineering Specialist
3 weeks ago
Centurion, Gauteng, South Africa AICA Consultancy Full timeData Engineer Role at AICA ConsultancyWe are seeking an experienced Data Engineer to join our team at AICA Consultancy. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.
-
Data Systems Engineer
1 day ago
Centurion, Gauteng, South Africa E&D Recruiters Full timeJob Title: Data Systems EngineerCompany OverviewE&D Recruiters is a leading recruitment agency specializing in the automotive and electronics sectors.About the RoleWe are seeking an experienced Data Systems Engineer to lead our telematics systems development team. As a key member of our team, you will be responsible for designing, implementing, and...
-
Data Insights Engineer
6 days ago
Centurion, Gauteng, South Africa MPRTC Full timeAbout the RoleMPRTC seeks a seasoned Data Insights Engineer to lead our data analysis efforts. This is an exciting opportunity for a skilled professional to drive business growth through data-driven insights.Key Responsibilities:Analyzing complex data sets to identify trends and patternsDeveloping and maintaining relational databases to ensure data...
-
Snr Specialist: Data Engineering
6 months ago
Centurion, South Africa BCXP Full timeBusiness unit, Department, Reporting Business Unit DPS, Business and Digital Advisory Department Data Insights and Intelligence Job grade S4 Core Description Responsible for supporting the delivery of data science projects and solutions by leveraging your data and software engineering experience. Will be required to lead a small team of engineers through...
-
Data Engineering Expert
4 days ago
Centurion, Gauteng, South Africa Open Source (Pty) Ltd Full timeJob OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Open Source (Pty) Ltd. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Key ResponsibilitiesData Pipeline Development: Design and build end-to-end data pipelines using ETL/ELT frameworks...
-
Data Center Engineer
1 day ago
Centurion, Gauteng, South Africa Alinta Tech Solutions Full timeAbout the RoleWe are seeking a skilled Data Center Engineer to join our team at Alinta Tech Solutions. As a key member of our data center operations team, you will be responsible for ensuring the smooth operation of our data centers, including maintenance, upgrades, and repairs.The ideal candidate will have 3-5 years of experience in data center operations,...
-
Chief Data Engineering Lead
1 month ago
Centurion, Gauteng, South Africa Network Recruitment Full timeOverview: Network Recruitment seeks an experienced Chief Data Engineering Lead to join our team. This role requires a strong technical background and the ability to lead complex data architecture projects.Salary: $150,000 - $200,000 per annum, depending on experience.About the Role: As Chief Data Engineering Lead, you will be responsible for designing and...
-
Data Science and Engineering Professional
4 weeks ago
Centurion, Gauteng, South Africa MPRTC Full timeJob OverviewInnovative data-driven solutions are in high demand across various industries. At MPRTC, we seek a highly skilled Data Science and Engineering Professional to spearhead our analytics initiatives. This role requires a seasoned professional with expertise in SQL, Python, or R programming, as well as experience in relational database design and...
-
Data Protection Engineer
1 month ago
Centurion, Gauteng, South Africa BCXP Full timeJob Title: Data Protection Engineer - IT SupportAbout BCXPBCXP is a leading organization in the field of information technology, providing innovative solutions to businesses across the globe. Our team of experts is dedicated to delivering high-quality services that meet the evolving needs of our clients.Estimated Salary: $80,000 - $110,000 per annumJob...
-
Data Engnieer
6 months ago
Centurion, South Africa Plus1X Solutions (Pty) Ltd Full time+Onex is hiring a Data Engineer to build and maintain secure and compliant data processing pipelines by using different tools and techniques and maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis. This includes data store design using different architecture patterns based on business...
-
Data Architect for Secure Data Solutions
4 weeks ago
Centurion, Gauteng, South Africa Plus1X Solutions (Pty) Ltd Full timeJob Description:We are seeking a skilled Data Engineer to design and develop secure data processing pipelines using various tools and techniques.Key Responsibilities:Develop and maintain data services and frameworks to store and produce cleansed and enhanced datasets for analysisDesign data stores using different architecture patterns based on business...
-
Data Engnieer
7 months ago
Centurion, South Africa Plus1X Solutions (Pty) Ltd Full time+Onex is hiring a Data Engineer to build and maintain secure and compliant data processing pipelines by using different tools and techniques and maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis. This includes data store design using different architecture patterns based on business...
-
Snr Specialist: Data Engineering
6 months ago
Centurion, South Africa BCXP Full timeBusiness unit, Department, Reporting Business Unit DPS, Business and Digital Advisory Department Data Insights and Intelligence Job grade S4 Experience with Linux, Python 3, SQL, JavaScript, and tools in our stack including Docker, Kubernetes, Kubeflow, MLflow PyTorch, XGBoost, Scikit-learn, Keras, TensorFlow, Dask, Flask, Django, FastAPI, Vertex AI, GKE,...
-
Senior Data and Vehicle Support Engineer
2 months ago
Centurion, South Africa Jobted ZA C2 Full timeSenior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: - BEng or MEng (Electronic or Mechatronic Engineering) - Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. - Proficient in interpreting vehicle log data to support data analysis...
-
Senior Data and Vehicle Support Engineer
2 months ago
Centurion, South Africa E&D Recruiters Full timeSenior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. Proficient in interpreting vehicle log data to support data analysis relevant to...
-
Software Engineering Professional
1 month ago
Centurion, Gauteng, South Africa Dimension Data Full timeJob DescriptionThe successful candidate will be responsible for designing and developing web-based systems for the motor industry.Key ResponsibilitiesProficiency with HTML 4/5, JavaScript, and .NET C# (MVC, WebAPI) is required.Experience with DPHP (OOP), RESTful Services, and Ionic is highly valued.Strong understanding of MsSQL and MySQL is essential.About...
-
Senior Data and Vehicle Support Engineer
3 weeks ago
Centurion, South Africa E&D Recruiters Full timeSenior Data and Vehicle Support Engineer (Telematics)ÂCenturionÂMinimum requirements and experience:BEng or MEng (Electronic or Mechatronic Engineering)Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards.Proficient in interpreting vehicle log data to support data analysis relevant to...
-
Data Scientist
1 month ago
Centurion, Gauteng, South Africa Plus1X Solutions (Pty) Ltd Full timeAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Plus1X Solutions (Pty) Ltd.Main Responsibilities:Design and implement secure and compliant data processing pipelines using various tools and techniques.Maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis.Collaborate with...
-
Senior Data and Vehicle Support Engineer
2 months ago
Centurion, South Africa E&D Recruiters Full timeSenior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience:BEng or MEng (Electronic or Mechatronic Engineering)Minimum of 5 years working experience in telematics systems and -components including data management and data dashboards.Proficient in interpreting vehicle log data to support data analysis relevant to...