Data Engineer Specialist
4 days ago
We are seeking a highly skilled Data Engineer Specialist to join our team at Eqplus Technologies (Pty) Ltd. In this role, you will be responsible for designing and implementing ETL/ELT methodologies and technologies to maintain our data warehouse. You will also provide maintenance and support to our ETL and ML environments.
Duties & Responsibilities
- Design and develop various functionalities in AWS for the project flow.
- Develop and maintain automated ETL pipelines using scripting languages such as Python, SQL, and AWS services like S3, Glue, Lambda, SNS, Redshift, SQS, KMS.
- Create Glue Jobs for batch data processing and set up Glue Catalog for metadata synchronization.
- Develop data pipelines using AWS Lambda and Step Functions for data processing.
- Manage data coming from different sources.
- Experience with AWS services to manage applications in the cloud and create or modify instances.
- Implement solutions using the Scaled Agile Framework (SAFe).
- Be involved in the performance and optimization of existing algorithms in Hadoop using Spark Context.
- Create Hive Tables, load data, and write Hive queries.
Requirements
- Degree in Information Technology.
- 6-7 years of experience in a similar role.
- Experience with Talend.
- Knowledge of SSIS, SSAS, and SSRS.
- Experience with Clover ETL.
- Strong SQL background.
- Experience with AWS.
- Familiarity with Jupyter Notebook.
- Experience in Data Warehousing.
- Experience in Cloud Warehousing.
-
Data Engineer Specialist
7 days ago
Johannesburg, Gauteng, South Africa Nedbank Full timeWe are seeking an experienced Data Engineer Specialist to join our team at Nedbank. The successful candidate will be responsible for designing, building, and maintaining scalable data infrastructure using various technologies.Key Responsibilities:Maintain and improve data quality in operational and analytics databases.Design and implement data pipelines for...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeAn industry requiring specialist skills, deserves specialist recruitment. I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority. This will allow me to enhance your current skills within the FMCG, Manufacturing...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob & Company Description An industry requiring specialist skills, deserves specialist recruitment.I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority.This will allow me to enhance your current skills...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business. Key Responsibilities: Implement...
-
Cloud Data Engineering Specialist
8 hours ago
Johannesburg, Gauteng, South Africa PRR Recruitment Full timeAt PRR Recruitment, we are seeking an experienced Cloud Data Engineering Specialist to develop innovative data products and pipelines in cloud environments. This role is ideal for individuals with expertise in designing and implementing data models, as well as utilizing tools like Python, Dbt, and Apache Airflow to drive business insights.Key...
-
AWS Data Engineering Specialist
7 days ago
Johannesburg, Gauteng, South Africa E-Merge Full timeWe are seeking a highly skilled AWS Data Engineering Specialist to join our team at E-Merge. In this role, you will be responsible for designing, building, and maintaining Big Data pipelines using AWS services.About the RoleThe ideal candidate will have experience working with cloud-based data engineering tools and technologies, including AWS EMR, Redshift,...
-
Data Specialist Position
7 days ago
Johannesburg, Gauteng, South Africa Xcede Group Full timeData Specialist PositionXcede Group is a leading provider of data solutions, and we are seeking an experienced Data Specialist to join our team.The purpose of this role is to ensure that the necessary data is properly stored on the cloud platform and is available to the data scientists. This requires strong skills in database engineering, software...
-
Data Engineer Specialist
6 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob Description:We are seeking a highly skilled and experienced Data Engineer to develop and maintain scalable, secure, and repeatable data pipelines. Key responsibilities include implementing and maintaining scalable data pipelines, ensuring data quality and accuracy for reporting and analysis, and developing prototypes and solutions for data science...
-
Data Analyst
8 hours ago
Johannesburg, Gauteng, South Africa Data Bene Full timeA vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...
-
Data Specialist
12 hours ago
Johannesburg, Gauteng, South Africa Network Recruitment Full time**About Network Recruitment**We are a specialist recruitment agency with a passion for connecting talented professionals with top clients in Gauteng. Our team of expert recruiters understand the importance of finding the right candidate for the job, which is why we take the time to get to know our candidates and match them with opportunities that align with...
-
Data Insights Analyst
5 hours ago
Johannesburg, Gauteng, South Africa Data Bene Full timeAbout the RoleThe Data Analyst will play a crucial role in driving business growth by providing insights and recommendations based on data analysis.Key Responsibilities include:Collecting, organizing, analyzing, and disseminating information to support business decision-makingResolving data queries, report writing, and presenting findings to...
-
Data Engineering Specialist
7 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full time**Job Summary:**We are seeking an experienced Data Engineer to design, develop, and implement efficient data pipelines using Python, SQL, and cloud-based technologies.About the Job:This is a key role within our organization, requiring a highly skilled professional who can work independently and collaboratively to deliver high-quality results.Bachelor's...
-
Data Engineering Specialist
7 days ago
Johannesburg, Gauteng, South Africa Blue Bean Software Full timeCompany OverviewBlue Bean Software is a leading custom software and product development company that partners with both large enterprises and dynamic start-ups to solve their most complex challenges. With a flat organisational structure, we empower every team member to make an impact and deliver exceptional customer service.Job DescriptionWe are seeking...
-
Data Science Expert
7 days ago
Johannesburg, Gauteng, South Africa Data Bene Full timeJob DescriptionWe are seeking a highly skilled Data Analyst to join our team at Data Bene. As a key member of our organization, you will play a vital role in collecting, analyzing, and interpreting data sets to inform business decisions.Your primary focus will be on ensuring the accuracy and quality of data, while also developing ad hoc analyses from start...
-
Data Science Engineer
7 days ago
Johannesburg, Gauteng, South Africa Muse Consultancy Services Full timeMUSE Consultancy Services is a specialist consultancy that provides expert advice on software development, resourcing, and recruitment. We are dedicated to delivering high-quality software solutions that meet our clients' needs.Our team of experienced developers and consultants work closely with leading companies in South Africa to design and implement...
-
Analytical Data Solutions Provider
5 hours ago
Johannesburg, Gauteng, South Africa Data Bene Full timeAbout the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...
-
Data Protection Lead/Manager
2 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeKey Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...
-
Data Science and Analytics Manager
1 day ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeInherent RequirementsAt least 10 years of hands-on involvement in data science projects, including managing large-scale initiatives and leading multidisciplinary teams.Degree (Honours, Masters or PHD) in quantitative fields such as Actuarial Science, Statistics, Computer Science, Engineering, Mathematics and/or combination of these.Proven expertise in data...
-
Data Engineer
7 days ago
Johannesburg, Gauteng, South Africa Promapp Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team. As a key member of our engineering department, you will be responsible for designing and implementing high-quality data engineering solutions that meet the needs of our organization.As a senior member of our team, you will demonstrate technical excellence and provide guidance and...
-
GCP Data Engineering Specialist
9 hours ago
Johannesburg, Gauteng, South Africa Nagarro Full timeAbout NagarroWe are a Digital Product Engineering company that is scaling rapidly. Our people exist everywhere in the world (18000+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical.About the RoleWe are looking for a highly skilled Data Engineer to join our team.You will be responsible for designing, developing, and...