Data Engineer Specialist
3 days ago
We are seeking a highly skilled Data Engineer Specialist to join our team at Eqplus Technologies (Pty) Ltd. In this role, you will be responsible for designing and implementing ETL/ELT methodologies and technologies to maintain our data warehouse. You will also provide maintenance and support to our ETL and ML environments.
Duties & Responsibilities
- Design and develop various functionalities in AWS for the project flow.
- Develop and maintain automated ETL pipelines using scripting languages such as Python, SQL, and AWS services like S3, Glue, Lambda, SNS, Redshift, SQS, KMS.
- Create Glue Jobs for batch data processing and set up Glue Catalog for metadata synchronization.
- Develop data pipelines using AWS Lambda and Step Functions for data processing.
- Manage data coming from different sources.
- Experience with AWS services to manage applications in the cloud and create or modify instances.
- Implement solutions using the Scaled Agile Framework (SAFe).
- Be involved in the performance and optimization of existing algorithms in Hadoop using Spark Context.
- Create Hive Tables, load data, and write Hive queries.
Requirements
- Degree in Information Technology.
- 6-7 years of experience in a similar role.
- Experience with Talend.
- Knowledge of SSIS, SSAS, and SSRS.
- Experience with Clover ETL.
- Strong SQL background.
- Experience with AWS.
- Familiarity with Jupyter Notebook.
- Experience in Data Warehousing.
- Experience in Cloud Warehousing.
-
Data Engineer Specialist
6 days ago
Johannesburg, Gauteng, South Africa Nedbank Full timeWe are seeking an experienced Data Engineer Specialist to join our team at Nedbank. The successful candidate will be responsible for designing, building, and maintaining scalable data infrastructure using various technologies.Key Responsibilities:Maintain and improve data quality in operational and analytics databases.Design and implement data pipelines for...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeAn industry requiring specialist skills, deserves specialist recruitment. I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority. This will allow me to enhance your current skills within the FMCG, Manufacturing...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob & Company Description An industry requiring specialist skills, deserves specialist recruitment.I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opportunities within the market is my main priority.This will allow me to enhance your current skills...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business. Key Responsibilities: Implement...
-
AWS Data Engineering Specialist
6 days ago
Johannesburg, Gauteng, South Africa E-Merge Full timeWe are seeking a highly skilled AWS Data Engineering Specialist to join our team at E-Merge. In this role, you will be responsible for designing, building, and maintaining Big Data pipelines using AWS services.About the RoleThe ideal candidate will have experience working with cloud-based data engineering tools and technologies, including AWS EMR, Redshift,...
-
Data Specialist Position
6 days ago
Johannesburg, Gauteng, South Africa Xcede Group Full timeData Specialist PositionXcede Group is a leading provider of data solutions, and we are seeking an experienced Data Specialist to join our team.The purpose of this role is to ensure that the necessary data is properly stored on the cloud platform and is available to the data scientists. This requires strong skills in database engineering, software...
-
Data Engineer Specialist
5 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeJob Description:We are seeking a highly skilled and experienced Data Engineer to develop and maintain scalable, secure, and repeatable data pipelines. Key responsibilities include implementing and maintaining scalable data pipelines, ensuring data quality and accuracy for reporting and analysis, and developing prototypes and solutions for data science...
-
Data Engineering Specialist
6 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full time**Job Summary:**We are seeking an experienced Data Engineer to design, develop, and implement efficient data pipelines using Python, SQL, and cloud-based technologies.About the Job:This is a key role within our organization, requiring a highly skilled professional who can work independently and collaboratively to deliver high-quality results.Bachelor's...
-
Data Engineering Specialist
6 days ago
Johannesburg, Gauteng, South Africa Blue Bean Software Full timeCompany OverviewBlue Bean Software is a leading custom software and product development company that partners with both large enterprises and dynamic start-ups to solve their most complex challenges. With a flat organisational structure, we empower every team member to make an impact and deliver exceptional customer service.Job DescriptionWe are seeking...
-
Data Science Expert
6 days ago
Johannesburg, Gauteng, South Africa Data Bene Full timeJob DescriptionWe are seeking a highly skilled Data Analyst to join our team at Data Bene. As a key member of our organization, you will play a vital role in collecting, analyzing, and interpreting data sets to inform business decisions.Your primary focus will be on ensuring the accuracy and quality of data, while also developing ad hoc analyses from start...
-
Data Science Engineer
6 days ago
Johannesburg, Gauteng, South Africa Muse Consultancy Services Full timeMUSE Consultancy Services is a specialist consultancy that provides expert advice on software development, resourcing, and recruitment. We are dedicated to delivering high-quality software solutions that meet our clients' needs.Our team of experienced developers and consultants work closely with leading companies in South Africa to design and implement...
-
Data Protection Lead/Manager
2 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeKey Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...
-
Data Science and Analytics Manager
7 hours ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeInherent RequirementsAt least 10 years of hands-on involvement in data science projects, including managing large-scale initiatives and leading multidisciplinary teams.Degree (Honours, Masters or PHD) in quantitative fields such as Actuarial Science, Statistics, Computer Science, Engineering, Mathematics and/or combination of these.Proven expertise in data...
-
Data Engineer
6 days ago
Johannesburg, Gauteng, South Africa Promapp Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team. As a key member of our engineering department, you will be responsible for designing and implementing high-quality data engineering solutions that meet the needs of our organization.As a senior member of our team, you will demonstrate technical excellence and provide guidance and...
-
Data Engineering Professional Johannesburg
6 days ago
Johannesburg, Gauteng, South Africa IQbusiness Full timeJob DescriptionWe are looking for data engineering professionals to join our dynamic and diverse team of data specialists. If you meet some or all of the below requirements, then you may have a certain set of skills which we require.The ideal candidate should be able to solve problems, work in an ever-changing environment, and contribute ideas to the...
-
Data Infrastructure Specialist
6 days ago
Johannesburg, Gauteng, South Africa Liyema Consulting Full timeJob Title: Data Infrastructure SpecialistAbout Us:Liyema Consulting is a forward-thinking data solutions firm focused on harnessing data to fuel business growth. Our collaborative atmosphere encourages innovation and teamwork.Job Description:In this key role, the Senior Data Engineer will focus on building and maintaining scalable data infrastructure,...
-
Senior Data Engineer Position
1 week ago
Johannesburg, Gauteng, South Africa Wesbank Full timeAbout the RoleThis Big Data Engineering position will ensure effective movement, collection, integration, storage, and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders.As a Technical Data Specialist, you will assist with gap analysis and business...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...
-
Data Engineer
7 days ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeWe are seeking a highly skilled and experienced Data Engineer to join our team. In this role, you will be responsible for developing and maintaining scalable, secure, and repeatable data pipelines. You will manage data platforms, ensuring the accuracy and accessibility of data for reporting and analysis across the business.Key Responsibilities: Implement and...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa Network Recruitment Full timeA leading technology firm is seeking a highly skilled Data Engineer to join their team in a hybrid/remote capacity. If you have experience in Python, SQL, AWS, and ETL processes , and are passionate about building and optimizing data pipelines , this role is for you Qualifications: BSc in Computer Science, Information Systems, Engineering, or a related...