Specialist: Data Engineering
2 weeks ago
**Core Description**:
Responsible to support data science projects and solutions by leveraging data and software engineering experience to solve a variety of use cases across the Telkom Group and for its customers. Expected to be highly skilled in batch and real-time data ingestion and data transformation with the ability to design, build and scale data pipelines for efficient data integration and processing.
**Competencies**:**
FUNCTIONAL KNOWLEDGE**
Relational and non-relational database foundational knowledge; Data engineering knowledge base; Data integration concepts and terms ; Software and data engineering knowledge (Python, Scala, Shell scripting, JavaScript, Firebase); Cloud data streaming knowledge (Kafka, Sqoop, Pub-Sub based models/ services, Redis, RabbitMQ, Airflow, Beam, Cloud DataFlow, Apache Arrow, Apache Arrow Flight, Apache Iceberg); Data ops CI/CD and cloud deployment best practises knowledge; Cloud computing and platform management (GCP, Azure, AWS, etc.)
**FUNCTIONAL SKILLS**
Problem solving; Communication (written and verbal); Stakeholder management
**ATTITUDES/ LEADERSHIP COMPETENCIES**
Takes initiative; Hard working; Can do attitude; Innovative thinker; Works well in teams; Works well under pressure; Relishes dynamic/ changing environment; Highly skilled in multitasking; Time management; Solving difficult problems
**Responsibilities**:
- Build data integration pipelines used to move data between databases, file systems & other locations while tracking data quality according to measures set by data owner.
- Provide data support for specialized data centric services we provide to grow our data maturity:
- This includes but are not limited to: Data modelling, database design, data quality assessments, data format conversion, data transformation, data tool selection.
- Enable big data engineering by creating and managing code and tools created to efficiently obtain and move vast amounts of data between file systems and/or databases while ensuring data integrity.
- Enable live/real-time data engineering by creating and managing code and tools built to efficiently obtain and move real-time data while ensuring data integrity.
- Engage with stakeholders to support the design and delivery of data science projects and solutions.
- Use data engineering techniques to solve business problems.
- Responsible for working with a team of data engineers to develop and maintain our cloud-based development and production platforms.
- Support ETL/ELT processes and data ingestion for exploratory data analysis and solution development.
- Lead and develop a team of junior data engineers.
- Contribute to our agile way of work and our innovation culture.
- Up to date knowledge of data platforms and related technologies.
- Translate business requirements into system requirements.
- Consistent documentation of all implemented data integration pipelines and processes.
**Required Certification**:
Data and cloud certifications will be advantageous (GCP, Azure, AWS) as well as certifications for other products in our stack (Airflow, Beam, Cloud DataFlow, Apache Arrow, Apache Arrow Flight, Apache Iceberg, Tableau, Alteryx)
**Qualifications**:
3-year degree/ diploma (NQF level 6) preferably in Computer Science, Mathematics, Statistics, Data Engineering or a related field. A relevant post graduate degree will be an added advantage.
**Experience**:
3-5 years relevant experience, of which at least 2 years must have been in a data engineering environment. Experience in ICT/ Telecommunications will be an advantage. Experience with system and process analysis and design.
**Special Requirements**:
Experience with Google Cloud Platform.
Expected to stay abreast of new data engineering frameworks and developments and to put them into practice.
**Comments**:
-
Quality Data Engineer Specialist
4 days ago
Centurion, Gauteng, South Africa A 1L Realization (Pty) Ltd Full timeWe are looking for a Quality Data Engineer Specialist to contribute to the development of our data engineering capabilities at A 1L Realization (Pty) Ltd. As a key member of our team, you will play a vital role in guaranteeing data quality, consistency, and usability.The successful candidate will have hands-on experience working with data quality frameworks...
-
Data Engineer
3 weeks ago
Centurion, Gauteng, South Africa Network Recruitment Full timeAs a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience in...
-
Data Engineer
3 weeks ago
Centurion, Gauteng, South Africa Network Recruitment Full timeAs a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree in computer science, Informatics or related At least 3 years of relevant experience Proven experience...
-
Data Engineer
1 week ago
Centurion, Gauteng, South Africa Network Recruitment Full timeAs a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements:Completed Bachelors Degree in computer science, Informatics or relatedAt least 3 years of relevant experienceProven experience in...
-
Data Specialist
2 days ago
Centurion, Gauteng, South Africa Network Recruitment Full timeJob Description:As a specialist in data engineering, you will be responsible for designing, building, and maintaining large-scale data systems. This involves working with various technologies such as Apache Spark, Hadoop, and Kafka to process and analyze complex data sets.Requirements:• Bachelor's degree in computer science or a related field• At least 3...
-
Specialist: Data Engineering
2 weeks ago
Centurion, South Africa Ntirho Human Capital Full timeJOB PURPOSE Responsible to support data science projects and solutions by leveraging data and software engineering experience to solve a variety of use cases across the Telkom Group and for its customers. Expected to be highly skilled in batch and real-time data ingestion and data transformation with the ability to design, build and scale data pipelines for...
-
Electrical Engineering Specialist
1 day ago
Centurion, Gauteng, South Africa Network Engineering Full timeJob DescriptionWe are seeking a highly skilled and experienced Electrical Consulting Engineer to provide technical guidance, conduct feasibility studies, develop designs, and ensure compliance with regulatory standards.Main Responsibilities:Collaborate with clients and internal teams to understand project requirements.Conduct site visits, inspections, and...
-
Electronics Manufacturing Specialist
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeJob SummaryA challenging opportunity exists for a skilled Electronics Manufacturing Specialist to oversee the technical aspects of PCB manufacturing processes and related standards.Main ResponsibilitiesSupervise the technical aspects of PCB manufacturing processes and related standards.Utilize software tools effectively for processing manufacturing data.Key...
-
Engineering Technologist
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full time**About Us:**We are a leading company in the field of conservation efforts through innovative technology solutions. Our survey system is a pioneering platform designed to process and analyze aerial survey data, utilizing state-of-the-art deep learning classifiers to identify animals in aerial images.The system generates accurate statistical population...
-
Snr Specialist: Data Engineering
2 weeks ago
Centurion, South Africa BCXP Full timeBusiness unit, Department, Reporting Business Unit DPS, Business and Digital Advisory Department Data Insights and Intelligence Job grade S4 Core Description Responsible for supporting the delivery of data science projects and solutions by leveraging your data and software engineering experience. Will be required to lead a small team of engineers through...
-
Data Engineer
3 days ago
Centurion, Gauteng, South Africa Mediro ICT Recruitment Full timeJob DescriptionProfile OutlineA technology focussed individual, data engineers will need to design, configure, develop and deploy data transformations.Key ResponsibilitiesDevelop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates.Combine and curate data in a...
-
Network Architecture Engineer
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeWe are a forward-thinking company dedicated to using technology to address environmental challenges. Our survey system is a cutting-edge platform designed to process and analyze aerial survey data, utilizing advanced algorithms and deep learning techniques to identify animals in aerial images.The system enables the generation of accurate statistical...
-
Electronic Engineer
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeJob & Company DescriptionMy client is a dynamic and innovative company committed to conservation efforts through cutting-edge technology. Their survey system is a pioneering platform designed to process and analyze aerial survey data. It utilizes state-of-the-art deep learning classifiers to identify animals in aerial images, enabling the generation of...
-
Production Process Engineer Centurion
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeProduction Process EngineerReference: NES018051-SV-1A thrilling opportunity as a Production Process Engineer awaits, beckoning for your expertiseDuties & ResponsibilitiesA respected leader in electronic manufacturing is in search of a proficient Production Process Engineer to join their team of experts. The main focus of this role is to supervise the...
-
Senior Data Engineer
4 days ago
Centurion, Gauteng, South Africa Inspired Xpert Full timeLocation: Cape Town OR Centurion (hybrid)Type: PermanentRole SummaryAs a Senior Data Engineer, you'll design and optimise scalable data infrastructure, ensuring high-performance pipelines that support strategic goals. You'll mentor junior team members, drive best practices, and contribute to key architectural decisions. Your work will empower data teams with...
-
Electronic Engineering Specialist
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeNetwork Engineering: A Leading Provider of Advanced Electronic SolutionsWe are seeking a highly skilled Production Engineer to join our team. As a key member of our production department, you will be responsible for overseeing the technical aspects of our manufacturing facility and orders.Key Responsibilities:Oversee the technical aspects of the production...
-
Automation Systems Specialist
6 days ago
Centurion, Gauteng, South Africa Network Engineering Full timeAbout the RoleThis Automation Systems Specialist position requires a strong foundation in electronic engineering principles and experience with PLC programming languages. As a key member of our team, you will be responsible for designing, developing, and testing electronic systems and components.Key Responsibilities:Assist in the design, development, and...
-
Electronic Engineer Centurion
1 week ago
Centurion, Gauteng, South Africa Network Engineering Full timeDuties & ResponsibilitiesJob & Company Description:My client is a dynamic and innovative company committed to conservation efforts through cutting-edge technology. Their survey system is a pioneering platform designed to process and analyse aerial survey data. It utilizes state-of-the-art deep learning classifiers to identify animals in aerial images,...
-
Electrical Systems Specialist
6 days ago
Centurion, Gauteng, South Africa Triz Engineering Services Full timeWe are looking for a highly skilled Electrical Systems Specialist to join our team at Triz Engineering Solutions in Centurion, Gauteng.The successful candidate will have a strong background in electrical design and experience working in an electrical design engineering position, with a minimum of 3 years of experience. A B Eng degree in Electrical /...
-
Production Engineering Manager
6 days ago
Centurion, Gauteng, South Africa Triz Engineering Services Full timeJob DescriptionAs an Industrial Process Engineer at Triz Engineering Services, you will play a critical role in ensuring the seamless transition of engineering designs and data into production. This involves managing industrial and process engineering functions, including reviewing and approving sub-systems for build feasibility, setting up detailed...