Data Engineer
Found in: beBee S ZA - 4 weeks ago
Job title : Data Engineer – Template jobs in Gauteng
Job Location : Gauteng,
Deadline : May 09, 2024
Quick Recommended Links
Job Advert Summary
As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on migrating data pipelines to Azure Synapse Analytics and optimizing consumption side data provisioning. You will work closely with external consulting teams, in both data pipeline creation & maintenance and data management; and the analytics team, to understand analytics issues and requirements and translate them into scalable data solutions.
You will be working with internal company data as well as data provided by third party suppliers and partners. You would be involved in building and maintaining a cloud data lake, including the full process of ingestion, maintenance and provisioning of data from both internal and external data providers. Additionally, you will play a role in migrating business logic from analytics and reporting tools to Azure Synapse Analytics.
Minimum Requirements
Experience and Qualification
Skills and Attributes
Highly SQL proficient Python advantageous Process design and implementation Familiarity with APIs Familiarity with on-premises SQL Server databases and familiarity with migration processes to cloud platforms. Familiarity with Qlik Sense or similar reporting and analytics tools. Familiarity with enterprise systems and working with multiple databases. Knowledge of Microsoft Purview or similar data governance tools. Strong problem-solving skills and a demonstrated ability to learn new technologies independently. Proactive approach to problem solving Ability to function within various teams and environments, but also work independently Excellent communication skillsDuties & Responsibilities
Monitor, maintain and improve data pipelines on-premises and in Azure Synapse Analytics. Designing, developing, and testing large data pipelines to ingest, aggregate, clean, and distribute data models ready for analysis. Work with third party consultants to implement data lake architecture. Build and maintain data pipelines to facilitate the smooth flow of data between various systems and databases. Provision datasets for consumption side users, focusing on consistency and data integrity. Migrate business logic from Qlik Sense to Azure Synapse Analytics. Migrate on premises data systems to the Azure Cloud. Test and maintain new and existing API connections. Contribute to and expand a data taxonomy to ensure consistency and clarity in data organization. Implement data security protocols across the entire data environment. Focused improvement initiatives of existing processes, systems, data, reports. Focused improvement initiatives of cross-functional interactions within the organisation. Willing to travel locallly and Internationally.*Research / Data Analysis jobs in south africa
*Data Engineer – Template in
-
Data Engineer
Found in: beBee S ZA - 3 weeks ago
Gauteng,, South Africa Unitrans Full timeUnitrans’s job vacancy, Career and Recruitment Job title : Data Engineer – Template jobs in Gauteng Job Location : Gauteng, Deadline : May 09, 2024 Quick Recommended Links Jobs by Location Job by industries Job Advert Summary As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on...
-
AWS Data Engineer
Found in: beBee S ZA - 3 weeks ago
Gauteng, South Africa SabenzaIT Full timeAre you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...
-
Data Engineer/ETL Developer
Found in: beBee S ZA - 3 weeks ago
Gauteng, Johannesburg, South Africa Datafin Recruitment Full timeDatafin Recruitment’s job vacancy, Career and Recruitment Job title : Data Engineer/ETL Developer (Remote) jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 20, 2024 Quick Recommended Links Jobs by Location Job by industries DUTIES: Collaborate with stakeholders to understand data requirements and deliver comprehensive ETL...
-
Software Engineer: Radar Data Processing and Control
Found in: beBee S ZA - 3 weeks ago
Gauteng, Pretoria, South Africa Council for Scientific and Industrial Research Full timeCouncil for Scientific and Industrial Research’s job vacancy, Career and Recruitment Job title : Software Engineer: Radar Data Processing and Control – Scientia, Pretoria (Hybrid) jobs in Gauteng Job Location : Gauteng, Pretoria Deadline : April 08, 2024 Quick Recommended Links Jobs by Location Job by industries About the job: The CSIR has a vacancy...
-
Senior Analytics Engineer, Data Platform
Found in: beBee jobs ZA - 2 weeks ago
Eastern Cape - Free State - Gauteng - KwaZulu-Natal - Limpopo - Mpumalanga - North West - Northern Cape - Western Cape - International, South Africa DEEL Full timeWho we are and what we doDeel is a global team that helps businesses hire anyone, anywhere, easily. Deel consists of more than three thousand self-driven individuals spanning over 100 countries. Our unified yet diverse culture keeps us continually learning and innovating the Deel platform and our products for customers.Companies should be able to hire the...
-
Director of Engineering
Found in: beBee S ZA - 4 weeks ago
Gauteng, South Africa Endeavour Recruitment Full timeDirector of Engineering Endeavour Recruitment has an exciting opportunity for a Director of Engineering with strong experience in web app or mobile full-stack development to join our client based in Eastern Africa, Uganda/Kenya. Remote - Occasional T... ● You have 5+ years of web app or mobile full-stack development resulting in strong technology...
-
Digital & Data Analytics Manager
2 days ago
Gauteng, South Africa Natebo Consulting Full timeWaverly Office Park, Bramley, Sandton Our Data and Digital service line helps our clients to achieve digital transformation as a strategic advisor and delivery partner. We provide a range of services to help clients respond to disruptive technology trends, implement innovative digital products, make data driven decisions and deliver technology-enabled...
-
Data Specialist
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa Experian Full timeExperian’s job vacancy, Career and Recruitment Job title : Data Specialist – Sandton jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications At least 3 years of experience in data engineering or related field Proficiency in Source Control, T-SQL,...
-
Software Engineer II
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa LexisNexis Full timeLexisNexis’s job vacancy, Career and Recruitment Job title : Software Engineer II jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 06, 2024 Quick Recommended Links Jobs by Location Job by industries BASIC FUNCTIONS: This position performs moderate research, design, and software development assignments within a specific software...
-
Manager: Data Services
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa Standard Bank Group Full timeStandard Bank Group’s job vacancy, Career and Recruitment Job title : Manager: Data Services jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description Oversee data mining techniques and conduct statistical analysis to large, structured and unstructured data...
-
Senior Data Analyst
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa Experian Full timeExperian’s job vacancy, Career and Recruitment Job title : Senior Data Analyst – Bryanston jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications BSc/BA in Computer Science math, software engineering, statistics, data science or a related technical...
-
Tailings Engineer
Found in: beBee S ZA - 3 weeks ago
Gauteng, Johannesburg, South Africa WSP in Africa Full timeWSP in Africa’s job vacancy, Career and Recruitment Job title : Tailings Engineer jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 10, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description WSP has a new opportunity for a Tailings Engineer to join our Mine Waste team on a full-time basis in Midrand....
-
Tailings Engineer
Found in: beBee S ZA - 3 weeks ago
Gauteng, Johannesburg, South Africa WSP in Africa Full timeWSP in Africa’s job vacancy, Career and Recruitment Job title : Tailings Engineer jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 10, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description WSP has a new opportunity for a Tailings Engineer to join our Mine Waste team on a full-time basis in Midrand....
-
Software Engineer III
Found in: beBee S ZA - 3 weeks ago
Gauteng, Johannesburg, South Africa LexisNexis Full timeLexisNexis’s job vacancy, Career and Recruitment Job title : Software Engineer III – Johannesburg jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 21, 2024 Quick Recommended Links Jobs by Location Job by industries BASIC FUNCTIONS: This position performs moderately difficult research, design, and software development...
-
Data Analytics Skills Programme
Found in: beBee S ZA - 2 weeks ago
Gauteng, Johannesburg, South Africa Afrika Tikkun Full timeAfrika Tikkun’s job vacancy, Career and Recruitment Job title : Data Analytics Skills Programme jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : 18-May-24 Quick Recommended Links Jobs by Location Job by industries Exciting Career Opportunity for Young Graduates! Join Our Data Analytics Skills Programme Are you a recent graduate...
-
Performance Pulse Data Analyst
Found in: beBee S ZA - 3 weeks ago
Gauteng, Johannesburg, South Africa RetailNext Full timeRetailNext’s job vacancy, Career and Recruitment Job title : Performance Pulse Data Analyst jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 02, 2024 Quick Recommended Links Jobs by Location Job by industries RetailNext is looking for a Performance Pulse Data Analyst to work with large data sets and assist the world’s largest...
-
Network and Security Engineer Johannesburg North
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa Affirmative Portfolios Full timeAffirmative Portfolios’s job vacancy, Career and Recruitment Job title : Network and Security Engineer Johannesburg North jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 06, 2024 Quick Recommended Links Jobs by Location Job by industries Key performance areas: Overall cybersecurity compliance, management, and training throughout...
-
Junior Data Analyst
Found in: beBee jobs ZA - 14 hours ago
Bryanston, Gauteng, South Africa The South African Breweries Full timeOverview:The role of the Data Analyst is to bring technical expertise to ensure the quality and accuracy of data, then process, generate insights, design and present it in ways to help colleagues within Draftline and AB-InBev to make better decisions.The Data Analyst will lead marketing data and analytics deliverables for Brand teams and other internal...
-
Junior Data Analyst
Found in: beBee S ZA - 1 day ago
Bryanston, Gauteng, South Africa The South African Breweries Full timeOverview:The role of the Data Analyst is to bring technical expertise to ensure the quality and accuracy of data, then process, generate insights, design and present it in ways to help colleagues within Draftline and AB-InBev to make better decisions.The Data Analyst will lead marketing data and analytics deliverables for Brand teams and other internal...
-
Data Center Technician
Found in: beBee S ZA - 4 weeks ago
Gauteng, Johannesburg, South Africa Microsoft Full timeMicrosoft’s job vacancy, Career and Recruitment Job title : Data Center Technician – Johannesburg jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : March 29, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications Required Qualifications: High school diploma, GED, or equivalent and basic knowledge of computer...