Data Engineer

Found in: beBee S ZA - 3 weeks ago

Gauteng, South Africa Unitrans Full time
Unitrans’s job vacancy, Career and Recruitment

Job title : Data Engineer – Template jobs in Gauteng

Job Location : Gauteng,

Deadline : May 09, 2024

Quick Recommended Links

Jobs by Location Job by industries

Job Advert Summary    
As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on migrating data pipelines to Azure Synapse Analytics and optimizing consumption side data provisioning. You will work closely with external consulting teams, in both data pipeline creation & maintenance and data management; and the analytics team, to understand analytics issues and requirements and translate them into scalable data solutions.

You will be working with internal company data as well as data provided by third party suppliers and partners. You would be involved in building and maintaining a cloud data lake, including the full process of ingestion, maintenance and provisioning of data from both internal and external data providers. Additionally, you will play a role in migrating business logic from analytics and reporting tools to Azure Synapse Analytics.

Minimum Requirements    
Experience and Qualification

Bachelor’s degree in Computer Science, Information Systems, or a related field OR proven capability in working with enterprise data systems. Azure Data Engineer Associate (DP-203) preferred Experience with Azure cloud services, particularly Azure Synapse Analytics. Strong understanding of cloud data solutions and architectures. Valid Driver’s Licence with own transport 

Skills and Attributes

Highly SQL proficient Python advantageous Process design and implementation Familiarity with APIs Familiarity with on-premises SQL Server databases and familiarity with migration processes to cloud platforms. Familiarity with Qlik Sense or similar reporting and analytics tools. Familiarity with enterprise systems and working with multiple databases. Knowledge of Microsoft Purview or similar data governance tools. Strong problem-solving skills and a demonstrated ability to learn new technologies independently. Proactive approach to problem solving Ability to function within various teams and environments, but also work independently Excellent communication skills

Duties & Responsibilities    

Monitor, maintain and improve data pipelines on-premises and in Azure Synapse Analytics. Designing, developing, and testing large data pipelines to ingest, aggregate, clean, and distribute data models ready for analysis. Work with third party consultants to implement data lake architecture.      Build and maintain data pipelines to facilitate the smooth flow of data between various systems and databases. Provision datasets for consumption side users, focusing on consistency and data integrity. Migrate business logic from Qlik Sense to Azure Synapse Analytics. Migrate on premises data systems to the Azure Cloud. Test and maintain new and existing API connections. Contribute to and expand a data taxonomy to ensure consistency and clarity in data organization. Implement data security protocols across the entire data environment. Focused improvement initiatives of existing processes, systems, data, reports. Focused improvement initiatives of cross-functional interactions within the organisation. Willing to travel locallly and Internationally.

*Research / Data Analysis  jobs in south africa

*Data Engineer – Template in

  • Data Engineer

    Found in: beBee S ZA - 4 weeks ago

    Gauteng,, South Africa Unitrans Full time

    Unitrans’s job vacancy, Career and Recruitment Job title : Data Engineer – Template jobs in Gauteng Job Location : Gauteng, Deadline : May 09, 2024 Quick Recommended Links Jobs by Location Job by industries Job Advert Summary     As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on...

  • AWS Data Engineer

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • Data Engineer/ETL Developer

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Johannesburg, South Africa Datafin Recruitment Full time

    Datafin Recruitment’s job vacancy, Career and Recruitment Job title : Data Engineer/ETL Developer (Remote) jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 20, 2024 Quick Recommended Links Jobs by Location Job by industries DUTIES: Collaborate with stakeholders to understand data requirements and deliver comprehensive ETL...

  • Software Engineer: Radar Data Processing and Control

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Pretoria, South Africa Council for Scientific and Industrial Research Full time

    Council for Scientific and Industrial Research’s job vacancy, Career and Recruitment Job title : Software Engineer: Radar Data Processing and Control – Scientia, Pretoria (Hybrid) jobs in Gauteng Job Location : Gauteng, Pretoria Deadline : April 08, 2024 Quick Recommended Links Jobs by Location Job by industries About the job: The CSIR has a vacancy...

  • Senior Analytics Engineer, Data Platform

    Found in: beBee jobs ZA - 2 weeks ago

    Eastern Cape - Free State - Gauteng - KwaZulu-Natal - Limpopo - Mpumalanga - North West - Northern Cape - Western Cape - International, South Africa DEEL Full time

    Who we are and what we doDeel is a global team that helps businesses hire anyone, anywhere, easily. Deel consists of more than three thousand self-driven individuals spanning over 100 countries. Our unified yet diverse culture keeps us continually learning and innovating the Deel platform and our products for customers.Companies should be able to hire the...

  • Director of Engineering

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, South Africa Endeavour Recruitment Full time

    Director of Engineering Endeavour Recruitment has an exciting opportunity for a Director of Engineering with strong experience in web app or mobile full-stack development to join our client based in Eastern Africa, Uganda/Kenya. Remote - Occasional T... ● You have 5+ years of web app or mobile full-stack development resulting in strong technology...

  • Digital & Data Analytics Manager

    2 days ago

    Gauteng, South Africa Natebo Consulting Full time

    Waverly Office Park, Bramley, Sandton Our Data and Digital service line helps our clients to achieve digital transformation as a strategic advisor and delivery partner. We provide a range of services to help clients respond to disruptive technology trends, implement innovative digital products, make data driven decisions and deliver technology-enabled...

  • Data Specialist

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa Experian Full time

    Experian’s job vacancy, Career and Recruitment Job title : Data Specialist – Sandton jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications At least 3 years of experience in data engineering or related field Proficiency in Source Control, T-SQL,...

  • Software Engineer II

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa LexisNexis Full time

    LexisNexis’s job vacancy, Career and Recruitment Job title : Software Engineer II jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 06, 2024 Quick Recommended Links Jobs by Location Job by industries BASIC FUNCTIONS:  This position performs moderate research, design, and software development assignments within a specific software...

  • Manager: Data Services

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa Standard Bank Group Full time

    Standard Bank Group’s job vacancy, Career and Recruitment Job title : Manager: Data Services jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description Oversee data mining techniques and conduct statistical analysis to large, structured and unstructured data...

  • Senior Data Analyst

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa Experian Full time

    Experian’s job vacancy, Career and Recruitment Job title : Senior Data Analyst – Bryanston jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 05, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications BSc/BA in Computer Science math, software engineering, statistics, data science or a related technical...

  • Tailings Engineer

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Johannesburg, South Africa WSP in Africa Full time

    WSP in Africa’s job vacancy, Career and Recruitment Job title : Tailings Engineer jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 10, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description WSP has a new opportunity for a Tailings Engineer to join our Mine Waste team on a full-time basis in Midrand....

  • Tailings Engineer

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Johannesburg, South Africa WSP in Africa Full time

    WSP in Africa’s job vacancy, Career and Recruitment Job title : Tailings Engineer jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 10, 2024 Quick Recommended Links Jobs by Location Job by industries Job Description WSP has a new opportunity for a Tailings Engineer to join our Mine Waste team on a full-time basis in Midrand....

  • Data Analytics Skills Programme

    Found in: beBee S ZA - 2 weeks ago

    Gauteng, Johannesburg, South Africa Afrika Tikkun Full time

    Afrika Tikkun’s job vacancy, Career and Recruitment Job title : Data Analytics Skills Programme jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : 18-May-24 Quick Recommended Links Jobs by Location Job by industries Exciting Career Opportunity for Young Graduates! Join Our Data Analytics Skills Programme  Are you a recent graduate...

  • Software Engineer III

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Johannesburg, South Africa LexisNexis Full time

    LexisNexis’s job vacancy, Career and Recruitment Job title : Software Engineer III – Johannesburg jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 21, 2024 Quick Recommended Links Jobs by Location Job by industries BASIC FUNCTIONS: This position performs moderately difficult research, design, and software development...

  • Performance Pulse Data Analyst

    Found in: beBee S ZA - 3 weeks ago

    Gauteng, Johannesburg, South Africa RetailNext Full time

    RetailNext’s job vacancy, Career and Recruitment Job title : Performance Pulse Data Analyst jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : May 02, 2024 Quick Recommended Links Jobs by Location Job by industries RetailNext is looking for a Performance Pulse Data Analyst to work with large data sets and assist the world’s largest...

  • Junior Data Analyst

    Found in: beBee jobs ZA - 12 hours ago

    Bryanston, Gauteng, South Africa The South African Breweries Full time

    Overview:The role of the Data Analyst is to bring technical expertise to ensure the quality and accuracy of data, then process, generate insights, design and present it in ways to help colleagues within Draftline and AB-InBev to make better decisions.The Data Analyst will lead marketing data and analytics deliverables for Brand teams and other internal...

  • Junior Data Analyst

    Found in: beBee S ZA - 1 day ago

    Bryanston, Gauteng, South Africa The South African Breweries Full time

    Overview:The role of the Data Analyst is to bring technical expertise to ensure the quality and accuracy of data, then process, generate insights, design and present it in ways to help colleagues within Draftline and AB-InBev to make better decisions.The Data Analyst will lead marketing data and analytics deliverables for Brand teams and other internal...

  • Network and Security Engineer Johannesburg North

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa Affirmative Portfolios Full time

    Affirmative Portfolios’s job vacancy, Career and Recruitment Job title : Network and Security Engineer Johannesburg North jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : April 06, 2024 Quick Recommended Links Jobs by Location Job by industries Key performance areas: Overall cybersecurity compliance, management, and training throughout...

  • Data Center Technician

    Found in: beBee S ZA - 4 weeks ago

    Gauteng, Johannesburg, South Africa Microsoft Full time

    Microsoft’s job vacancy, Career and Recruitment Job title : Data Center Technician – Johannesburg jobs in Gauteng Job Location : Gauteng, Johannesburg Deadline : March 29, 2024 Quick Recommended Links Jobs by Location Job by industries Qualifications Required Qualifications: High school diploma, GED, or equivalent and basic knowledge of computer...