Data Engineer

Found in: beBee jobs ZA - 1 week ago


Pretoria, Gauteng, South Africa Unitrans Full time
Unitrans's job vacancy, Career and Recruitment

Job title : Data Engineer – Template jobs in Gauteng

Job Location : Gauteng,

Deadline : May 09, 2024

Quick Recommended Links

Jobs by Location
Job by industries

Job Advert Summary

As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on migrating data pipelines to Azure Synapse Analytics and optimizing consumption side data provisioning. You will work closely with external consulting teams, in both data pipeline creation & maintenance and data management; and the analytics team, to understand analytics issues and requirements and translate them into scalable data solutions.

You will be working with internal company data as well as data provided by third party suppliers and partners. You would be involved in building and maintaining a cloud data lake, including the full process of ingestion, maintenance and provisioning of data from both internal and external data providers. Additionally, you will play a role in migrating business logic from analytics and reporting tools to Azure Synapse Analytics.

Minimum Requirements

Experience and Qualification

Bachelor's degree in Computer Science, Information Systems, or a related field OR proven capability in working with enterprise data systems.
Azure Data Engineer Associate (DP-203) preferred
Experience with Azure cloud services, particularly Azure Synapse Analytics.
Strong understanding of cloud data solutions and architectures.
Valid Driver's Licence with own transport

Skills and Attributes
Highly SQL proficient
Python advantageous
Process design and implementation
Familiarity with APIs
Familiarity with on-premises SQL Server databases and familiarity with migration processes to cloud platforms.
Familiarity with Qlik Sense or similar reporting and analytics tools.
Familiarity with enterprise systems and working with multiple databases.
Knowledge of Microsoft Purview or similar data governance tools.
Strong problem-solving skills and a demonstrated ability to learn new technologies independently.
Proactive approach to problem solving
Ability to function within various teams and environments, but also work independently
Excellent communication skills

Duties & Responsibilities
Monitor, maintain and improve data pipelines on-premises and in Azure Synapse Analytics.
Designing, developing, and testing large data pipelines to ingest, aggregate, clean, and distribute data models ready for analysis.
Work with third party consultants to implement data lake architecture.
Build and maintain data pipelines to facilitate the smooth flow of data between various systems and databases.
Provision datasets for consumption side users, focusing on consistency and data integrity.
Migrate business logic from Qlik Sense to Azure Synapse Analytics.
Migrate on premises data systems to the Azure Cloud.
Test and maintain new and existing API connections.
Contribute to and expand a data taxonomy to ensure consistency and clarity in data organization.
Implement data security protocols across the entire data environment.
Focused improvement initiatives of existing processes, systems, data, reports.
Focused improvement initiatives of cross-functional interactions within the organisation.
Willing to travel locallly and Internationally.

*Research / Data Analysis jobs in south africa
*Data Engineer – Template in
  • AWS Data Engineer

    Found in: beBee jobs ZA - 1 week ago


    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • Data Streaming Platform Engineer

    Found in: beBee jobs ZA - 1 week ago


    Pretoria, Gauteng, South Africa Sabenza IT Full time

    Sabenza IT's job vacancy, Career and RecruitmentJob title : Data Streaming Platform Engineer – Midrand jobs in GautengJob Location : Gauteng, Deadline : April 25, 2024Quick Recommended LinksJobs by LocationJob by industries ESSENTIAL SKILLS REQUIREMENTS:Sound knowledge in Kotlin, Java or JavaScript or Python or C#Familiarity with Microservices...

  • Curation Assistant

    Found in: beBee jobs ZA - 1 week ago


    Pretoria, Gauteng, South Africa Twinkl Full time

    Twinkl's job vacancy, Career and RecruitmentJob title : Curation Assistant jobs in GautengJob Location : Gauteng, Deadline : May 04, 2024Quick Recommended LinksJobs by LocationJob by industries As a Curation Assistant, you'll work the curation team lead and the curation manager. You'll play a pivotal role in ensuring our customers find relevant content...

  • Information Scientist

    Found in: beBee jobs ZA - 3 weeks ago


    Pretoria, Gauteng, South Africa Council for Scientific and Industrial Research Full time

    Council for Scientific and Industrial Research's job vacancy, Career and RecruitmentJob title : Information Scientist jobs in GautengJob Location : Gauteng, PretoriaDeadline : May 03, 2024Quick Recommended LinksJobs by LocationJob by industries About the job:The CSIR has a vacancy for an Information Scientist in the Business Excellence and Integration...

  • Specialist - Network Sub-systems Technology Information

    Found in: beBee jobs ZA - 1 week ago


    Pretoria, Gauteng, South Africa MTN Full time

    MTN's job vacancy, Career and RecruitmentJob title : Specialist – Network Sub-systems Technology Information jobs in GautengJob Location : Gauteng, Deadline : April 21, 2024Quick Recommended LinksJobs by LocationJob by industries RESPONSIBILITIESContext: (Global influences, environmental / industry demands, organisational mission, etc.)All operational...

  • Snr C# Developer

    Found in: beBee jobs ZA - 2 days ago


    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Join our dynamic team in the National Treasury space as a Senior C# Developer within the Systems Support department. Our client plays a crucial role in the economic development of South Africa, and your expertise will contribute to maintaining and enhancing the systems that support this mission. Minimum Requirements:Hold a pertinent tertiary degree in...

  • Process Coach, Maintenance

    Found in: beBee jobs ZA - 1 week ago


    Pretoria, Gauteng, South Africa Ford Motor Company of Southern Africa Full time

    Ford Motor Company of Southern Africa's job vacancy, Career and RecruitmentJob title : Process Coach, Maintenance jobs in GautengJob Location : Gauteng, PretoriaDeadline : May 15, 2024Quick Recommended LinksJobs by LocationJob by industries ROLE SUMMARYThe Process Coach is responsible for:Supporting Production with well-maintained facilities adhering to...

  • Data Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago


    Pretoria, South Africa HR Genie Full time

    We are committed to excellence and are looking for a dynamic Data Engineer to join our team. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want you on our team. Hybrid (once a week) - Pretoria As a Data Engineer at Dotcom, you will play a crucial role in our engineering team, responsible for designing,...

  • AWS Data Engineer

    Found in: Whatjobs ZA C2 - 7 days ago


    Pretoria, South Africa Jordan HR Full time

    Responsibilities: Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team. Develop technical documentation and artifacts to support data engineering processes and initiatives. Work with various data formats including Parquet, AVRO, JSON, XML, and CSV. Utilize Data Quality Tools such as...

  • AWS Data Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Pretoria, South Africa Jordan HR Full time

    Responsibilities:Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team.Develop technical documentation and artifacts to support data engineering processes and initiatives.Work with various data formats including Parquet, AVRO, JSON, XML, and CSV.Utilize Data Quality Tools such as...

  • Data Engineer/ BI Consultant

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa People Dimension Full time

    Job Description/Duties:• To identify, conceptualize & advocate strategic data enablement opportunities (new & existing customers). • Project and activity planning. • Stakeholder expectation management. • Product installation & configuration.• Stakeholder expectation management. • Product installation & configuration.• Implement data strategies,...

  • RFX 4921036 _ Data Engineer Services

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa Tipp Focus Full time

    Objective of this Scope of WorkThe main purpose of this position is to ensure that data quality and integrity, creating advanced algorithms, develop and maintain datasets and architecture design of high calibre to also support the business goals and to build systems by collecting, validating and preparing high quality data objectives of client PA...

  • Senior AWS Data Engineer

    Found in: Whatjobs ZA C2 - 7 days ago


    Pretoria, South Africa Jordan HR Full time

    RESPONSIBILITIESYou will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis. Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms. Collaborating with cross-functional teams to understand data requirements and develop scalable...

  • Senior AWS Data Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Pretoria, South Africa Jordan HR Full time

    RESPONSIBILITIESYou will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis.Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms.Collaborating with cross-functional teams to understand data requirements and develop scalable...


  • Pretoria, South Africa Carlysle Human Capital Full time

    **ROLE PURPOSE**: To analyze (using data science methods) and provide expert advice with regards to data analytics in order to achieve business objectives. **MINIMUM REQUIREMENTS**: **Qualifications & Experience**: - ** **Relevant Bachelor's Degree / Advanced Diploma (NQF 8) - AND 8-10 years' experience in Data Engineering / Business Data Intelligence /...

  • Data Scientist

    4 days ago


    Pretoria, South Africa Curiska (Pty) Ltd Full time

    **Minimum education (essential)**: Bachelor's degree in Computer Science, Statistics, Mathematics, Actuarial Science or a related field. **Minimum education (desirable)**: Honors or Masters degree Computer Science, Statistics, Mathematics, or a related field. **Minimum applicable experience (years)**: 5 years **Required nature of experience**: - Proven...


  • Pretoria, South Africa Carlysle Full time

    **Gauteng**, Tshwane (Pretoria)** **Negotiable - Negotiable Monthly Basic Salary (Market related, Negotiable)** **Our client - Interfront (a global technology solutions provider that solely focuses on the Customs and Border Management business sphere) - is looking for a Senior Specialist in Data Analytics to join their team of data specialists.** **ROLE...

  • Data Scientist

    2 days ago


    Pretoria, South Africa The Hiring House Full time

    Minimum education (essential): Bachelor's degree in Computer Science, Statistics, Mathematics, Actuarial Science or a related field. Minimum education (desirable): Honors or Masters degree Computer Science, Statistics, Mathematics, or a related field. Minimum applicable experience (years): 5 years Required nature of experience: - Proven experience in...

  • Data Architect

    3 days ago


    Pretoria, South Africa Hi-Tech Recruitment Full time

    **Gauteng**, Pretoria** **R 900 000 - R 1 4000 Annually Cost To Company (Medical, pension and 13th cheque, Market related, Negotiable)** Your expertise in data modelling, data management, data analysis, as well as experience with data warehousing, data integration, and data security are the key to this role ! READ ON! - You will be designing and developing...

  • Chief Data Systems

    2 weeks ago


    Pretoria, South Africa Ambassador Human Resource Solution Full time

    A BSc Honours degree in Systems Engineering, Computer Science, Computer Systems or related qualification A Masters degree in Systems Engineering, Computer Science, Computer Systems or related qualification will be an added adv Solid background hands-on on designing and software development of large scale complex computer systems using any of the modern...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    Found in: Talent ZA 2A C2 - 3 weeks ago


    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    Found in: Whatjobs ZA C2 - 7 days ago


    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...


  • Pretoria, South Africa Kamo Placement Full time

    Gauteng, Tshwane (Pretoria) - Annually Cost To Company (Market related, Negotiable) The main purpose of this position is to assist the Data Modeller in improving data modelling and developing data maturity standards within the Financial Surveillance Department (FinSurv) to support quality-assured, cross border statistics for effective decision making **JOB...

  • Software Engineer: Radar Data Processing and Control

    Found in: beBee S ZA - 3 weeks ago


    Gauteng, Pretoria, South Africa Council for Scientific and Industrial Research Full time

    Council for Scientific and Industrial Research’s job vacancy, Career and Recruitment Job title : Software Engineer: Radar Data Processing and Control – Scientia, Pretoria (Hybrid) jobs in Gauteng Job Location : Gauteng, Pretoria Deadline : April 08, 2024 Quick Recommended Links Jobs by Location Job by industries About the job: The CSIR has a vacancy...

  • ELV Engineer

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa TAKORA Pty Ltd (Staffing, Talent Acquisition & Recruitment) Full time

    Minimum Requirements • Diploma or BTech BSc/MSc/ BEng/ in Electrical Engineering• Minimum of 3 to 5 years of relevant experience in the ELV /Built Environment , within the built environment, preferably within a consulting engineering businessRole Responsibilities• Provide support to a team of digital designers, engineers, technicians, and modellers•...

  • AWS Data Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashCloud Data Hub (CDH)CDEC BlueprintExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefactsKnowledge of...

  • AWS Data Engineer

    Found in: Whatjobs ZA C2 - 7 days ago


    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts...