Senior Data Engineer

4 weeks ago


Johannesburg, Gauteng, South Africa Indsafri Full time

Indsafri City of Johannesburg, Gauteng, South Africa

Exp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloud

Job Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)

Company Name: Indsafri

Notice Period: Immediate to 30 days of notice (More than 30 days of notice period please do not apply)

KINDLY DO NOT APPLY IF YOU HAVE LESS THAN 6+ YEARS OF RELEVANT WORK EXPERIENCE AS DATA ENGINEER IN PYTHON

KINDLY DO NOT APPLY IF YOU ARE A NON SOUTH AFRICAN CITIZEN. ONLY SOUTH AFRICA CITIZENS/PERSON WITH SOUTH AFRICA PR ID NO WILL BE PREFERRED AND CONSIDERED.

Description:

The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank's strategy to become a data driven organisation.

Job Responsibilities:

  • Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank's operational and analytics databases.
  • Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastructure.
  • Data Pipeline Build: Build and maintain data pipelines to create data pipelines for data integration.
  • Data Modelling and Schema Build: In collaboration with Data Modellers, create data models and database schemas.
  • Company Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines.
  • Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientists, and Data Warehouse teams.
  • Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented.
  • Performance and Optimisation: Ensure the performance of the client data warehouse.
  • API Development: Build APIs that enable the Data Driven Organisation.

Essential Qualifications:

  • Matric / Grade 12 / National Senior Certificate
  • Advanced Diplomas/National 1st Degrees

Preferred Qualification:

  • Field of Study: Bcom, BSc, Beng

Preferred Certifications:

  • Cloud (Azure, AWS), DEVOPS or Data engineering certification.

Minimum Experience Level:

  • Total number of years of experience: 6 years
  • Experience designing, building, and maintaining data warehouses and data lakes.
  • Experience with big data technologies such as Hadoop, Spark, and Hive.
  • Experience with programming languages such as Python, Java, and SQL.
  • Experience with relational databases and NoSQL databases.
  • Experience with cloud computing platforms such as AWS, Azure, and GCP.

Technical Knowledge (Must have Skills):

  • Data Warehousing
  • Programming (Python, Java, SQL)
  • Data Analysis and Data Modelling
  • Data Pipelines and ETL tools (Ab Initio, ADB, ADF, SAS ETL)

Note:

This is a permanent role. Its a full time role. Kindly do not apply if you are looking for part-time, freelancing or moon-lighting jobs.

Interested candidates can share your updated resume to priyadharshiny.karunakaran@indsafri.com with the below details:

Name:

Tot Exp:

Rel work exp in Data warehousing:

Do you have certification in Cloud (Azure, AWS), DEVOPS or Data engineering certification?:

Mob No:

Email id:

Willing to work for permanent role hybrid?:

Current salary (in monthly gross rands ZAR):

Expected salary ECTC (In monthly gross rands ZAR):

Any offers on hand:

Reason for leaving or job change:

Nationality:

Date of Birth:

WHY INDSAFRI:

We believe anything is possible. We have the potential to create and build anything we can imagine. If you have a challenging business problem we believe there is always a solution, with the right process, talents & technology anything is possible.

Website:

www.indsafri.com

Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Engineering, Information Technology, and Other
Industries
  • IT Services and IT Consulting, Software Development, and Staffing and Recruiting
#J-18808-Ljbffr

  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data engineering, analytics, and cloud-based...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a seasoned Senior Data Engineer/Analyst to lead our data engineering efforts.About the RoleThe ideal candidate has strong experience in data engineering, analytics, and cloud-based technologies, with expertise in SQL, Python, ETL processes, and big data platforms.ResponsibilitiesDesign and implement data pipelines for data ingestion,...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year contractHybrid RoleJohannesburgJob Summary We are seeking a highly skilled Senior Data Engineer/Analyst to join our dynamic team. This role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making. The ideal candidate has strong experience in data...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    As a Senior Data Science Specialist at Gig Engineer, you will play a critical role in driving data-driven decision-making across the organization. This senior-level position requires expertise in designing, building, and maintaining scalable and efficient ETL pipelines for data ingestion, transformation, and storage.Data Engineering & ArchitectureDesign and...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer seeks a highly skilled Senior Data Engineer/Analyst to join our dynamic team.Job DescriptionThis role will focus on designing, building, and maintaining data pipelines, analyzing large datasets, and providing key insights to drive data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable and efficient ETL pipelines...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are seeking a highly skilled Senior Data Engineer/Analyst to join our team of data professionals.About the JobThis role will focus on designing, building, and maintaining data pipelines, as well as analyzing large datasets to provide key insights.Key ResponsibilitiesDesign and develop ETL pipelines for data ingestion, transformation, and storage.Build and...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is hiring a Senior Machine Learning Engineer to lead the development of cutting-edge machine learning models.The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing scalable AI solutions.Key Responsibilities:Develop and optimize machine learning models for...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    3 Year ContractHybrid RoleJohannesburgJob Summary:We are seeking an experienced Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models. The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    The Cloud Data Architect will be responsible for designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureEnsure data quality, integrity, and security across all data processing workflows.Implement data governance,...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a talented Senior Data Engineer/Analyst to join our team.Role OverviewThe successful candidate will be responsible for designing, building, and maintaining data pipelines, as well as analyzing large datasets to provide key insights.Main ResponsibilitiesDevelop and implement ETL pipelines for data ingestion, transformation, and...

  • Cloud Data Architect

    2 weeks ago


    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a skilled Big Data and AI Developer to join our team. The ideal candidate has strong experience in data engineering, analytics, and BI development, with expertise in SQL, Python, ETL processes, and big data platforms.Data Engineering & ArchitectureDesign, develop, and maintain scalable and efficient ETL pipelines for data ingestion,...

  • Senior AI Developer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is looking for an experienced Senior Machine Learning Engineer to join our team.The successful candidate will have a strong background in machine learning, deep learning, and software engineering, as well as experience in designing scalable AI solutions.Job Summary:Design, develop, and optimize machine learning models for real-world...


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    We are looking for a talented Cloud Data Architect to lead our cloud-based data solutions. The successful candidate will have experience in designing and managing cloud-based data solutions (AWS, Azure, GCP) with services such as AWS Glue, Azure Data Factory, Google BigQuery, Snowflake, and Databricks.Data Engineering & ArchitectureCollaborate with Data...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the RoleThe Senior ISP Network Engineer at Dimension Data designs and implements complex data networks across multiple locations. This role involves close collaboration with business teams to provide innovative solutions to their network challenges. Additionally, the engineer works with partners on vendor projects or in-house engineering...

  • Senior Data Engineer

    4 weeks ago


    Johannesburg, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...

  • Senior Data Engineer

    3 weeks ago


    Johannesburg, Gauteng, South Africa Liyema Consulting Full time

    Job Title: Senior Data EngineerReference: JHB001499-FE-1Type: PermanentLocation: Gauteng, JohannesburgAbout Us:We're a leading data solutions firm in South Africa, dedicated to fostering equality through actionable insights.Responsibilities:As a Senior Data Engineer, you'll be tasked with designing robust data architectures, managing seamless pipelines,...

  • Senior Data Engineers

    3 weeks ago


    Johannesburg, Gauteng, South Africa DVT Full time

    DVT is a software development, technology consulting and related services company, with offices in Cape Town, Johannesburg, Durban, UK, Kenya, Ireland and Switzerland with over 600 staff. We employ highly - skilled individuals in the fields of Software Development (.Net, Mobile and Java), Business Intelligence, Business Analysis, Agile Consulting, Solution...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    The Senior ISP Network Engineer, DSL & Telephone Cable Networks, Data Center (DC), Integrated services provider (ISP), MPLS, ACI, SDA, CORE, IP Networks will be responsible for designing and implementing complex data networks across multiple locations. The role involves working closely with business teams to provide solutions to their network challenges....


  • Johannesburg, Gauteng, South Africa Gig Engineer Full time

    Gig Engineer is seeking a Senior Machine Learning Engineer to drive the development, deployment, and optimization of cutting-edge machine learning models.The ideal candidate will have a strong background in machine learning, deep learning, and software engineering, along with experience in designing scalable AI solutions.Key Responsibilities:Model...


  • Johannesburg, Gauteng, South Africa DVT Full time

    About the RoleThe Senior Data Engineer will collaborate closely with cross-functional teams to ensure data pipelines are efficient, reliable, and aligned with business objectives within our clients.Develop and maintain optimal data pipeline architectureCollaborate with data scientists and business analysts to meet functional data requirementsAssist the Lead...