Senior Data Engineer

4 days ago


Johannesburg, Gauteng, South Africa Indsafri Full time

Indsafri City of Johannesburg, Gauteng, South Africa

Exp Required: Atleast 6+ Years of relevant work experience as Data engineer - Python & cloud

Job Location: Johannesburg - Hybrid (need to go to office like 3 or 2 days in a week, rest of the days remote work)

Company Name: Indsafri

Notice Period: Immediate to 30 days of notice (More than 30 days of notice period please do not apply)

KINDLY DO NOT APPLY IF YOU HAVE LESS THAN 6+ YEARS OF RELEVANT WORK EXPERIENCE AS DATA ENGINEER IN PYTHON

KINDLY DO NOT APPLY IF YOU ARE A NON SOUTH AFRICAN CITIZEN. ONLY SOUTH AFRICA CITIZENS/PERSON WITH SOUTH AFRICA PR ID NO WILL BE PREFERRED AND CONSIDERED.

Description:

The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank's strategy to become a data driven organisation.

Job Responsibilities:

  • Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank's operational and analytics databases.
  • Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastructure.
  • Data Pipeline Build: Build and maintain data pipelines to create data pipelines for data integration.
  • Data Modelling and Schema Build: In collaboration with Data Modellers, create data models and database schemas.
  • Company Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines.
  • Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientists, and Data Warehouse teams.
  • Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented.
  • Performance and Optimisation: Ensure the performance of the client data warehouse.
  • API Development: Build APIs that enable the Data Driven Organisation.

Essential Qualifications:

  • Matric / Grade 12 / National Senior Certificate
  • Advanced Diplomas/National 1st Degrees

Preferred Qualification:

  • Field of Study: Bcom, BSc, Beng

Preferred Certifications:

  • Cloud (Azure, AWS), DEVOPS or Data engineering certification.

Minimum Experience Level:

  • Total number of years of experience: 6 years
  • Experience designing, building, and maintaining data warehouses and data lakes.
  • Experience with big data technologies such as Hadoop, Spark, and Hive.
  • Experience with programming languages such as Python, Java, and SQL.
  • Experience with relational databases and NoSQL databases.
  • Experience with cloud computing platforms such as AWS, Azure, and GCP.

Technical Knowledge (Must have Skills):

  • Data Warehousing
  • Programming (Python, Java, SQL)
  • Data Analysis and Data Modelling
  • Data Pipelines and ETL tools (Ab Initio, ADB, ADF, SAS ETL)

Note:

This is a permanent role. Its a full time role. Kindly do not apply if you are looking for part-time, freelancing or moon-lighting jobs.

Interested candidates can share your updated resume to priyadharshiny.karunakaran@indsafri.com with the below details:

Name:

Tot Exp:

Rel work exp in Data warehousing:

Do you have certification in Cloud (Azure, AWS), DEVOPS or Data engineering certification?:

Mob No:

Email id:

Willing to work for permanent role hybrid?:

Current salary (in monthly gross rands ZAR):

Expected salary ECTC (In monthly gross rands ZAR):

Any offers on hand:

Reason for leaving or job change:

Nationality:

Date of Birth:

WHY INDSAFRI:

We believe anything is possible. We have the potential to create and build anything we can imagine. If you have a challenging business problem we believe there is always a solution, with the right process, talents & technology anything is possible.

Website:

www.indsafri.com

Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Engineering, Information Technology, and Other
Industries
  • IT Services and IT Consulting, Software Development, and Staffing and Recruiting
#J-18808-Ljbffr

  • Johannesburg, Gauteng, South Africa Betway Group Full time

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline Design and DevelopmentSenior Data Engineers are proficient in designing and implementing scalable and efficient data pipelines. They use streaming technologies such as Apache Spark, Apache Kafka, or equivalent to extract, transform, and...


  • Johannesburg, Gauteng, South Africa Dynexity Full time

    Our client is seeking an experienced senior data engineer to join their team. Candidate must hold the necessary tertiary qualification and have extensive experience with SQL/SSIS packages.

  • Senior Data Engineer

    6 hours ago


    Johannesburg, Gauteng, South Africa PROVEN Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team, responsible for designing and implementing efficient database structures to support application and business needs.\


  • Johannesburg, Gauteng, South Africa Standard Bank Group Full time

    At Standard Bank Group, we are passionate about creating growth in Africa. As a Mid-Senior Level Data Engineering professional, you will play a crucial role in designing, coding, verifying, testing, documenting, amending, and securing data pipelines and data stores according to agreed architecture, solution designs, standards, policies, and governance...


  • Johannesburg, Gauteng, South Africa Eqplus Technologies (Pty) Ltd Full time

    **Job Description:**Senior Data Engineer for AWSWe are looking for an experienced Senior Data Engineer to join our team at Eqplus Technologies (Pty) Ltd. The successful candidate will be responsible for designing and implementing data warehousing solutions using AWS services.Key Responsibilities:Design and develop data pipelines using AWS Lambda, Step...

  • Data Analyst

    4 days ago


    Johannesburg, Gauteng, South Africa Data Bene Full time

    A vacancy exists for a Data Analyst within the Micro Merchant Division – Touchsides, in Rosebank, Johannesburg. The primary focus as Data Analyst is to collect, analyze, clean and interpret data sets across the business to make informed decisions. Utilize technical expertise to ensure data is accurate and high-quality.Key Responsibilities include, but are...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing and analytics systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines and systems.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    About the Job Data Centrix is looking for a seasoned professional to lead our security architecture efforts. As a Senior Security Solutions Architect, you will drive the development of comprehensive security strategies that protect our organization's assets. Your leadership skills will enable you to mentor and guide a team of security architects and...

  • Data Engineer

    4 days ago


    Johannesburg, Gauteng, South Africa CrossBoundary Group Full time

    Get AI-powered advice on this job and more exclusive features.About The FirmCrossBoundary Energy develops, owns, and operates distributed renewable energy solutions for businesses, offering cheaper and cleaner energy through power purchase and lease agreements. With a secured portfolio exceeding $680M, the company boasts over 500MW of solar PV and wind...


  • Johannesburg, Gauteng, South Africa Betway Group Full time

    About the RoleWe are looking for an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems and infrastructure.As a Senior Data Engineer at Betway Group, you will work closely with cross-functional teams to understand data...

  • Engineer, Data

    2 days ago


    Johannesburg, Gauteng, South Africa Standard Bank Group Full time

    Get AI-powered advice on this job and more exclusive features.Company DescriptionStandard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities – plus the chance to work alongside some of the sector's most talented, motivated professionals. Our...


  • Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...


  • Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...


  • Johannesburg, Gauteng, South Africa Data Bene Full time

    About the RoleThe Data Analyst will play a crucial role in driving business growth by providing insights and recommendations based on data analysis.Key Responsibilities include:Collecting, organizing, analyzing, and disseminating information to support business decision-makingResolving data queries, report writing, and presenting findings to...


  • Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    Data Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...


  • Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    Data Streaming Engineer WantedWe are looking for a Data Streaming Engineer to build and maintain our real-time data pipeline. In this senior role, you will develop data ingestion pipelines critical to the bank's growth and collaborate with teams to meet data needs.Key Responsibilities:Build and maintain real-time data pipelines.Work with infrastructure teams...


  • Johannesburg, Gauteng, South Africa Data Bene Full time

    About the JobWe are seeking a talented Data Analyst to join our team at Data Bene. The successful candidate will be responsible for analyzing complex data sets and providing insights to inform business decisions.Key Responsibilities include:Collecting, organizing, and analyzing data to support business decision-makingDeveloping and maintaining databases and...


  • Johannesburg, Gauteng, South Africa Data Centrix Full time

    Key Responsibilities:Define and implement data classification, data loss prevention (DLP), and encryption standards.Work with business units to identify sensitive data flows and implement appropriate controls.Oversee data privacy and compliance efforts (GDPR, local data protection regulations, IP protection requirements).Collaborate with IT, OT, and legal...


  • Johannesburg, Gauteng, South Africa Psybergate (Pty) Ltd Full time

    Senior Data Engineer RolePsybergate (Pty) Ltd is a leading provider of bespoke software solutions and skilled resources to its clients. We are seeking a highly skilled Senior Data Engineer to join our team in Sandton for a 12-month contract role.About the PositionThe successful candidate will be responsible for designing and implementing data integration...