Current jobs related to Big Data Solutions Architect - Johannesburg, Gauteng - Eqplus Technologies (Pty) Ltd

  • Big Data Architect

    4 days ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job Description:A skilled Data Engineer is required by Network Recruitment to design, build, and optimize data pipelines for real-time and batch processing. The ideal candidate will have a strong passion for big data, cloud technologies, and scalable solutions.Key Qualifications:Bachelor's Degree in Computer Science, Computer Engineering, or a related...


  • Johannesburg, Gauteng, South Africa Golden Rule Full time

    About the Role:We are seeking an experienced Big Data Streaming Architect to lead the design and implementation of our real-time data pipeline. As a key member of our team, you will be responsible for architecting and implementing scalable data solutions that meet the needs of our business.Responsibilities:Data Pipeline Design: Design and develop scalable...


  • Johannesburg, Gauteng, South Africa Paracon Full time

    About the RoleWe are looking for an experienced Cloud Data Architect to join our team in Johannesburg. As a key member of our data platform, you will be responsible for designing and implementing large-scale enterprise data solutions on the AWS cloud.The ideal candidate will have hands-on experience with AWS cloud services, proficiency in SQL, Python, and...

  • Solutions Architect

    17 hours ago


    Johannesburg, Gauteng, South Africa Dimension Data Full time

    We are looking for a Solutions Architect to assist in the operations of our organization. The Solutions Architect's responsibilities include improving the current IT infrastructure, optimizing business operations, and setting the direction and approach for integrating information applications and programs. The Solutions Architect is also responsible for...


  • Johannesburg, Gauteng, South Africa Paracon Full time

    Paracon is seeking a skilled Data Engineering Specialist to join our team in Johannesburg. As a key member of our data platform, you will be responsible for architecting and deploying innovative data solutions on the AWS cloud.The ideal candidate will have hands-on experience with AWS cloud services, proficiency in SQL, Python, and PySpark, as well as...


  • Johannesburg, Gauteng, South Africa Liberty Group Limited Full time

    About the RoleThis is an exciting opportunity to join our team at Liberty Group Limited as a Cloud Data Architect. The successful candidate will be responsible for designing and implementing large-scale enterprise data solutions using a combination of technologies including AWS Glue, Step-functions, RedShift, Lambda, Athena, Lakeformation, Spark, and...


  • Johannesburg, Gauteng, South Africa DVT Full time

    We are seeking a seasoned data engineer to lead the development of large-scale data processing systems. The ideal candidate will have a strong technical background in big data technologies, cloud-based data solutions, and data pipeline orchestration.Key Skills and QualificationsProficient in big data technologies such as Apache Hadoop, Spark, and...


  • Johannesburg, Gauteng, South Africa Endeavour Recruitment Solutions Full time

    Endeavour Recruitment are delighted to be assisting a leading international technology company in their search for a Solutions Architect. The position will be based out of their offices in Johannesburg, South Africa.With a global client base, our client is a Google Enterprise partner, specialising in the implementation of cloud and mobility solutions. They...


  • Johannesburg, Gauteng, South Africa Liberty Group Limited Full time

    The Job DescriptionWe are seeking a Big Data Engineering Professional to join our team at Liberty Group Limited. The successful candidate will be responsible for designing and implementing large-scale enterprise data solutions using a combination of technologies including AWS Glue, Step-functions, RedShift, Lambda, Athena, Lakeformation, Spark, and...

  • Solution Architect

    17 hours ago


    Johannesburg, Gauteng, South Africa Mindworx Consulting Full time

    Job Responsibilities:Define and design solutions that encompass all architecture domains and align with business requirements, enterprise architecture principles, and ICT standards to ensure standardization and risk management.Review and ensure solution architecture designs provide seamless integration, scalability, and security in accordance with the...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a leading provider of innovative IT solutions and is seeking a highly skilled Data Engineer/Scientist to join our team. The successful candidate will have a strong background in software development, mathematics, and analytics, with expertise in machine learning and cloud platforms.Key Responsibilities:Develop and integrate data science solutions...

  • Big Data Specialist

    5 days ago


    Johannesburg, Gauteng, South Africa Tower Group (Pty) Ltd Full time

    Tower Group (Pty) Ltd is committed to delivering high-quality services to our clients. We are now seeking a Big Data Specialist to join our team and help us achieve this goal.The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and NoSQL databases. They will be responsible for designing and implementing data...

  • Solution Architect

    3 weeks ago


    Johannesburg, Gauteng, South Africa Mindworx Consulting Full time

    Key Performance Areas:What do you have to be able to do to achieve the desired results of your job?Include management and leadership responsibilities for work team leadersSolution Architecture:Define and design solutions that encompass all architecture domains and in line with business requirements, enterprise architecture principles and ICT standards to...

  • Solution Architect

    1 week ago


    Johannesburg, Gauteng, South Africa Mindworx Consulting Full time

    Key Performance Areas:What do you have to be able to do to achieve the desired results of your job?Include management and leadership responsibilities for work team leadersSolution Architecture:Define and design solutions that encompass all architecture domains and in line with business requirements, enterprise architecture principles and ICT standards to...


  • Johannesburg, Gauteng, South Africa BSG Full time

    We are looking for highly skilled Data Engineers to join our team at BSG. Our vision is to design and build innovative data platforms that drive business growth and success.The successful candidate will work closely with cross-functional teams to architect, develop, and deploy enterprise-grade data solutions using a range of technologies including SQL,...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    We are seeking a Linux and Kubernetes Engineer with expertise in big data solutions to join our team at E-Merge.You will be responsible for designing, implementing, and maintaining Linux and Kubernetes environments to support our big data projects.Key Responsibilities:Designing and implementing Linux and Kubernetes environments for big data projectsEnsuring...


  • Johannesburg, Gauteng, South Africa Business Systems Group Full time

    We are looking for an experienced Architect to join our Data and Analytics (DnA) Capability.Our Johannesburg office is situated in Houghton Estate, within walking distance of the Rosebank Gautrain station.Location: JohannesburgThis role will be based in our Johannesburg office and at client sites, as needed in line with project requirements. BSG subscribes...

  • Data Architect

    22 hours ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge is a leading provider of information technology services, offering strategic consulting to clients in various industries. We are currently seeking a talented Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data solutions, including data acquisition, data management, and data analysis.The...

  • Data Architect

    4 weeks ago


    Johannesburg, Gauteng, South Africa Sappi Full time

    Job title : Data ArchitectJob Location : Gauteng, JohannesburgDeadline : March 24, 2025Quick Recommended LinksJobs by Location Job by industries As a Data Architect, you will be responsible for: Data ArchitectureTranslate business requirements from all regions and areas of the business into architectural requirements and technical specifications, including...

  • Solution Architect

    17 hours ago


    Johannesburg, Gauteng, South Africa Planet10 Full time

    The ideal candidate will have a diverse background in delivering business value using technology. As a consultant solution architect, we require an individual that is able to adapt quickly to new and varied project environments and provide meaningful and valuable contributions at all stages of the project lifecycle; including:Solution requirements...

Big Data Solutions Architect

2 weeks ago


Johannesburg, Gauteng, South Africa Eqplus Technologies (Pty) Ltd Full time
Job Overview

Eqplus Technologies (Pty) Ltd is seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing and implementing ETL/ELT methodologies and technologies to maintain our data warehouse. You will also provide maintenance and support to our ETL and ML environments.

Main Responsibilities
  • Design and develop various functionalities in AWS for the project flow.
  • Develop and maintain automated ETL pipelines using scripting languages such as Python, SQL, and AWS services like S3, Glue, Lambda, SNS, Redshift, SQS, KMS.
  • Develop Glue Jobs for batch data processing and create Glue Catalog for metadata synchronization.
  • Develop data pipelines using AWS Lambda and Step Functions for data processing.
  • Manage data coming from different sources.
  • Experience with AWS services to manage applications in the cloud and create or modify instances.
  • Implement solutions using the Scaled Agile Framework (SAFe).
  • Be involved in the performance and optimization of existing algorithms in Hadoop using Spark Context.
  • Create Hive Tables, load data, and write Hive queries.

Requirements
  • Degree in Information Technology.
  • 6-7 years of experience in a similar role.
  • Experience with Talend.
  • Knowledge of SSIS, SSAS, and SSRS.
  • Experience with Clover ETL.
  • Strong SQL background.
  • Experience with AWS.
  • Familiarity with Jupyter Notebook.
  • Experience in Data Warehousing.
  • Experience in Cloud Warehousing.