See more Collapse

Big Data Engineer- Johannesburg

1 month ago

Johannesburg, South Africa E-Merge Full time

Leading Financial Services group specialising in investment banking and global markets is seeking an experienced Big Data Engineer.

Do you have more than 5 years of professional working experience with Hadoop and Kafka?

''Can you serve as an expert in supporting and developing, implementing and managing enterprise infrastructure.

If this sounds like you, and you know you can be a value add to our business, APPLY NOW

Requirements:

  • Min 5 years development experience
  • Strong technical / programming experience
  • Development and deployment of data applications
  • Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
  • Creation of data ingestion pipelines between legacy data warehouses and the big data stack
  • Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
  • Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools
  • Automation of application back-end workflows
  • Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

Qualifications:

  • Bachelors degree, BSc or B.Com (Postgrad or Masters preferred)

The Reference Number for this position is MM56791 which is a Permanent position based at their client in Johannesburg offering a salary of up to R650k Per Annum

We have other current jobs related to this field that you can find below

  • Big Data Engineer- Johannesburg

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Leading Financial Services group specialising in investment banking and global markets is seeking an experienced Big Data Engineer.Do you have more than 5 years of professional working experience with Hadoop and Kafka?''Can you serve as an expert in supporting and developing, implementing and managing enterprise infrastructure.If this sounds like you, and...

  • Big Data Architect

    2 weeks ago

    Johannesburg, South Africa Prorek Full time

    5+ years of technical solutions experience including 3+ years of in a combination of relevant Big Data/Analytics areas including: - Enterprise Business Intelligence and Analytics (e.g., SAP, Oracle, Teradata) - Hadoop and other Industry BigData Frameworks - Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data...

  • BI Big Data Engineer – Johannesburg – up to R950k per annum

    4 weeks ago

    Johannesburg, South Africa E-Merge Full time

    An expert in integrated corporate benefits well known for outstanding usability and integration within the banking space is looking for a specialist capable of working within the capacity of a BI Big Data Engineer who will be responsible for building and maintaining data pipelines for new data in a variety of formats using an optimal orchestration method...

  • Big Data Product Owner Specialist

    2 weeks ago

    Johannesburg, Gauteng, South Africa Vodafone Full time

    Role purpose:As product Manager for Big Data, you will work with various senior stakeholder in the international business. You be responsible for keeping track of the Big Data and AI agenda for Vodacom International. This will mean Big Data requirements gathering and tracking of the success.Your responsibilities will include:Creation of the Big Data Road Map...

  • Data Engineering Lead(Big Data)

    3 weeks ago

    Johannesburg, South Africa Adcorp Holdings Full time

    **Roles and Responsibilities** Internal Process** - Responsible for the end-to-end technical solution. This means that key decisions, once discussed and debated, are appropriately understood, and implemented. - Collaborate with the Product Development Lead and the Business Enablement Lead to ensure that all stakeholder expectations are met. - Ensure that the...

  • Big Data Architect

    2 weeks ago

    Johannesburg, Gauteng, South Africa Prorek Full time

    5+ years of technical solutions experience including 3+ years of in a combination of relevant Big Data/Analytics areas including:Enterprise Business Intelligence and Analytics (e.g., SAP, Oracle, Teradata) Hadoop and other Industry BigData Frameworks Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data Center...

  • Data Engineer

    4 weeks ago

    Johannesburg, South Africa NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Big Data Architect

    3 weeks ago

    Johannesburg, South Africa PBT Group Full time

    PBT Group has an opportunity for a Big Data Architect. In this position you have the opportunity to help lead the change on operational strategy and your responsibilities will include to validate the reference architecture and provide details for the architecture of platforms, leading and working hands on towards implementation and delivery to production of...

  • Data Engineering Lead(Big Data)

    1 month ago

    Johannesburg, South Africa TalentCru Full time

    The purpose of this role is to lead the technical delivery team, using experience to deliver right sized and well architected solutions in order to meet targets. The successful candidate will be expected to use their experience working in Azure to understand the available technology choices and selectively implement services safely and securely. As well as...

  • AWS Data Engineer

    2 weeks ago

    Johannesburg, South Africa E-Merge Full time

    Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently...

  • AWS Data Engineer

    2 weeks ago

    Johannesburg, South Africa E-Merge Full time

    Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently...

  • Data Engineer

    4 days ago

    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    A leading Group in Southern Africa providing innovative financial services have an opportunity for a Data Engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust and trustworthy data to support high performing ML algorithms, predictive models and support real-time data...

  • AWS Data Cloud Engineer

    4 weeks ago

    Johannesburg, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications  High knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companiesDemonstrated project development and leadership skillsMaster's degree in...

  • AWS Data Cloud Engineer

    4 weeks ago

    Johannesburg, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer)  Knowledge /Qualifications   High knowledge in AWS – security groups, permissions, VPC, roles, services. Experience developing engineering applications in Corporate companies Demonstrated project development and leadership skills Master's degree...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Mimecast Limited Full time

    Data Engineer (SQL experience essential) page is loaded Data Engineer (SQL experience essential) Apply locations South Africa - Johannesburg time type Full time posted on Posted 3 Days Ago job requisition id R4508 Analytics Engineer We're your dream business intelligence team The Business Intelligence & Analytics team at Mimecast is an exciting blend of...

  • AWS Data Cloud Engineer

    1 month ago

    Johannesburg, South Africa Adzuna ZA B C2 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications  High knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companiesDemonstrated project development and leadership skillsMaster's degree in...

  • AWS Data Cloud Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa GoldenRule Technology (Pty) Ltd Full time

    The RoleA leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer)Skills And ExperienceKnowledge /Qualifications High knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companiesDemonstrated project development and leadership...

  • Data Governance Lead – Johannesburg

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    This industry leading insurance company is urgently seeking a Data Governance Lead to join their ranks. The main goal of this position is to implement a Data Governance Operating Framework for the organisation, emphasizing the enhancement of data governance and data quality by adjusting organizational behaviour, policies, standards, principles, governance...

  • Data Engineer

    4 weeks ago

    Johannesburg, South Africa E-Merge Full time

    A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust and trustworthy data to support high performing ML...