Big Data Engineer- Johannesburg

2 weeks ago


Johannesburg, Gauteng, South Africa E-Merge Full time

Leading Financial Services group specialising in investment banking and global markets is seeking an experienced Big Data Engineer.

Do you have more than 5 years of professional working experience with Hadoop and Kafka?

''Can you serve as an expert in supporting and developing, implementing and managing enterprise infrastructure.

If this sounds like you, and you know you can be a value add to our business, APPLY NOW

Requirements:

  • Min 5 years development experience
  • Strong technical / programming experience
  • Development and deployment of data applications
  • Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
  • Creation of data ingestion pipelines between legacy data warehouses and the big data stack
  • Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
  • Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools
  • Automation of application back-end workflows
  • Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

Qualifications:

  • Bachelors degree, BSc or B.Com (Postgrad or Masters preferred)

The Reference Number for this position is MM56791 which is a Permanent position based at their client in Johannesburg offering a salary of up to R650k Per Annum



  • Johannesburg, Gauteng, South Africa Vodafone Full time

    Role purpose:As product Manager for Big Data, you will work with various senior stakeholder in the international business. You be responsible for keeping track of the Big Data and AI agenda for Vodacom International. This will mean Big Data requirements gathering and tracking of the success.Your responsibilities will include:Creation of the Big Data Road Map...

  • Big Data Architect

    2 weeks ago


    Johannesburg, Gauteng, South Africa Prorek Full time

    5+ years of technical solutions experience including 3+ years of in a combination of relevant Big Data/Analytics areas including:Enterprise Business Intelligence and Analytics (e.g., SAP, Oracle, Teradata) Hadoop and other Industry BigData Frameworks Underlying infrastructure for Big Data Solutions (Clustered/Distributed Computing, Storage, Data Center...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    A leading Group in Southern Africa providing innovative financial services have an opportunity for a Data Engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust and trustworthy data to support high performing ML algorithms, predictive models and support real-time data...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Mimecast Limited Full time

    Data Engineer (SQL experience essential) page is loaded Data Engineer (SQL experience essential) Apply locations South Africa - Johannesburg time type Full time posted on Posted 3 Days Ago job requisition id R4508 Analytics Engineer We're your dream business intelligence team The Business Intelligence & Analytics team at Mimecast is an exciting blend of...


  • Johannesburg, Gauteng, South Africa E-Merge Full time

    This industry leading insurance company is urgently seeking a Data Governance Lead to join their ranks. The main goal of this position is to implement a Data Governance Operating Framework for the organisation, emphasizing the enhancement of data governance and data quality by adjusting organizational behaviour, policies, standards, principles, governance...

  • Engineer, Data X2

    2 weeks ago


    Johannesburg, Gauteng, South Africa Standard Bank Of South Africa Limited Full time

    Business Segment: Corporate & Investment Banking Location: ZA, GP, Johannesburg, Simmonds Street 6 To design, code, verify, test, document, amend, and secure data pipelines and data stores according to agreed architecture, solution designs, standards, policies and governance requirements. To monitor and report on own progress and proactively identify issues...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa PRR Recruitment Services Full time

    This well known company is looking for a Data Engineer. will be based in Rivonia The ideal candidate will have strong experience in the following: Data cleaning SQL ExportBig data Sets BSc Degree in Maths and Stats will be required a min of 3 years experience. Stable track record is required. Send your Cv to

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa E-Merge Full time

    A top Group in Southern Africa specialized in cutting-edge financial services has an opening for a Data Engineer who will be accountable for steering, planning, and constructing scalable ETL systems for a large data warehouse to deploy robust and reliable data to back high-performing ML algorithms, predictive models, and real-time data visualization needs...

  • Cloud Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Planet10 Full time

    A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company's Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Nedbank Full time

    Requisition Details & Talent Acquisition Consultant REQ Thembi MtshaliJob FamilyRisk, Audit and ComplianceCareer StreamAuditingLeadership PipelineManage Self: ProfessionalJob PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Nedbank Full time

    Requisition Details & Talent Acquisition ConsultantREQ Keabetswe ModiseJob FamilyInformation TechnologyCareer StreamData Leadership PipelineManager of Self ProfessionalJob PurposeThe purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Nedbank Data Architecture Roadmap, to advance technical thought...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Recru-it Full time

    Job Purpose: The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Welcome to our Data Engineering team at XYZ Company!Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field (Master's degree preferred)Requirements: 5+ years of solid experience in data engineeringStrong background in data warehousing and data lake architectureProficiency in Data Vault and dimensional modeling...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Snaphunt Full time

    The OfferGreat work environmentThe Job You will be responsible for : Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with stakeholders to understand needs...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa JCM Consultants Full time

    Our client is an IT company looking for the best talent to join their dynamic team. They are a hard-working, fun-loving bunch that knows how to get the job done with a smile. The Role You will be responsible for : Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability,...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Energy At Work Full time

    Job Title: Data Engineer (SAS)Location: RemoteAbout Our Client: Our client is a leading player in the insurance industry, dedicated to providing innovative solutions to meet the needs of our clients. They leverage cutting-edge technology to drive their business forward and are seeking a skilled Data Engineer to join their dynamic team. If you are passionate...

  • Data Engineer

    2 weeks ago


    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Job Title: Data Infrastructure Engineer at [Company Name]Requirements:Experience building enterprise standard ETL/ELT processes, data lakes, and using code-based techniques in collaborative environmentsProficiency in Agile development, utilizing tools like Jira and GitFamiliarity with multiple software development languagesProficiency in Python, Bash/Shell...

  • Data Engineering Lead

    2 weeks ago


    Johannesburg, Gauteng, South Africa Datafin Full time

    ENVIRONMENT:A leading global Digital Solutions Tech company is seeking a young and vibrant Data Engineering Lead who will be responsible for providing advisory and thought leadership on the provision of analytics environments leveraging Cloud based platforms, big data technologies, including integration with existing data and analytics platforms and tools....