Intermediate Data Engineer

2 months ago


Cape Town, South Africa Boardroom Appointments Full time

Intermediate Data Engineer

Minimum Requirements:

  • Matric (Grade 12)
  • Masters in Software Engineering, Data Engineering, Computer Science or related field
  • 2-3 years of relevant work experience
  • Strong Scala or Java background
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Understanding of data modeling principles
  • Ability to work with complex data models
  • Experience with relational and NoSQL databases (e.g. Postgres, ElasticSearch/OpenSearch, graph databases such as Neptune or neo4j)
  • Experience with technologies that power analytics (Spark, Hadoop, Kafka, Docker, Kubernetes) or other distributed computing systems
  • Knowledge of API development and machine learning deployment

Responsibilities:

  • Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architecture
  • Build scalable data ingestion and machine learning inference pipelines
  • Build general-purpose APIs to deliver data science outputs to multiple business units
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data



  • Data Engineer

    3 months ago


    Cape Town, South Africa Dimension Data Full time

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and objectives. Your role will involve: - Analyzing business requirements; -...


  • Cape Town, South Africa Black Swan Data Full time

    Summary: We are seeking an experienced and passionate DevOps Engineer with a strong background in Kubernetes, AWS, and Linux to join our team. As an Intermediate DevOps Engineer, you will play a critical role in designing, implementing, and maintaining our cloud infrastructure, with a focus on Kubernetes-based container orchestration, AWS services, and...


  • Cape Town, South Africa Inspired Testing Full time

    Intermediate Quality Engineer Location: Johannesburg/Cape Town, South Africa Full-time About Us: Inspired Testing is a leading innovative and forward-thinking quality engineering and software testing consultancy. Our teams of exceptional consultants and engineers provide solutions that help our customers deliver...


  • Cape Town, South Africa OfferZen Full time

    Intermediate .NET EngineerAre you a talented intermediate .NET engineer looking for your Dream Developer Job? OfferZen, the developer jobs marketplace, reverses the job search process. We connect developers with a vast network of top tech companies that are eager to apply to interview you!This could be the last job posting you ever have to click on! Why...


  • Cape Town, South Africa OfferZen Full time

    Intermediate Frontend EngineerAre you a talented intermediate frontend engineer looking for your Dream Developer Job? OfferZen, the developer jobs marketplace, reverses the job search process. We connect developers with a vast network of top tech companies that are eager to apply to interview you!This could be the last job posting you ever have to click on!...

  • Data Engineer

    3 months ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate Data Engineers skilled in AWS, SQL, Oracle, legacy systems, infrastructure, Cobol. Duties:Design, develop, test and deploy ETL for ODS and data mart projects, as well as application and management reports.Provide technical support, troubleshooting and upgrade setup or support on ETL and database related...


  • Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingResponsible for developing and maintaining daily, weekly and monthly MIS reports as well as data flows. Duties include supporting clients with regard to ad-hoc reports and queries. Responsibilities include the coordination and management of changes to the MIS database, the streamlining of MIS reports and ETL processes across the business....

  • DevOps Data Engineer

    3 months ago


    Cape Town, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, Delta.io, RedShift, Lambda, DeltaLake,...


  • Cape Town, South Africa Anthesis Group Full time

    **About Anthesis** Anthesis is the sustainability activator. Proud to be a B Corp, we seek to make a significant contribution to a world which is more resilient and productive. We do this by working with cities, corporates, investors and other organisations to drive sustainable performance. We develop financially driven sustainability strategies, underpinned...


  • Cape Town, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    As an Amazon Field Engineer, you will provide full life-cycle support to AWS Data Centers from design inception through site improvement and maintenance. You will be the ‘go to’ engineering resource for your region when technical advice is needed, and will use your subject matter expertise and engage with diverse teams to:• Perform design and equipment...


  • Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want to work for an awesome company? Are you looking for a job that combines flexibility with great benefits and opportunities? My client is looking to hire a Project Manager who wants the same. Apply now!As an Intermediate Project Manager, you'll be responsible for managing a number of projects in order to meet the requirements and...

  • Data Engineer

    2 months ago


    Cape Town, South Africa Betway Group Full time

    On average it takes 5 minutes to apply for this role.Kick-start your career in the online gaming world and experience the very latest in technology and innovation. Do you see yourself as one of those “out-of-the-box thinkers”, “Technical masterminds”, “Outstanding creatives”, or “Mind-boggling number crunchers”? If so, we want to welcome you...

  • Data Center Operations

    3 months ago


    Cape Town, South Africa Dimension Data Full time

    FunctieomschrijvingDo you want greater control over your own career? We believe this Data Centre Operations role was created for you! Please read through and apply!Data Centre Operations (DCO) person: Data Centre - manages the operational day to day tasks onsite and assists the Site Manager/ Senior Operations Manager in operational tasks such as budgeting,...

  • Data Engineer

    3 months ago


    Cape Town, South Africa Initiate International Full time

    Join our client’s dynamic team as a Data Engineer in Cape Town, where you’ll design and develop resilient data frameworks and create data services that deliver actionable insights to our client’s global clientele. Our client champions a culture of innovation, continuous improvement, and collaboration. Embrace technical challenges, unleash your...

  • Data Engineer

    2 months ago


    Cape Town, South Africa Sanlam Full time

    What will you do? Job Summary:  As a Data Engineer, you will lead the design and implementation of robust data pipelines and architectures. You will drive the development of data strategies, mentor junior team members, and ensure the scalability and efficiency of our data infrastructure.  Responsibilities:  Lead the design and development of...

  • Sales Engineer

    3 months ago


    Cape Town, South Africa Career Dynamics Global Full time

    Sales Engineer (Junior/Intermediate)Engineering/Technical – Marine & Land based.Highly Negotiable Salary package + Benefits (Basic based on Experience)Opportunity in Cape Town, join well-Established Sole Service Provider to Africa.Sales and Services Marine/Land Engineering products – Propellers & auxiliary engines, land-based generators.Working with...


  • Cape Town, South Africa Amazon Data Services South Africa (Pty) Ltd Full time

    As an Amazon Field Engineer, you will provide full life-cycle support to AWS Data Centers from design inception through site improvement and maintenance. You will be the ‘go to’ engineering resource for your region when technical advice is needed, and will use your subject matter expertise and engage with diverse teams to:•Perform design and equipment...

  • Data Scientist

    3 months ago


    Cape Town, South Africa FirstRand Full time

    Job Description To plan, build, optimise and implement innovative quantitative analytical methodologies, procedures, products and advanced mathematical models that provide analytical support and interpret insights, to address business opportunities and problems and implement business strategy, with mínimal guidance. Hello, Data Scientist Welcome to FNB,...

  • Data Engineer

    3 months ago


    Cape Town, South Africa Creative CFO Full time

    Become part of a vibrant, quality-focused team that leverages trust and autonomy to deliver exceptional services to diverse, high-growth clients. Receive recognition for your committed, results-producing approach to problem-solving, and opportunities for learning to realise your own passion for personal growth. All while working with some of the country's...

  • Data Engineer

    3 months ago


    Cape Town, South Africa IOCO Full time

    We're looking for a Data Engineer to join our Cape Town based team.  The successful person must be based in Cape Town as there will be a requirement to go into the office 3 times per week.  This will be for an initial 12 month contract.  The purpose of this position is modelling data to provide clean, accurate datasets so that different users within...