Data Platform Engineer

5 days ago

Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R46 800 - R3 000 000 per year


Data Platform Engineer - 12 Month Contract

Key Responsibilities
Platform Engineering & Development
  • Design, implement, and maintain Big Data platforms (e.g., Hadoop, Spark, Kafka) used across the CIB environment.
  • Build robust batch and real-time data ingestion pipelines using tools like Apache NiFi, Airflow, Spark, and Kafka Streams.
  • Maintain and enhance enterprise data lakes and warehouse environments using technologies such as Hive, Delta Lake, and Azure Synapse.
Cloud & Hybrid Integration
  • Architect and deploy data platform solutions on Microsoft Azure (Databricks, Azure Data Lake Storage, Synapse Analytics).
  • Build hybrid cloud systems to integrate on-premises and cloud-based data infrastructure.
  • Ensure optimal performance, scalability, and cost-efficiency across cloud workloads.
Data Governance, Compliance & Security
  • Ensure platform compliance with data governance and privacy regulations (POPIA, GDPR, BCBS239).
  • Implement robust security controls across infrastructure including encryption, access controls, and audit logging.
  • Work closely with data stewards and governance teams to integrate metadata management and data cataloging tools.
Automation & DevOps
  • Develop and maintain CI/CD pipelines for automated testing, deployment, and monitoring of data solutions.
  • Automate infrastructure provisioning using tools like Terraform and Azure DevOps.
  • Perform routine system administration, performance tuning, and issue resolution across data platforms.
Monitoring & Support
  • Implement monitoring solutions (e.g., Prometheus, Grafana, ELK Stack) to ensure system availability and reliability.
  • Provide L2/L3 support for production data environments, managing incidents and service requests effectively.
Stakeholder Engagement
  • Collaborate with cross-functional teams including data scientists, analysts, developers, and compliance teams.
  • Translate business and analytical requirements into scalable platform solutions.
  • Participate in Agile sprints and architecture design reviews.
Qualifications & Experience
Minimum Requirements
  • Bachelors degree in Computer Science, Information Systems, Engineering, or related field.
  • 5+ years of experience in Big Data engineering or platform operations.
  • Experience in enterprise-grade platforms in banking or financial services.
Technical Skills
  • Strong proficiency with Hadoop ecosystem: HDFS, Hive, Spark, Kafka.
  • Expertise in Azure cloud services: Azure Data Factory, Azure Databricks, Azure Data Lake, Synapse Analytics.
  • Solid programming skills in Python, Scala, Java, and SQL.
  • Familiarity with Terraform, Git, Jenkins, Docker, and Kubernetes.
  • Experience with data governance tools such as Apache Atlas or Collibra is advantageous.
Soft Skills
  • Excellent problem-solving and troubleshooting ability.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced, high-stakes environment.
Preferred Certifications
  • Microsoft Certified: Azure Data Engineer Associate
  • Cloudera Data Platform Certified Developer
  • Databricks Certified Data Engineer Associate
  • TOGAF or similar architecture frameworks (advantageous)

  • Platform Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa Myn Full time R900 000 - R1 200 000 per year

    Specialist Platform Engineer | Banking IndustryJohannesburg (Hybrid)FULL TIME | PERMANENTAre you an expert PLATFORM engineer passionate about building robust, scalable platforms?Ready to shape the core technology of a leading financial institution?Myn is an AI driven marketplace that connects the candidates, clients and recruiters. Myn collaborates with...

  • Senior Data Management Security Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Data Engineer

    19 hours ago

    Johannesburg, Gauteng, South Africa Dariel Full time R800 000 - R1 200 000 per year

    Data Engineer / Streaming EngineerJohannesburg, Gauteng, South Africa(Hybrid)Employment Type: Full-TimeAbout the RoleWe are looking for a highly skilled and motivatedData Engineer / Streaming Engineerto join our team. This role is central to building and supporting scalable, secure, and repeatable data pipelines that power intelligent decision-making. You'll...

  • Data Engineers

    6 days ago

    Johannesburg, Gauteng, South Africa InfyStrat Full time R900 000 - R1 200 000 per year

    InfyStrat is on the lookout for skilled and driven Data Engineers with expertise in Denodo to join our innovative data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data integration solutions that leverage Denodo's data virtualization platform. Your role will be pivotal in transforming complex data into actionable...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Boardroom Appointments Full time R2 000 000 - R2 500 000 per year

    Minimum requirements: B Degree in Business Commerce/ Information Studies/ Information Technology5 -7 years experience in building databases, warehouses, reporting and data integration solutions. Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root...

  • Data Engineer

    19 hours ago

    Johannesburg, Gauteng, South Africa InfyStrat Full time R900 000 - R1 200 000 per year

    InfyStrat is looking for a proficient Data Engineer to strengthen our data team. In this role, you will be integral in designing and implementing data pipelines that facilitate the efficient extraction, transformation, and loading (ETL) of data across various platforms. You will collaborate with data analysts, scientists, and business units to provide...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Standard Bank Full time R400 000 - R1 200 000 per year

    Job OverviewBusiness Segment: Group FunctionsLocation: ZA, undefined, Johannesburg, 30 Baker StreetJob Type: Full-timeJob Ref ID: A-0001Date Posted: 11/4/2025Job DescriptionTo develop and maintain complete data architecture across several application platforms, provide capability across application platforms. To design, build, operationalise, secure and...

  • Data Engineer

    6 days ago

    Johannesburg, Gauteng, South Africa Standard Bank Group Full time R900 000 - R1 200 000 per year

    Company DescriptionStandard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities - plus the chance to work alongside some of the sector's most talented, motivated professionals. Our clients range from individuals, to businesses of all sizes, high...

  • Data Engineer

    19 hours ago

    Johannesburg, Gauteng, South Africa Betway Africa Full time R250 000 - R500 000 per year

    Kick-start your career in the online gaming world and experience the very latest in technology and innovation.Data Pipeline DevelopmentData Engineers design and develop data pipelines to extract, transform, and load (ETL) data from various sources into a data warehouse, data lake, or data mart. They use technologies such as Apache Spark, Apache Kafka, or...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Calibrate People Full time R1 200 000 - R3 600 000 per year

    Data Engineer"Join Us as a Data Alchemist: Turn Raw Data into Golden Insights"Location: Johannesburg, SA - Hybrid | Salary:Competitive (Cause you're worth it)Are you a data virtuoso with a flair for crafting seamless data highways? We're on the hunt for a Data Engineer extraordinaire to join our client's dynamic Technology Team. This role offers the...