Data Engineer

3 weeks ago

Johannesburg, South Africa Dariel Full time

About the Role We are looking for a highly skilled and motivated Data Engineer / Streaming Engineer to join our team. This role is central to building and supporting scalable, secure, and repeatable data pipelines that power intelligent decision‑making. You’ll work in an agile environment, integrating diverse data sources and leveraging emerging technologies across big data and cloud platforms to deliver innovative solutions. Software development is essential for this role Key Responsibilities Architect and implement scalable data analytics frameworks. Translate complex functional and technical requirements into high‑performing software solutions. Lead the development of batch and real‑time data pipelines using transformational technologies. Create and support data feeds from on‑premise systems to Google Cloud Platform. Build data marts using Talend or similar ETL tools. Manipulate and process data using Python and PySpark/Spark. Leverage AWS services such as EMR, EC2, and S3 for big data processing. Support production data feeds and troubleshoot issues on a break‑fix basis. Contribute to the research, evaluation, and implementation of new tools and technologies. Ensure compliance with policies, standards, and disaster recovery protocols. Collaborate across teams to deliver robust data solutions aligned with business needs. Required Experience & Skills Bachelor’s degree in Computer Science, Computer Engineering, or equivalent. AWS Certification (preferred). 5+ years of experience in data engineering and software engineering. 2+ years of experience with big data technologies. 2+ years of experience with ETL processes and tools (e.g., Talend). 2+ years of hands on experience with GCP - Google Cloud Platform is ESSENTIAL Strong programming skills in Python and scripting languages. Experience with PySpark or Spark for distributed data processing. Deep understanding of data modeling and various data structures. Proven ability to architect scalable distributed systems using open‑source tools. Familiarity with Hadoop and AWS EMR. Knowledge of automated testing and deployment practices. Technologies You’ll Work With Big Data Tools : Hadoop, Spark, PySpark ETL Tools : Talend Languages : Python, scripting languages Data Processing : Batch and streaming pipelines Work on impactful, data‑driven projects using the latest technologies. Be part of a collaborative and innovative team. Opportunities for continuous learning and professional growth. Competitive compensation and benefits. Seniority level Mid‑Senior level Employment type Full‑time Job function Consulting, Information Technology, and Engineering Industries Outsourcing and Offshoring Consulting, Software Development, and IT Services and IT Consulting Referrals increase your chances of interviewing at Dariel by 2x #J-18808-Ljbffr

  • Senior Process Engineer

    2 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Changing the way the world works @ Gig Engineer | Founder | MBA | Engineer | Jedi Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation,...

  • Senior Process Engineer.

    3 weeks ago

    Johannesburg, South Africa Gig Engineer Full time

    Gig Engineer is seeking an experienced Senior Process Engineer to lead process development and optimisation efforts on behalf of its client, dedicated to advancing nuclear fuel technologies for next-generation reactors. In this role, you will oversee the design, implementation, and scaling of processes across the Nuclear Fuel Cycle, utilising proprietary ASP...

  • Senior Data Management Security Engineer

    4 weeks ago

    Johannesburg, South Africa Ntt Data, Inc. Full time

    Senior Data Management Security Engineer NTT DATA, Inc. is hiring for a Senior Data Management Security Engineer. The role focuses on defining and enforcing data security strategies, policies, and controls across the organization's data landscape to protect data assets while enabling secure and compliant data usage across analytics, operations, and digital...

  • Senior Data Management Security Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa NTT DATA, Inc. Full time R800 000 - R1 200 000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.The Data Management Security Engineer...

  • Data Scientist

    4 days ago

    Johannesburg, South Africa NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Project Manager

    2 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Qualifications and ExperienceBachelors degree in Information Systems, Computer Science, HR Technology, or related field. Project Management certification (PMP, PRINCE2, or Agile). 5+ years experience in data management projects, preferably in HR and/or mining industry. Experience in Denodo and related environments. Strong project management skills (PMBOK or...

  • Lead Forward Deployed Engineer

    7 hours ago

    Johannesburg, Gauteng, South Africa RANGR Data Full time R1 200 000 - R2 400 000 per year

    RANGR Data is an advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir FoundryRole OverviewAs Lead Engineer, you are responsible for driving the technical success of client solutions by leading a team of engineers in designing,...

  • Project Manager

    2 weeks ago

    Johannesburg, South Africa Data Centrix Full time

    Qualifications and ExperienceBachelors degree in Information Systems, Computer Science, HR Technology, or related field.Project Management certification (PMP, PRINCE2, or Agile).5+ years experience in data management projects, preferably in HR and/or mining industry.Experience in Denodo and related environments.Strong project management skills (PMBOK or...

  • 2022 59 Senior Data Analyst

    2 days ago

    Johannesburg, South Africa Data Centrix Full time

    Required Experience: - Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing, - Analytics or as a dedicated Data-Modeller. - Solid experience in TSQL and SQL server skills. - Logical, and Physical Data-Modelling Expertise. - Experience with Forward and Reverse Engineering of Existing Databases. - Good understanding of Star...

  • 2022 37 Mid-level Data Analyst

    1 week ago

    Johannesburg, South Africa Data Centrix Full time

    Requirements - Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing, - Analytics or as a dedicated Data-Modeller. - Above average TSQL and SQL server skills. - Logical, and Physical Data-Modelling Expertise. - Experience with Forward and Reverse Engineering of Existing Databases. - Good understanding of Star Schemas, Snowflake...