Senior Data Engineer

5 days ago

Midrand, Gauteng, South Africa Netstar Full time

We are seeking a highly skilled and experienced
Senior Data Engineer
to join our dynamic team. This role will support our software development team and data scientists by engineering robust data solutions that ensure optimized and consistent data delivery architectures across ongoing projects. The ideal candidate will be passionate about big data technologies, spatial data, cloud platforms, and enterprise system migrations, and thrive in a fast-paced environment with tight deadlines.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines and architectures for structured and unstructured data.
  • Collaborate with software engineers and data scientists to support data initiatives and ensure data consistency across projects.
  • Lead the development and optimization of big data environments using tools such as
    Hadoop
    ,
    Spark
    , and
    Kafka
    .
  • Engineer data solutions for the migration from
    CRM and AX to D365
    , ensuring minimal disruption and high data integrity.

Work with various storage environments including:

  • Azure Blob Storage
    and
    AWS S3
  • Cassandra
  • Apache Iceberg
  • Other big data formats and distributed storage systems
  • Develop and manage data transformation processes using:
  • Azure Synapse Analytics
  • AWS Glue
    ,
    AWS EMR
    , and
    Amazon Redshift
  • Create and orchestrate data pipelines to extract, transform, and load data from big data environments and business systems into a data lake for reporting and analytics.
  • Apply spatial data engineering techniques to support geospatial analytics and applications.
  • Handle urgent data requests and deliver under tight deadlines while maintaining high quality.
  • Work across multiple programming languages including
    .NET
    ,
    Python
    ,
    Scala
    ,
    R and SQL
    .
  • Implement and maintain
    cloud security best practices
    across Azure and AWS environments, including:
  • Data encryption at rest and in transit
  • Identity and access management (IAM)
  • Secure data lake and pipeline configurations
  • Monitoring and auditing using tools like
    Azure Security Center
    and
    AWS CloudTrail

Required Skills & Qualifications

  • Proven experience as a
    Senior Data Engineer
    or similar role in both
    Azure
    and
    AWS
    environments.
  • Strong expertise in
    Hadoop
    ,
    Spark
    ,
    Kafka
    , and cloud-native data services.
  • Deep understanding of data storage technologies:
    Azure Blob
    ,
    AWS S3
    ,
    Cassandra
    ,
    Apache Iceberg
    , etc.
  • Experience with
    spatial data engineering
    and geospatial data formats.
  • Hands-on experience with
    data migration projects
    , especially involving
    CRM, AX, and D365
    .
  • Proficiency in multiple programming languages:
    Python
    ,
    Scala
    ,
    R
    ,
    .NET
    and
    SQL
    .
  • Strong understanding of
    cloud security principles
    and experience implementing secure data solutions.
  • Ability to work with both structured and unstructured data sets.
  • Excellent problem-solving skills and ability to work independently.
  • Strong communication and collaboration skills.

Preferred Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • Certifications in
    Azure Data Engineering
    ,
    AWS Big Data
    , or
    Cloud Security
    .
  • Experience in Agile development environments.

What We Offer

  • Flexible remote or hybrid working options.
  • Opportunity to work on cutting-edge data projects across cloud platforms.
  • Collaborative and innovative team culture.
  • Competitive salary and benefits.

  • Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Decision Full time R750 000 - R1 800 000 per year

    Job Description: We are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability...

  • Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Decision Inc Full time R900 000 - R1 200 000 per year

    We are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...

  • Data Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Decision Inc. Full time R450 000 - R750 000 per year

    We are looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly...

  • Senior Data Analayst

    2 weeks ago

    Midrand, Gauteng, South Africa Hire Far Out Full time R650 000 - R800 000 per year

    Midrand (Hybrid) R650,000 – R800,000 CTC per annum Strong SQL + BI tools (Power BI/Tableau/Looker) 3–5 years' experience working independently in a data or analytics environmentA leading company in the technology and telecommunications sector is seeking a highly capable Senior Data Analyst to join their South African team. This organisation provides...

  • Senior Tailings Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa WSP Full time R800 000 - R1 200 000 per year

    DescriptionWSP has a new opportunity for a Senior Tailings Engineer to join our Mine Waste team on a full-time basis in Midrand.   This is senior level position in the consulting team and is regarded as a professional person in the delivery of tailings and geotechnical services, in line with the WSP suite of engineering products.ResponsibilitiesIs...

  • Senior System Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Netstar Full time

    We are seeking a highly experienced Senior Systems Engineer to lead the design, integration, and evolution of Systems of Systems (SoS) within a fast-paced vehicle telematics environment. This role demands strategic thinking and technical expertise to architect and orchestrate complex, interconnected systems spanning vehicles, IoT devices, cloud services, and...

  • Senior Geotechnical Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa WSP Full time R900 000 - R1 200 000 per year

    DescriptionWSP has a new opportunity for a Senior Geotechnical Engineer to be part of our Mine Waste team on a full-time basis based in Midrand. The typical role and responsibilities of this role is to provide Geotechnical Engineering services in the mining, infrastructure as well as property and buildings sectors ResponsibilitiesProject management of...

  • Senior Civil Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Hire Resolve Full time R200 000 - R250 000 per year

    An engineering company based in Gauteng that's involved in the planning, design, construction and project management of roads & stormwater needs a Senior Civil Engineer to join their team.​The Civil Engineer will design, develop and construct a huge range of projects of the physically and naturally built environment from conception through to...

  • Senior Electrical Engineer

    2 weeks ago

    Midrand, Gauteng, South Africa Sernet Global Full time R1 200 000 - R2 400 000 per year

    Company DescriptionSernet Global offers a diverse range of solutions, including transformers, switchgear, smart meters, solar systems, signaling equipment, and IoT modules, all meeting SANS and IEC standards. As a Black female-led enterprise, the company prioritizes diversity, economic empowerment, and green innovation to drive impactful change across...

  • Senior Overhead Lines Design Engineer

    7 days ago

    Midrand, Gauteng, South Africa WSP Full time

    We are seeking an Senior Overhead Lines Design Engineer to join our team at WSP. This is an exciting opportunity to contribute to innovative projects and deliver high-quality engineering solutions.Primary Responsibilities 1. Technical LeadershipLead all tower spotting and line profiling activities for OHL projects using PLS-Suite (PLSCADD,POLE). Define...