Data Engineer

1 month ago


Johannesburg, South Africa Data Centrix Full time
Core requirements
  • Advanced TSQL scripting: stored procedures, views, functions
  • Building and maintaining SSIS pipeline
  • Data warehousing & modelling
  • Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
  • Data Analysis
  • Working with relational databases
  • Building and maintaining SSRS reports
  • Using GIT
  • CI/CD pipelines
  • Performance monitoring and tuning

Responsibilities
  • Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
  • Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
  • Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
  • Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
  • Promote data engineering best practices with CICD pipelines and automation.
  • Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
  • Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
  • Follow Data Ethics standards to protect personal information and do the right thing to meet our customers, partners, and communitys expectations.

Skills and Experience
  • 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
  • Experience in ETL using Microsoft technologies.
  • Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
  • Experience with SSRS would be an advantage.
  • Experience of manipulating semi-structured data (XML, JSON)
  • Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
  • Bachelors degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
  • Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.

  • Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Data Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...

  • Data Engineer

    1 month ago


    Johannesburg, South Africa Data Centrix Full time

    Core requirementsAdvanced TSQL scripting: stored procedures, views, functionsBuilding and maintaining SSIS pipelineData warehousing & modellingWorking with CSV, TXT, XML, JSON, XLS, XLSX. EtcData AnalysisWorking with relational databasesBuilding and maintaining SSRS reportsUsing GITCI/CD pipelinesPerformance monitoring and tuningResponsibilitiesMaintain,...

  • Senior Data Engineer

    4 weeks ago


    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our Data Engineering team at Data Centrix. In this role, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing and data ingestion environments.You will work closely with our data architects to design and implement data models, and...

  • Cloud Data Engineer

    6 months ago


    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Data Engineer

    5 months ago


    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    At Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...

  • Cloud Data Architect

    1 month ago


    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging cloud-based...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the Role:The Lead Data Network Engineer will be responsible for designing and implementing complex data networks across multiple locations. This individual will work closely with business teams to provide solutions to their network challenges, collaborating with partners on vendor projects or in-house engineering efforts.Key Responsibilities:Analyze...

  • Data Architect

    3 weeks ago


    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Data Discipline ExpertiseData Centrix seeks a seasoned Scrum Master - Data Discipline professional to support our ever-evolving strategy in person-centred health and care. This role demands substantial expertise in software development, programming, and data analysis, as well as knowledge of data structures, algorithms, and distributed computing.Key...

  • Data Analyst

    5 months ago


    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Johannesburg, Gauteng, South Africa Dimension Data Full time

    About the Role:We are seeking a skilled Data Solutions Architect to join our team at Dimension Data. As a key member of our technology group, you will play a critical role in designing and implementing data architectures that meet the needs of our clients.The ideal candidate will have a strong background in database systems engineering and experience with...

  • Data Scientist

    2 months ago


    Johannesburg, South Africa NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Data Engineer

    1 month ago


    Johannesburg, South Africa Datacentrix Full time

    Datacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS...

  • Data Engineer

    4 weeks ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    Core requirements - Advanced TSQL scripting: stored procedures, views, functions - Building and maintaining SSIS pipeline - Data warehousing & modelling - Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc - Data Analysis - Working with relational databases - Building and maintaining SSRS reports - Using GIT - CI/CD pipelines - Performance monitoring and...

  • Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa JCM Consultants Full time

    At JCM Consultants, we're on the hunt for a talented Data Engineer to join our dynamic team!As a Data Engineer, you'll be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...

  • Data Engineer

    1 month ago


    Johannesburg, Gauteng, South Africa Planet10 Full time

    Job Title: Junior Data EngineerWe are seeking a highly motivated and detail-oriented Junior Data Engineer to join our team at Planet10. As a Junior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support business growth and innovation.Key Responsibilities:Design and implement data pipelines to...

  • Data Engineer

    6 days ago


    Johannesburg, South Africa Jobted ZA C2 Full time

    A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...


  • Johannesburg, South Africa Axis Data Full time

    Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...


  • Johannesburg, South Africa Axis Data Full time

    Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...