Data Engineer

3 days ago

Johannesburg, South Africa Datacentrix Full time
Datacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS pipelines, and working with various data formats such as CSV, TXT, XML, JSON, XLS, XLSX. The ideal candidate must have 8+ years experience in design, build and support of data engineering pipelines.

Core requirements
  • Advanced TSQL scripting: stored procedures, views, functions
  • Building and maintaining SSIS pipeline
  • Data warehousing & modelling
  • Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
  • Data Analysis
  • Working with relational databases
  • Building and maintaining SSRS reports
  • Using GIT
  • CI/CD pipelines
  • Performance monitoring and tuning

Responsibilities
  • Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
  • Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
  • Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
  • Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
  • Promote data engineering best practices with CICD pipelines and automation.
  • Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
  • Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
  • Follow Data Ethics standards to protect personal information and do the right thing to meet our customers’, partners’, and community’s expectations.

Skills and Experience
  • 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
  • Experience in ETL using Microsoft technologies.
  • Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
  • Experience with SSRS would be an advantage.
  • Experience of manipulating semi-structured data (XML, JSON)
  • Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
  • Bachelor’s degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
  • Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.

  • Data Engineer

    3 days ago

    Johannesburg, Gauteng, South Africa Data Centrix Full time

    Data Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...

  • Data Engineer

    2 days ago

    Johannesburg, South Africa Data Centrix Full time

    Core requirements Advanced TSQL scripting: stored procedures, views, functions Building and maintaining SSIS pipeline Data warehousing & modelling Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc Data Analysis Working with relational databases Building and maintaining SSRS reports Using GIT CI/CD pipelines Performance monitoring and tuning Responsibilities...

  • Data Engineer

    3 days ago

    Johannesburg, South Africa Data Centrix Full time

    Core requirementsAdvanced TSQL scripting: stored procedures, views, functionsBuilding and maintaining SSIS pipelineData warehousing & modellingWorking with CSV, TXT, XML, JSON, XLS, XLSX. EtcData AnalysisWorking with relational databasesBuilding and maintaining SSRS reportsUsing GITCI/CD pipelinesPerformance monitoring and tuningResponsibilitiesMaintain,...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...

  • Data Engineer

    4 months ago

    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Cloud Data Engineer

    5 months ago

    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...

  • Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...

  • Cloud Data Architect

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging cloud-based...

  • Cloud Data Architect

    1 month ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging AWS services and...

  • Cloud Data Architect

    3 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Cloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that enhance our clients' businesses.Key ResponsibilitiesDesign and develop mission-critical information extraction, analysis, and management...

  • Data Analyst

    1 month ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Business Intelligence Analyst to join our team. As a key member of our analytics team, you will be responsible for transforming data into critical information and knowledge that drives business value.Key Responsibilities:Analyze complex business problems and issues using data from internal and external sources to...

  • Data Analyst

    3 weeks ago

    Johannesburg, Gauteng, South Africa NTT DATA Full time

    About the RoleNTT DATA is seeking a seasoned Business Intelligence Analyst to join our team. As a key member of our analytics team, you will be responsible for transforming data into critical information and knowledge that can be used to make sound business decisions.Key Responsibilities:Analyze complex business problems and issues using data from internal...

  • Data Analyst

    4 months ago

    Johannesburg, South Africa NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Azure Data Engineer OpportunityE-Merge is seeking a skilled Azure Data Engineer to join our team and drive improvements in data engineering across the business. As a key member of our data science and engineering team, you will be responsible for designing and implementing scalable data pipelines, collaborating with data scientists, and mentoring junior data...

  • Data Scientist

    4 weeks ago

    Johannesburg, South Africa NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Data Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    About the RoleE-Merge is seeking a highly skilled Data Engineer to join our team and help drive improvements in data engineering across the business. As a Data Engineer, you will play a key role in developing best practices and designing data engineering solutions to meet business requirements.Key ResponsibilitiesAnalyse and organise raw data to ensure its...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Performability Recruitment Full time

    Job Title: Intermediate/Sr Data EngineerJob Summary:We are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting.Key Responsibilities:Design and implement...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    Job Title: Data EngineerE-Merge is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing best practices and driving improvements in data engineering across the business.Responsibilities:Analyze and organize raw data to ensure its quality and reliability.Design data engineering solutions to...

  • Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa TOTALCARE PEOPLE® SOLUTIONS Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TOTALCARE PEOPLE® SOLUTIONS. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data systems, ensuring they are scalable, efficient, and secure.Key Responsibilities:Design and implement data models, ETL processes, and data...