Data Engineer
1 month ago
- Advanced TSQL scripting: stored procedures, views, functions
- Building and maintaining SSIS pipeline
- Data warehousing & modelling
- Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
- Data Analysis
- Working with relational databases
- Building and maintaining SSRS reports
- Using GIT
- CI/CD pipelines
- Performance monitoring and tuning
Responsibilities
- Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
- Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
- Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
- Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
- Promote data engineering best practices with CICD pipelines and automation.
- Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
- Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
- Follow Data Ethics standards to protect personal information and do the right thing to meet our customers, partners, and communitys expectations.
Skills and Experience
- 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
- Experience in ETL using Microsoft technologies.
- Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
- Experience with SSRS would be an advantage.
- Experience of manipulating semi-structured data (XML, JSON)
- Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
- Bachelors degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
- Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeData Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...
-
Data Engineer
1 month ago
Johannesburg, South Africa Data Centrix Full timeCore requirementsAdvanced TSQL scripting: stored procedures, views, functionsBuilding and maintaining SSIS pipelineData warehousing & modellingWorking with CSV, TXT, XML, JSON, XLS, XLSX. EtcData AnalysisWorking with relational databasesBuilding and maintaining SSRS reportsUsing GITCI/CD pipelinesPerformance monitoring and tuningResponsibilitiesMaintain,...
-
Senior Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our Data Engineering team at Data Centrix. In this role, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing and data ingestion environments.You will work closely with our data architects to design and implement data models, and...
-
Cloud Data Engineer
6 months ago
Johannesburg, South Africa Dimension Data Full timeThe Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...
-
Data Engineer
5 months ago
Johannesburg, South Africa NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...
-
Johannesburg, Gauteng, South Africa Dimension Data Full timeAt Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...
-
Cloud Data Architect
1 month ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeCloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging cloud-based...
-
Johannesburg, Gauteng, South Africa Dimension Data Full timeAbout the Role:The Lead Data Network Engineer will be responsible for designing and implementing complex data networks across multiple locations. This individual will work closely with business teams to provide solutions to their network challenges, collaborating with partners on vendor projects or in-house engineering efforts.Key Responsibilities:Analyze...
-
Data Architect
3 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeData Discipline ExpertiseData Centrix seeks a seasoned Scrum Master - Data Discipline professional to support our ever-evolving strategy in person-centred health and care. This role demands substantial expertise in software development, programming, and data analysis, as well as knowledge of data structures, algorithms, and distributed computing.Key...
-
Data Analyst
5 months ago
Johannesburg, South Africa NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Data Solutions Architect
6 days ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeAbout the Role:We are seeking a skilled Data Solutions Architect to join our team at Dimension Data. As a key member of our technology group, you will play a critical role in designing and implementing data architectures that meet the needs of our clients.The ideal candidate will have a strong background in database systems engineering and experience with...
-
Data Scientist
2 months ago
Johannesburg, South Africa NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...
-
Data Engineer
1 month ago
Johannesburg, South Africa Datacentrix Full timeDatacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS...
-
Data Engineer
4 weeks ago
Johannesburg, South Africa Jobted ZA C2 Full timeCore requirements - Advanced TSQL scripting: stored procedures, views, functions - Building and maintaining SSIS pipeline - Data warehousing & modelling - Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc - Data Analysis - Working with relational databases - Building and maintaining SSRS reports - Using GIT - CI/CD pipelines - Performance monitoring and...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa JCM Consultants Full timeAt JCM Consultants, we're on the hunt for a talented Data Engineer to join our dynamic team!As a Data Engineer, you'll be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: Junior Data EngineerWe are seeking a highly motivated and detail-oriented Junior Data Engineer to join our team at Planet10. As a Junior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support business growth and innovation.Key Responsibilities:Design and implement data pipelines to...
-
Data Engineer
5 days ago
Johannesburg, South Africa Jobted ZA C2 Full timeA reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Pepkor Lifestyle Full timeJob Title: Data EngineerAbout the Role:We are seeking an experienced Data Engineer to join our team at Pepkor Lifestyle. The successful candidate will play a critical role in the development and maintenance of our data infrastructure, working closely with cross-functional teams to ensure data availability, quality, and accessibility for analysis.Main...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Psybergate Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Psybergate. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop scalable data pipelines using Ab Initio.Develop ETL processes to extract, transform, and load data from...