Data Engineer
1 month ago
- Advanced TSQL scripting: stored procedures, views, functions
- Building and maintaining SSIS pipeline
- Data warehousing & modelling
- Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
- Data Analysis
- Working with relational databases
- Building and maintaining SSRS reports
- Using GIT
- CI/CD pipelines
- Performance monitoring and tuning
Responsibilities
- Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
- Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
- Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
- Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
- Promote data engineering best practices with CICD pipelines and automation.
- Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
- Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
- Follow Data Ethics standards to protect personal information and do the right thing to meet our customers, partners, and communitys expectations.
Skills and Experience
- 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
- Experience in ETL using Microsoft technologies.
- Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
- Experience with SSRS would be an advantage.
- Experience of manipulating semi-structured data (XML, JSON)
- Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
- Bachelors degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
- Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeData Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...
-
Data Engineer
1 month ago
Johannesburg, South Africa Data Centrix Full timeCore requirements Advanced TSQL scripting: stored procedures, views, functions Building and maintaining SSIS pipeline Data warehousing & modelling Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc Data Analysis Working with relational databases Building and maintaining SSRS reports Using GIT CI/CD pipelines Performance monitoring and tuning Responsibilities...
-
Senior Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our Data Engineering team at Data Centrix. In this role, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing and data ingestion environments.You will work closely with our data architects to design and implement data models, and...
-
Cloud Data Engineer
6 months ago
Johannesburg, South Africa Dimension Data Full timeThe Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...
-
Johannesburg, Gauteng, South Africa Dimension Data Full timeAt Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...
-
Johannesburg, Gauteng, South Africa Dimension Data Full timeAbout the Role:The Lead Data Network Engineer will be responsible for designing and implementing complex data networks across multiple locations. This individual will work closely with business teams to provide solutions to their network challenges, collaborating with partners on vendor projects or in-house engineering efforts.Key Responsibilities:Analyze...
-
Data Architect
4 weeks ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeData Discipline ExpertiseData Centrix seeks a seasoned Scrum Master - Data Discipline professional to support our ever-evolving strategy in person-centred health and care. This role demands substantial expertise in software development, programming, and data analysis, as well as knowledge of data structures, algorithms, and distributed computing.Key...
-
Data Solutions Architect
2 weeks ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeAbout the Role:We are seeking a skilled Data Solutions Architect to join our team at Dimension Data. As a key member of our technology group, you will play a critical role in designing and implementing data architectures that meet the needs of our clients.The ideal candidate will have a strong background in database systems engineering and experience with...
-
Data Scientist
2 months ago
Johannesburg, South Africa NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...
-
Data Engineer
1 month ago
Johannesburg, South Africa Datacentrix Full timeDatacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS...
-
Data Engineer
1 month ago
Johannesburg, South Africa Jobted ZA C2 Full timeCore requirements - Advanced TSQL scripting: stored procedures, views, functions - Building and maintaining SSIS pipeline - Data warehousing & modelling - Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc - Data Analysis - Working with relational databases - Building and maintaining SSRS reports - Using GIT - CI/CD pipelines - Performance monitoring and...
-
Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa JCM Consultants Full timeAt JCM Consultants, we're on the hunt for a talented Data Engineer to join our dynamic team!As a Data Engineer, you'll be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...
-
Data Engineer
1 week ago
Johannesburg, South Africa Jobted ZA C2 Full timeA reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...
-
Senior Business Data Analyst
1 month ago
Johannesburg, South Africa Axis Data Full timeAxis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...
-
Senior Business Data Analyst
3 weeks ago
Johannesburg, South Africa Axis Data Full timeAxis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry Role Overview: As a Senior Business Data Analyst at Axis Data, you will lead the development and deployment of BI and data solutions,...
-
Data Insights Strategist
1 week ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the Role:">This is a seasoned role for a Data Insights Strategist to transform data into critical information and knowledge that can be used to make sound business decisions. The ideal candidate will have expertise in generating visual analytics, dashboards, and ad hoc reports for the business.">Responsibilities:">">Analyzes complex business problems...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Pepkor Lifestyle Full timeJob Title: Data EngineerAbout the Role:We are seeking an experienced Data Engineer to join our team at Pepkor Lifestyle. The successful candidate will play a critical role in the development and maintenance of our data infrastructure, working closely with cross-functional teams to ensure data availability, quality, and accessibility for analysis.Main...
-
Data Engineer
2 weeks ago
Johannesburg, South Africa Jobted ZA C2 Full timeAs a Data Engineer, you will: - Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment. - Collaborate with clients to understand their requirements and translate them into scalable data solutions. - Aggregate, store, and manage data from various sources, ensuring...
-
Data Engineer
2 weeks ago
Johannesburg, South Africa Jobted ZA C2 Full timeAs a Data Engineer, you will: - Design, develop, and implement robust data pipelines and ETL processes to meet client needs, focusing on data cleansing, aggregation, and enrichment. - Collaborate with clients to understand their requirements and translate them into scalable data solutions. - Aggregate, store, and manage data from various sources, ensuring...
-
Data Engineer
1 week ago
Johannesburg, South Africa Network Recruitment Full timeA reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while working on cutting-edge systems and data solutions. As a Data Engineer, you will play a pivotal role in...