Data Engineer
2 months ago
About JCM Consultants
We are a dynamic IT company seeking a talented Data Engineer to join our team. Our company culture is built on a foundation of hard work, teamwork, and a passion for innovation.
The Role
You will be responsible for developing and implementing data engineering solutions to drive business growth and improve data-driven decision making. Key responsibilities include:
- Designing and developing scalable data pipelines to process structured and unstructured data.
- Collaborating with stakeholders to understand business needs and translate them into technical requirements.
- Developing and maintaining data quality, reliability, and efficiency.
- Working with cross-functional teams to ensure data accessibility and scalability.
Ideal Profile
We are looking for a highly skilled Data Engineer with:
- Hands-on experience in building ETL pipelines on Big Data, using modern cloud Data Engineering tools (1+ years):
- AWS Glue (highly preferred)
- GCP DataFlow (preferred)
- Azure Data Factory
- Object Oriented Python programming (2+ years)
- Python package development
- Python class development
- Pythonic standards across the board
- Working knowledge of PySpark (preferred) or Apache Beam
- Efficient use of the PySpark DataFrame API
- Knowledge of big data file formats (Parquet, ORC, AVRO) and partitioning strategies
- Hands-on experience in writing SQL queries (2+ years)
- ANSI-SQL (preferred)
- Postgresql (preferred)
- MS-SQL
- MySQL
- Oracle
- Database experience
- Amazon Redshift
- Google BigQuery
- Or equivalent Infrastructure as code:
- Terraform (preferred)
- Cloudformation
- AWS CDK
- Hands on experience in making use of additional cloud services:
- AWS Lambda (highly important)
- AWS IAM (highly important)
- Cross account roles
What We Offer
- A dynamic and collaborative work environment
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeData Engineering Role at Data CentrixAt Data Centrix, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing, data ingestion, cleansing, manipulation, modeling, and reporting processes.Key Responsibilities:Maintain,...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...
-
Senior Data Engineer
1 day ago
Johannesburg, Gauteng, South Africa Data Centrix Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our Data Engineering team at Data Centrix. In this role, you will be responsible for designing, building, and maintaining data engineering pipelines in our data warehousing and data ingestion environments.You will work closely with our data architects to design and implement data models, and...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...
-
Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Data Engineer to join our team. As a Data Engineer, you will be responsible for transforming data into a structured format that can be easily analyzed in a query or report.Key Responsibilities:Develop structured data sets that can be reused or complimented by other data sets and reports.Analyze data sources and...
-
Johannesburg, Gauteng, South Africa Dimension Data Full timeAt Dimension Data, we are seeking an experienced Cloud Data Architect to lead our data engineering solutions. The ideal candidate will have a deep understanding of AWS technologies and experience in designing scalable data pipelines.Key ResponsibilitiesDesign and implement data pipelines using AWS services such as AWS Data Pipeline and AWS Storage...
-
Cloud Data Architect
3 weeks ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeCloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging cloud-based...
-
Cloud Data Architect
1 month ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeCloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that drive business growth for our clients.Key ResponsibilitiesDesign and develop mission-critical data systems, leveraging AWS services and...
-
Cloud Data Architect
4 weeks ago
Johannesburg, Gauteng, South Africa Dimension Data Full timeCloud Data EngineerAt Dimension Data, we're seeking a skilled Cloud Data Engineer to join our AWS infrastructure team. As a key member of our data pipeline team, you'll play a crucial role in delivering data services that enhance our clients' businesses.Key ResponsibilitiesDesign and develop mission-critical information extraction, analysis, and management...
-
Data Analyst
1 month ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Business Intelligence Analyst to join our team. As a key member of our analytics team, you will be responsible for transforming data into critical information and knowledge that drives business value.Key Responsibilities:Analyze complex business problems and issues using data from internal and external sources to...
-
Data Analyst
4 weeks ago
Johannesburg, Gauteng, South Africa NTT DATA Full timeAbout the RoleNTT DATA is seeking a seasoned Business Intelligence Analyst to join our team. As a key member of our analytics team, you will be responsible for transforming data into critical information and knowledge that can be used to make sound business decisions.Key Responsibilities:Analyze complex business problems and issues using data from internal...
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAzure Data Engineer OpportunityE-Merge is seeking a skilled Azure Data Engineer to join our team and drive improvements in data engineering across the business. As a key member of our data science and engineering team, you will be responsible for designing and implementing scalable data pipelines, collaborating with data scientists, and mentoring junior data...
-
Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAbout the RoleE-Merge is seeking a highly skilled Data Engineer to join our team and help drive improvements in data engineering across the business. As a Data Engineer, you will play a key role in developing best practices and designing data engineering solutions to meet business requirements.Key ResponsibilitiesAnalyse and organise raw data to ensure its...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa TOTALCARE PEOPLE® SOLUTIONS Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TOTALCARE PEOPLE® SOLUTIONS. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data systems, ensuring they are scalable, efficient, and secure.Key Responsibilities:Design and implement data models, ETL processes, and data...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa E-Merge Full timeJob Title: Data EngineerE-Merge is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in developing best practices and driving improvements in data engineering across the business.Responsibilities:Analyze and organize raw data to ensure its quality and reliability.Design data engineering solutions to...
-
Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: Junior Data EngineerWe are seeking a highly motivated and detail-oriented Junior Data Engineer to join our team at Planet10. As a Junior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support business growth and decision-making.Key Responsibilities:Design and implement data pipelines to...
-
Data Engineer
1 week ago
Johannesburg, Gauteng, South Africa TransEra Solutions Full timeJob Title: **Data Engineer**:We are seeking a skilled Data Engineer to join our team at TransEra Solutions. The successful candidate will be responsible for designing, building, and maintaining robust data infrastructure and systems. This includes developing data models, maintaining data warehouses, and writing scripts for data integration and analysis....
-
Data Engineer
3 weeks ago
Johannesburg, Gauteng, South Africa JCM Consultants Full timeAt JCM Consultants, we're on the hunt for a talented Data Engineer to join our dynamic team!As a Data Engineer, you'll be responsible for developing scripts to process structured and unstructured data, recommending ways to improve data reliability, efficiency, and quality, and supporting the translation of data business needs into technical system...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Planet10 Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Planet10. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our business goals.Key ResponsibilitiesMaintain, improve, clean, and manipulate data in our operational and analytics databases.Build and manage...
-
Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: Junior Data EngineerWe are seeking a highly motivated and detail-oriented Junior Data Engineer to join our team at Planet10. As a Junior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support business growth and decision-making.Key Responsibilities:Design and implement data pipelines to...