AWS Data Engineer
1 month ago
E-Merge is seeking a highly skilled AWS Data Engineer to join their team. As a pioneer in harnessing the power of Artificial Intelligence (AI), we aim to deliver actionable insights and drive transformative change for businesses worldwide.
Key Responsibilities:- Design, build, and operationalize large-scale enterprise data solutions and applications.
- Analyze, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka.
- Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming.
- Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.
- Design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies, and Kafka.
- Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka.
- Bachelor's Degree in Computer Science, Information Technology, or other relevant fields.
- 5-8 years of experience.
- Experience in any of the following AWS services: Athena, Glue, PySpark, DynamoDB, Redshift, Lambda, Step Functions, and Kafka.
- Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka, and Delta.io.
- Knowledge of software engineering best practices across the development lifecycle.
- Experience with big data tools: Delta.io, PySpark, Kafka, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
E-Merge offers a competitive salary of R900k to R1.1mil cost to company per annum for this Contract, Hybrid position based in Braamfontein, Johannesburg.
-
AWS Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAbout E-MergeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide.We are currently looking for a skilled AWS Data Engineer to join our fast-paced and dynamic team.ResponsibilitiesDevelop and Operationalize Large-Scale Data...
-
AWS Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa PBT Group Full timePBT Group Job OpportunityPBT Group is seeking a highly skilled AWS Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines and datamarts, ensuring data quality and security.The ideal candidate will have a strong background in software development, data analysis, and programming...
-
AWS Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timePioneers in Harnessing AI PowerE-Merge is a visionary company that leverages Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our mission is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and...
-
AWS Data Systems Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa MSP Staffing LTD Full timeAWS Data Engineer Job DescriptionMSP Staffing LTD is seeking a skilled AWS Data Engineer to join their Global Markets division.Key Responsibilities:Design and implement data pipelines to support global markets business.Collaborate with leading financial institutions.Ensure data ingestion using AWS Glue Jobs with PySpark or AWS Glue Spark.Develop and deliver...
-
AWS Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa PBT Group Full timePBT Group Job OpportunityWe are seeking a highly skilled AWS Data Engineer to join our team at PBT Group. As a key member of our agile team, you will play a pivotal role in constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security.Key Responsibilities:Architecting Data Analytics FrameworksDesigning and...
-
AWS Cloud Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: AWS Data Cloud EngineerWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key Responsibilities:Design and implement data processing pipelines using AWS services...
-
AWS Data Engineer – Johannesburg
1 month ago
Johannesburg, Gauteng, South Africa E-Merge Full timeJob Title: AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team at E-Merge. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.Responsibilities:Design and implement data models that meet business...
-
AWS Cloud Data Engineer
4 weeks ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: AWS Cloud Data EngineerWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key Responsibilities:Design and implement data pipelines using AWS services such as S3,...
-
AWS Data Engineering Specialist
4 days ago
Johannesburg, Gauteng, South Africa MSP Staffing LTD Full timeMSP Staffing LTD is seeking a highly skilled AWS Data Engineer to join their Global Markets division.About the RoleThis exciting opportunity allows you to collaborate with leading financial institutions, contributing to the design and implementation of data pipelines that support global markets business.Key RequirementsBachelor's degree in computer science,...
-
AWS Cloud Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa E-Merge Full timeE-Merge is a pioneering company that harnesses the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. Our vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable, and simplified...
-
AWS Cloud Data Engineer
1 month ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob Title: AWS Data Cloud EngineerWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key Responsibilities:Design and implement data processing pipelines using AWS services...
-
AWS Cloud Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa Planet10 Full timeAbout the RoleWe are seeking a highly skilled AWS Data Cloud Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesDesign and implement data processing pipelines using AWS services such as S3, Lambda,...
-
AWS Cloud Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa Planet10 Full timeAbout the RoleWe are seeking a highly skilled AWS Cloud Data Engineer to join our team at Planet10. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesLeadership and CollaborationLead cross-functional teams to develop and implement...
-
AWS Data Cloud Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa Planet10 Full timeJob SummaryPlanet10 is seeking a highly skilled AWS Data Cloud Engineer to lead the development of big data solutions in the insurance industry.Design and implement scalable and secure data architectures on AWS.Develop and maintain high-quality engineering applications in corporate environments.Collaborate with cross-functional teams to drive project...
-
AWS Data Engineer – Johannesburg
3 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timeJob Title: AWS Data Engineer – JohannesburgAbout the Role:E-Merge, a diversified financial services group, is seeking an experienced AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data...
-
AWS Data Engineer – Johannesburg
2 months ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAbout the RoleE-Merge is seeking a highly skilled AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.ResponsibilitiesData Ingestion and Management: Design and implement efficient...
-
AWS Data Engineer
2 weeks ago
Johannesburg, Gauteng, South Africa PBT Group Full timeAbout the Role: PBT Group is seeking an experienced AWS Data Engineer with a strong background in cloud data architecture and analytics.Key Responsibilities: The successful candidate will be responsible for designing and implementing scalable data pipelines, developing data analytics solutions, and ensuring the security and integrity of data.Required Skills...
-
AWS Data Engineer – Johannesburg
4 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAbout the Role:E-Merge is seeking a highly skilled AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data quality.Responsibilities:Design and implement data models that meet business...
-
AWS Data Engineer – Johannesburg
4 weeks ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAWS Data Engineer Job DescriptionE-Merge, a leading direct distributor of financial service products, is seeking an experienced AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data models, working with large data sources, and ensuring data...
-
AWS Data Engineer
2 months ago
Johannesburg, Gauteng, South Africa E-Merge Full timeAbout the RoleE-Merge is seeking a highly skilled AWS Data Engineer to lead the design and implementation of large-scale enterprise data solutions and applications. As a key member of our team, you will be responsible for analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services...