Current jobs related to Data Engineer - Randburg - ALOS Innovative Workforce Solution

  • Azure Data Engineer

    2 months ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying data pipelines across our Data Lake and into Synapse.Your expertise in PowerBI data sets and data flows will enable you to develop curated data sets...

  • Azure Data Engineer

    6 months ago

    Randburg, South Africa Dimension Data Full time

    FunctieomschrijvingAre you tired of micro-managing your Azure servers? Do you want to work with one of the best teams in the region? Apply for this Azure Data Engineer role!Our client requires an Azure Data Engineer to develop, deploy and monitor data pipelines across the Data Lake and into Synapse. Develop PowerBI data sets and data flows and develop...

  • Azure Data Engineer

    1 month ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying data pipelines across our Data Lake and into Synapse.Your expertise in PowerBI data sets and data flows will be crucial in developing curated data...

  • Azure Data Engineer

    2 months ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying data pipelines across our Data Lake and into Synapse.Key ResponsibilitiesDevelop and deploy data pipelines using Azure Data Factory and Azure...

  • Azure Data Engineer

    1 month ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying data pipelines across our Data Lake and into Synapse.Your expertise in PowerBI data sets and data flows will enable you to develop curated data sets...

  • Azure Data Engineer

    1 month ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying data pipelines across our Data Lake and into Synapse.Your expertise in PowerBI data sets and data flows will enable you to develop curated data sets...

  • Azure Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    About the RoleWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. As a key member of our team, you will be responsible for developing, deploying, and monitoring data pipelines across the Data Lake and into Synapse.Key Responsibilities:Develop and deploy data pipelines using Azure Data Factory and Azure SynapseDesign and...

  • Azure Data Engineer Specialist

    2 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    FunctieomschrijvingWe are seeking an experienced Azure Data Engineer to join our team at Dimension Data. The ideal candidate will have extensive experience developing Business Intelligence solutions, data marts, and transformations.The successful candidate will be responsible for developing, deploying, and monitoring data pipelines across the Data Lake and...

  • Data Engineer

    1 month ago

    Randburg, South Africa Datonomy Solutions Full time

    We are looking for a Data Engineer to join our team based in JHB. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Oracle, and will be responsible for designing, developing, and maintaining the data infrastructure. Key Responsibilities Data Pipeline Development: Design, build, and maintain scalable data...

  • Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa Datonomy Solutions Full time

    Key ResponsibilitiesWe are seeking a highly skilled Data Engineer to design, develop, and maintain our data infrastructure.Data Pipeline Development:Design and build scalable data pipelines to extract, transform, and load data from various sources.Develop ETL processes to ensure data quality and consistency across different systems.Data Integration and...

  • Data Systems Engineer

    2 weeks ago

    Randburg, Gauteng, South Africa Datonomy Solutions Full time

    We are seeking a skilled Data Engineer to design, develop, and maintain our data infrastructure at Datonomy Solutions.Data Pipeline Development:Design, build, and maintain scalable data pipelines to extract, transform, and load data from various sources.Develop ETL processes to integrate data from multiple sources and create a unified data environment.Data...

  • Data Engineer

    3 weeks ago

    Randburg, Gauteng, South Africa FirstRand Bank Limited Full time

    About the RoleWelcome to FirstRand Bank Limited, where innovation meets customer needs to transform the banking experience. Our team at FNB Interactions combines data expertise with business acumen to create actionable intelligence that drives business value and enhances customer interactions.As a Data Engineer in this dynamic environment, you will play a...

  • Data Analytics Engineer

    1 week ago

    Randburg, Gauteng, South Africa OneConnect Full time

    We empower our clients with actionable insights that drive business decisions through innovative data solutions.As a Senior BI Analyst/Data Engineer, you will be responsible for designing, developing, and optimizing our business intelligence and data engineering processes.You will play a critical role in transforming raw data into actionable insights,...

  • Senior Data Engineer

    1 month ago

    Randburg, Gauteng, South Africa OneConnect Full time

    About UsWe are a leading provider of innovative data solutions in the banking industry, empowering our clients with actionable insights to drive business decisions.Position OverviewWe are seeking a highly skilled Senior BI/Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing our business...

  • Data Engineer-1

    5 months ago

    Randburg, South Africa FirstRand Full time

    Job Description Hello Future Data Engineer II Welcome to FNB, the home of the #changeables. We design for the shapeshifters and deliver products and services that make us incredibly proud of people that make it happen. As part of our talent team, you will be surrounded by unique talents, diverse minds, and an adaptable environment that lives up to the...

  • Data Engineer

    2 months ago

    Randburg, South Africa Datonomy Solutions Full time

    The Group Data and Analytics Office is on the lookout for a skilled Ab Initio Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Ab Initio, and will be responsible for designing, developing, and maintaining the data infrastructure.Key ResponsibilitiesData Pipeline Development: Design, build, and maintain...

  • Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa Datonomy Solutions Full time

    Data Engineer - Design and Develop Scalable Data PipelinesWe are seeking a skilled Data Engineer to join our team at Datonomy Solutions. The ideal candidate will have extensive experience in data engineering, particularly with Ab Initio, and will be responsible for designing, developing, and maintaining scalable data pipelines.Key ResponsibilitiesDesign,...

  • Data Warehouse

    7 days ago

    Randburg, South Africa Syncwize Group Full time

    Data Warehouse and Data Analytics Engineer: Tax, Compliance Software Solutions and Design (Contract)We have a high-level, senior requirement within our financial services client for a Data Architect/Engineer with extensive experience on Tax Software Solutions, Designing and Analysing Data Warehouse solutions.Delivery and requirements on this contract include...

  • Senior BI Analyst/Data Engineer

    1 month ago

    Randburg, South Africa OneConnect Full time

    About Us: We are dedicated to transforming the banking industry through innovative data solutions. As a leader in financial services, we strive to empower our clients with actionable insights that drive business decisions. We are looking for a talented BI Analyst/Data Engineer to join our dynamic team and contribute to our mission of delivering excellence in...

  • Data Scientist

    4 months ago

    Randburg, South Africa Pillango Placements Full time

    If you are a curious, creative and innovative person with a passion for challenging, meaningful work, this role is for you! This is a unique opportunity to drive impactful healthcare innovations through a lean process, ensuring your ideas quickly translate into real-world solutions.Role PurposeCollaborating with cross-functional teams to identify and define...

Data Engineer

2 months ago

Randburg, South Africa ALOS Innovative Workforce Solution Full time
Data Engineer - AWS
Location: Gauteng
Applications: itplacements@alos.co.za

SKILLS REQUIREMENTS:

  • Terraform
  • Python 3x
  • SQL - Oracle/PostgreSQL
  • Py Spark
  • Boto3
  • ETL
  • Docker
  • Linux / Unix
  • Big Data
  • Powershell / Bash
  • Cloud Data Hub (CDH)
  • CDEC Blueprint
 
·        Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.
·        Experience developing technical documentation and artefacts.
·        Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc.
·        Experience working with Data Quality Tools such as Great Expectations.
·        Experience developing and working with REST API's is a bonus.
·        Basic experience in Networking and troubleshooting network issues.

Demonstrate expertise in data modelling Oracle SQL.
- Exceptional analytical skills analysing large and complex data sets.
- Perform thorough testing and data validation to ensure the accuracy of data transformations.
- Strong written and verbal communication skills, with precise documentation.
- Self-driven team player with ability to work independently and multi-task.
- Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
- Familiar with data store such as AWS S3, and AWS RDS or DynamoDB.
- Experience and solid understanding of various software design patterns.
- Experience preparing specifications from which programs will be written, designed, coded, tested and debugged.
- Strong organizational skills.

Basic experience/understanding of AWS Components
  • Glue
  • CloudWatch
  • SNS
  • Athena
  • S3
  • Kinesis Streams (Kinesis, Kinesis Firehose)
  • Lambda
  • DynamoDB
  • Step Function
  • Param Store
  • Secrets Manager
  • Code Build/Pipeline
  • CloudFormation
  • Business Intelligence (BI) Experience
  • Technical data modelling and schema design (“not drag and drop”)
  • Kafka 
·        AWS EMR
·        Redshift
 
QUALIFICATIONS/EXPERIENCE 

·        Relevant IT / Business / Engineering Degree
·        Certifications:
·        Candidates with one or more of the certifications are preferred.
·   AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate

ROLE AND RESPONSIBILITIES

e.g. Core Role tasks and responsibilities
Building and maintaining Big Data Pipelines using Data Platforms. 
Ensure that data is shared in line with the information classification requirements on a need-to-know basis.