AWS Data Engineer

3 days ago

centurion Gauteng, South Africa E-Merge Full time

Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team. This role offers an exciting opportunity to tackle complex challenges and make a substantial impact across multiple sectors. If you''re ready to leverage your skills and drive significant business value, this is the perfect opportunity for you

If you have the following, APPLY NOW.

Key Responsibilities:

  • Display exceptional analytical abilities to dissect intricate datasets of substantial size.
  • Perform thorough testing and validation procedures to guarantee the accuracy of data transformations.
  • Build resilient data pipelines, leveraging platforms like AWS Glue or Data Pipeline.
  • Craft precise specifications to direct the development, testing, and debugging phases.
  • Foster collaboration through effective use of Enterprise Collaboration tools such as Confluence and JIRA.
  • Harness expertise in Oracle SQL, showcasing prowess in data modeling.
  • Create technical documentation and artifacts to meet project needs comprehensively.
  • Employ Data Quality Tools like Great Expectations to maintain data integrity at all levels.
  • Experience with REST API development is advantageous.
  • Agile Working Model.

Qualifications :

Bachelor''s degree in IT, Business, or Engineering.

Experience:

  • Proficiency in Trino Distributed SQL queries.
  • Hands-on experience with Glue (ETL Scripting), CloudWatch, SNS, Athena, S3, Kinesis Streams (Kinesis, Kinesis Firehose), Lambda, DynamoDB, Step Function, Param Store, Secrets Manager, Code Build/Pipeline, and CloudFormation.
  • Expertise in technical data modeling and schema design, emphasizing practical implementation.
  • Knowledge of Kafka and AWS services like EMR and Redshift.

The Reference Number for this position is MM58957 which is a Contract position based in Centurion offering a rate of up to R700 per hour

  • AWS Data Engineer

    1 week ago

    Centurion, Gauteng, South Africa Liyema Consulting Full time

    Key Responsibilities:- Develop and maintain data pipelines using AWS technologies.- Implement and manage Big Data solutions.- Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:- Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.- Experience with ETL processes, Docker, Linux/Unix, and Big...

  • AWS Data Engineer

    1 week ago

    Centurion, Gauteng, South Africa Liyema Consulting Full time

    Key Responsibilities: Design, implement, and optimize Big Data Pipelines using AWS services. Ensure data integrity, security, and compliance. Collaborate with crossfunctional teams to integrate solutions. Develop and maintain technical documentation. Conduct thorough testing and validation of data solutions. Stay updated with industry trends and best...

  • AWS Data Engineer

    1 month ago

    Centurion, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:- Design, implement, and optimize Big Data Pipelines using AWS services.- Ensure data integrity, security, and compliance.- Collaborate with cross-functional teams to integrate solutions.- Develop and maintain technical documentation.- Conduct thorough testing and validation of data solutions.- Stay updated with industry trends and best...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:- Design, implement, and optimize Big Data Pipelines using AWS services.- Ensure data integrity, security, and compliance.- Collaborate with cross-functional teams to integrate solutions.- Develop and maintain technical documentation.- Conduct thorough testing and validation of data solutions.- Stay updated with industry trends and best...

  • AWS Data Engineer

    1 month ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities:- Design, implement, and optimize Big Data Pipelines using AWS services.- Ensure data integrity, security, and compliance.- Collaborate with cross-functional teams to integrate solutions.- Develop and maintain technical documentation.- Conduct thorough testing and validation of data solutions.- Stay updated with industry trends and best...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities: Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills: Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    3 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    3 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    4 weeks ago

    Centurion, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills:Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Engineer

    3 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    Key Responsibilities: Develop and maintain data pipelines using AWS technologies.Implement and manage Big Data solutions.Collaborate within Agile teams to deliver high-quality data solutions.Essential Skills: Proficiency in Terraform, Python 3.x, SQL (Oracle/PostgreSQL), PySpark, and Boto3.Experience with ETL processes, Docker, Linux/Unix, and Big Data...

  • AWS Data Cloud Engineer

    1 month ago

    Johannesburg, Gauteng, South Africa GoldenRule Technology (Pty) Ltd Full time

    The RoleA leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer)Skills And ExperienceKnowledge /Qualifications High knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companiesDemonstrated project development and leadership...

  • AWS Data Engineer

    3 days ago

    Centurion, South Africa E-Merge Full time

    Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team. This role offers an exciting opportunity to tackle complex challenges and make a substantial impact...

  • Snr Specialist: Data Engineering

    2 weeks ago

    Centurion, South Africa BCXP Full time

    Business unit, Department, Reporting Business Unit DPS, Business and Digital Advisory Department Data Insights and Intelligence Job grade S4 Core Description Responsible for supporting the delivery of data science projects and solutions by leveraging your data and software engineering experience. Will be required to lead a small team of engineers through...

  • Python & AWS Software Engineer (Senior)

    4 weeks ago

    Centurion, South Africa Adzuna ZA B C2 Full time

    What You'll Do:Develop APIs and ETL pipelines using Python and AWS (Lambda, DynamoDB, EMR, etc.).Implement CI/CD pipelines with Code Build and Github Actions.Work on Terraform for infrastructure as code (IAC) deployments.Collaborate with Munich teams on impactful projects.What You'll Bring:3-5 years of experience in Python and AWS technologies.Strong...

  • Python & AWS Software Engineer (Senior)

    4 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    What You'll Do:Develop APIs and ETL pipelines using Python and AWS (Lambda, DynamoDB, EMR, etc.).Implement CI/CD pipelines with Code Build and Github Actions.Work on Terraform for infrastructure as code (IAC) deployments.Collaborate with Munich teams on impactful projects.What You'll Bring:3-5 years of experience in Python and AWS technologies.Strong...

  • Python & AWS Software Engineer (Senior)

    4 weeks ago

    Centurion, South Africa Liyema Consulting Full time

    What You'll Do: Develop APIs and ETL pipelines using Python and AWS (Lambda, DynamoDB, EMR, etc.).Implement CI/CD pipelines with Code Build and Github Actions.Work on Terraform for infrastructure as code (IAC) deployments.Collaborate with Munich teams on impactful projects.What You'll Bring: 3-5 years of experience in Python and AWS technologies.Strong...

  • Python & AWS Software Engineer (Senior)

    1 week ago

    Centurion, Gauteng, South Africa Liyema Consulting Full time

    Responsibilities:- Develop APIs and ETL pipelines using Python and AWS technologies like Lambda, DynamoDB, and EMR.- Implement CI/CD workflows with tools such as Code Build and Github Actions.- Utilize Terraform for infrastructure as code (IAC) deployments.- Engage with teams in Munich on impactful projects.Qualifications:- 3-5 years of hands-on experience...