AWS Data Engineer

2 weeks ago

Pretoria North, South Africa CodeConnect Staffing (Pty) Ltd Full time

Overview

An exciting opportunity has become available for an experienced AWS Data Engineer. In this role, you'll be responsible for building and managing scalable data systems, from setting up data sources to integrating analytical tools, using AWS services.

Key Responsibilities:

  • Data Architecture & Management: Design and maintain data systems using AWS services (e.g., AWS S3, AWS Glue, Athena). Organize data effectively and ensure easy access through data partitioning and cataloging strategies.
  • ETL Pipeline Development: Develop and optimize ETL (Extract, Transform, Load) pipelines using AWS Glue and PySpark. Focus on improving performance, scalability, and cost-efficiency in batch and real-time data processing.
  • Automation & Monitoring: Automate workflows and ensure they run efficiently. Set up monitoring and alerts for data pipelines, and optimize AWS resources for scalability and performance.
  • Security & Compliance: Follow security best practices, including API authentication, data encryption, and compliance with GDPR, HIPAA, and SOC2.
  • Collaboration & Mentorship: Work closely with data scientists, analysts, and backend teams to integrate data pipelines. Provide mentorship to junior team members and encourage growth and collaboration.
  • Quality Management: Ensure high-quality software development standards by adhering to best practices and complying with industry regulations like ISO, CE, and FDA.

Key Skills and Experience (5+ Years Required):

  • AWS Services: Experience with AWS Glue, S3, Lambda, Athena, and CloudWatch.
  • Data Engineering: Proven experience developing and optimizing ETL pipelines. Familiarity with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, DynamoDB).
  • Programming: Strong skills in Python, particularly using PySpark with AWS Glue.
  • Data Modeling & Optimization: Experience in data modeling, schema design, and database optimization.
  • Machine Learning: Experience integrating data pipelines with machine learning workflows and deploying models with AWS SageMaker.
  • Compliance & Security: Knowledge of data governance, API security, and compliance with industry standards and regulations.

Education & Certification Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • AWS certifications, such as AWS Certified Data Engineer, Solutions Architect, or Data Analyst, are highly desirable.

  • AWS Data Engineer

    7 days ago

    Pretoria, Gauteng, South Africa Mediro ICT Recruitment Full time

    The RoleAs a senior big data developer, you will be responsible for building and maintaining big data pipelines using AWS data platforms. You will work closely with the data engineering team to design, develop, and deploy scalable and efficient data processing systems.Key Responsibilities:Design and develop data pipelines using AWS Glue, Data Pipeline, and...

  • AWS Data Engineer

    1 week ago

    Pretoria, Gauteng, South Africa CodeConnect Staffing (Pty) Ltd Full time

    An exciting opportunity has become available for an experienced AWS Data Engineer. In this role, you'll be responsible for building and managing scalable data systems, from setting up data sources to integrating analytical tools, using AWS services.Key Responsibilities :Data Architecture & Management : Design and maintain data systems using AWS services...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa hearX Group Full time

    Candidate will be responsible for creating and managing the technological part of data infrastructure in every step of data flow. From configuring data sources to integrating analytical tools — all these systems would be architected, built, and managed by a general-role data engineer.Minimum applicable experience (years): 5+ years working experienceMinimum...

  • Senior AWS Data Engineer

    7 days ago

    Pretoria, Gauteng, South Africa Mediro Ict Recruitment Full time

    Job Overview">Mediro ICT Recruitment is seeking an experienced AWS Data Engineer (Senior) to join their team in Pretoria. The ideal candidate will have a strong background in building and maintaining Big Data Pipelines using AWS Data Platforms.Key Responsibilities:">">Analyze large and complex data sets to identify trends and patterns">Design, develop, and...

  • Aws Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Hearx Group Full time

    Overview: An exciting opportunity has become available for an experienced AWS Data Engineer.In this role, you'll be responsible for building and managing scalable data systems, from setting up data sources to integrating analytical tools, using AWS services.Key Responsibilities:Data Architecture & Management: Design and maintain data systems using AWS...

  • Senior Data Engineer

    14 hours ago

    Pretoria, Gauteng, South Africa Jordan Human Resource Full time

    Job SummaryJordan Human Resource is looking for a highly skilled AWS Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing complex data processing systems on the AWS platform.About the RoleThis is a senior-level position that requires strong leadership skills, excellent...

  • AWS Big Data Engineer

    7 days ago

    Pretoria, Gauteng, South Africa Emphyre Full time

    At Emphyre, we are seeking an experienced AWS Data Engineer to join our team. The ideal candidate will have a strong background in building and maintaining big data pipelines using data platforms and ensuring that data is shared in line with information classification requirements on a need-to-know basis.Duties & ResponsibilitiesExceptional analytical skills...

  • Aws Data Engineer Market Related

    2 weeks ago

    Pretoria, Gauteng, South Africa Cruze Control Technologies Full time

    AWS Data EngineerThe AWS Data Engineer will be responsible for building and maintaining Big Data Pipelines using Data Platforms and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.Duties & ResponsibilitiesExceptional analytical skills analyzing large and complex data sets.Perform thorough...

  • AWS Data Infrastructure Specialist

    5 hours ago

    Pretoria, Gauteng, South Africa hearX Group Full time

    Job Summary: We are seeking an experienced Data Engineer to join our team at hearX Group. The ideal candidate will have a strong background in designing and implementing scalable data architectures using AWS services.The Data Engineer will be responsible for creating and managing the technological part of data infrastructure in every step of data flow, from...

  • Aws Engineer Pretoria

    7 days ago

    Pretoria, Gauteng, South Africa Mediro Ict Recruitment Full time

    Job DescriptionOur client in Pretoria is recruiting for an AWS Data Engineer (Senior) to join their team.Data Engineers are responsible for building and maintaining Big Data Pipelines using our client's Data Platforms. They are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know...

  • AWS Cloud Data Specialist

    1 week ago

    Pretoria, Gauteng, South Africa CodeConnect Staffing (Pty) Ltd Full time

    Job DescriptionAWS Data Engineer Job SummaryWe are seeking an experienced AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing scalable data systems using AWS services.This role is a great opportunity for individuals who want to work on challenging projects and make a real impact on our...

  • Aws Engineer Pretoria

    2 weeks ago

    Pretoria, Gauteng, South Africa Mediro ICT Recruitment Full time

    Job DescriptionOur client in Pretoria is recruiting for an AWS Data Engineer (Senior) to join their team. Data Engineers are responsible for building and maintaining Big Data Pipelines using our client's Data Platforms. They are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know...

  • AWS Cloud Engineer

    4 days ago

    Pretoria, Gauteng, South Africa Jordan Human Resource Full time

    About Jordan Human Resource: We are a leading HR solutions provider that helps businesses find top talent. As an AWS Engineer, you will play a key role in helping our clients navigate the ever-changing world of cloud computing.About the Role: Our client is seeking a skilled AWS Engineer to join their team. The ideal candidate will have experience with...

  • AWS Data Engineer

    2 weeks ago

    Pretoria North, South Africa CodeConnect Staffing (Pty) Ltd Full time

    Job Specifics: Industry: Medical DevicesEmployment Type: Full-timeWork Model: Hybrid (On-site for first 3 months of employment, thereafter hybrid)Overview:The Senior GOLang Backend Developer will be responsible for developing, maintaining, and optimizing software solutions. The role involves leading projects, ensuring high-quality code, and implementing best...

  • AWS Data Engineer

    5 days ago

    Pretoria North, South Africa CodeConnect Staffing (Pty) Ltd Full time

    Job Specifics: Industry: Medical Devices Employment Type: Full-time Work Model: Hybrid (On-site for first 3 months of employment, thereafter hybrid) Overview: The Senior GOLang Backend Developer will be responsible for developing, maintaining, and optimizing software solutions. The role involves leading projects, ensuring high-quality code, and...

  • AWS Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Jordan Human Resource Full time

    Reference: JHB009156-ZN-1Our Client in the IT industry is looking for an AWS Data Engineer. If you meet the below requirements, kindly send us your CV.Duties & ResponsibilitiesESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig...

  • Aws Engineer

    7 days ago

    Pretoria, Gauteng, South Africa Jordan Human Resource Full time

    Reference : JHB-ZN-1Our Client in the IT industry is looking for an AWS Data Engineer.If you meet the below requirements, kindly send us your CV.Duties & ResponsibilitiesESSENTIAL SKILLS REQUIREMENTS:Above average experience / understanding (in order of importance):TerraformPython 3SQL - Oracle / PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell...

  • Aws Data Engineer

    7 days ago

    Pretoria, Gauteng, South Africa Mediro Ict Recruitment Full time

    Job DescriptionOur client in Pretoria is recruiting for an AWS Data Engineer (Senior) to join their team.Data Engineers are responsible for building and maintaining Big Data Pipelines using our client's Data Platforms.They are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Mediro ICT Recruitment Full time

    Job DescriptionOur client in Pretoria is recruiting for an AWS Data Engineer (Advanced) to join their team. Data Engineers are responsible for building and maintaining Big Data Pipelines using our client's Data Platforms. They are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know...

  • Aws Data Engineer

    6 days ago

    Pretoria, Gauteng, South Africa Mediro Ict Recruitment Full time

    Job DescriptionOur client in Pretoria is recruiting for an AWS Data Engineer (Senior) to join their team.Data Engineers are responsible for building and maintaining Big Data Pipelines using our client's Data Platforms. They are custodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know...