AWS Data Engineer

4 weeks ago

Johannesburg, South Africa E-Merge Full time

An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public sectors seeks a highly motivated and experienced AWS Data Engineer to join their Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark.

Responsibilities:

  • Creating data models that can be used to extract information from various sources
  • Lead the design, implementation, and successful delivery of large-scale, critical, or

difficult data solutions involving a significant amount of data

  • Utilise expertise in SQL and have a strong understanding of ETL and data modelling
  • Ability to ingest data into AWS S3, perform ETL into RDS or Redshift
  • Use AWS Lambda (C# or Python) for event-driven data transformations
  • Designing and implementing security measures to protect data from unauthorized

access or misuse

  • Maintaining the integrity of data by designing backup and recovery procedures
  • Work on automating the migration process in AWS from development to production

Experience and Qualifications:

  • Bachelor''s degree in Computer Science, Information Systems, or related field.
  • AWS Certified Machine Learning Specialty Certificate
  • Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark
  • 5 Years Python/C# Development
  • 3 Years AWS Data Engineering
  • Strong SQL and C# or Python programming knowledge
  • Objective oriented principles in C# or Python
  • AWS technical certifications (Developer Associate or Solutions Architect)
  • services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
  • Experience working with RDBMS databases, such as Postgres, SQL Server

The Reference Number for this position is NG58761 which is a Permanent Hybrid position based in Johannesburg offering a cost to company salary negotiable from R500k to R650k Per Annum based experience and ability. Contact Nokuthula at

  • Aws Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    This technology company is enthusiastic about resolving business challenges for their clients and is actively seeking an AWS Data Engineer to join their team. By employing advanced data analytics, actuarial services, software development, and automation, this remarkable business serves both large corporations listed on the JSE and non-listed clients in the...

  • AWS Data Engineer/JHB

    4 weeks ago

    Johannesburg, South Africa Rooftop Recruitment Full time

    AWS Data Engineer/JHBContract Type: 12 monthsOur client is seeking a highly motivated and experienced AWS Data Engineer to join their GlobalMarkets division. The role is responsible for closely working the traders, quantitative analysts, andData Scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business.The...

  • Cloud Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • AWS Data Engineer

    1 month ago

    Johannesburg, South Africa ACB Consulting Full time

    “As part of our next project, we need to migrate existing cloud infrastructure from a set of source AWS accounts to a new set of target accounts. We need to make some functional changes and enhancements along the way so it won’t be simple copy-and-paste. Additionally, the target infrastructure needs to be managed by Terraform (which is currently not used...

  • Aws Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    A dynamic global group with a focus on innovation topics as well as comprehensive IT solutions and Global Team collaboration driving experiences with a deep insight into the compliance and IT Methodology processes is recruiting for an AWS Data Engineer to join an environment with cutting edge global IT system landscape and processesRequirements:Demonstrate...

  • AWS Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa ACB Consulting Full time

    "As part of our next project, we need to migrate existing cloud infrastructure from a set of source AWS accounts to a new set of target accounts. We need to make some functional changes and enhancements along the way so it won't be simple copy-and-paste. Additionally, the target infrastructure needs to be managed by Terraform (which is currently not used in...

  • AWS Data Engineer

    1 month ago

    Johannesburg, South Africa ACB Consulting Full time

    “As part of our next project, we need to migrate existing cloud infrastructure from a set of source AWS accounts to a new set of target accounts. We need to make some functional changes and enhancements along the way so it won’t be simple copy-and-paste. Additionally, the target infrastructure needs to be managed by Terraform (which is currently not used...

  • Cloud Data Engineer

    4 weeks ago

    Johannesburg, South Africa Dimension Data Full time

    The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while...

  • AWS Data Engineer with DataBricks

    4 weeks ago

    Johannesburg, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, with DataBricks experience.   Duties: Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake. Analyze, re-architect and...

  • AWS Data Engineer with DataBricks

    1 month ago

    Johannesburg, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, with DataBricks experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.Analyze, re-architect and...

  • AWS Data Engineer with DataBricks

    4 weeks ago

    Johannesburg, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Data Engineer, with DataBricks experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.Analyze, re-architect and...

  • AWS Data Cloud Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications High knowledge in AWS – security groups, permissions, VPC, roles, services. Experience developing engineering applications in Corporate companies Demonstrated project development and leadership skills Master's degree in Computer...

  • Aws Data Cloud Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    Job Description:A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (Big Data Engineer)Knowledge/Qualifications:High knowledge in AWS - security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companies.Demonstrated project development and leadership skills.Master's degree in...

  • AWS Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PM Connection Full time

    Job Title: Cloud Infrastructure Migration SpecialistCompany: Innovative Solutions Inc.As part of our exciting upcoming project, we are looking for a skilled professional to lead the migration of our cloud infrastructure from existing AWS accounts to new target accounts. This task involves more than just a simple transfer; it requires strategic functional...

  • AWS Data Cloud Engineer

    4 weeks ago

    Johannesburg, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications  High knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in Corporate companiesDemonstrated project development and leadership skillsMaster's degree in...

  • AWS Data Cloud Engineer

    4 weeks ago

    Johannesburg, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer)  Knowledge /Qualifications   High knowledge in AWS – security groups, permissions, VPC, roles, services. Experience developing engineering applications in Corporate companies Demonstrated project development and leadership skills Master's degree...

  • AWS Cloud Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Cloud Data Engineer. Duties:Coordinate/Prioritise the work that the Developers and Product OwnerAssist with cross-team projects that involve development.AWS practices are followed with sound security and governance.Coordinate with the cloud Center of Excellence team for any AWS account level security and access.Resolve...

  • AWS Data Cloud Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Psybergate Full time

    What you will be doing: Coordinate/Prioritize the work that the Developers and POAssist with cross-team projects that involve developmentAWS practices are followed with sound security and governance.Coordinate with the cloud COE team for any AWS account level security and access.Resolve any security findings on your responsible AWS accounts given by group...

  • AWS Data Cloud Engineer

    4 weeks ago

    Johannesburg, South Africa Psybergate Full time

    What you will be doing: Coordinate/Prioritize the work that the Developers and POAssist with cross-team projects that involve developmentAWS practices are followed with sound security and governance.Coordinate with the cloud COE team for any AWS account level security and access.Resolve any security findings on your responsible AWS accounts given by group...

  • AWS Data Cloud Engineer

    1 month ago

    Johannesburg, South Africa Adzuna ZA B C2 Full time

    What you will be doing: Coordinate/Prioritize the work that the Developers and POAssist with cross-team projects that involve developmentAWS practices are followed with sound security and governance.Coordinate with the cloud COE team for any AWS account level security and access.Resolve any security findings on your responsible AWS accounts given by group...