AWS Data Engineer

3 weeks ago

Johannesburg, Gauteng, South Africa Network Recruitment Full time
Minimum Experience:
  • 5 years of experience in Python/C# development
  • 3 years of experience in AWS Data Engineering
Education Requirements:
  • Bachelors degree in Computer Science, Information Systems, or a related field
Advantageous:
  • AWS Certified Machine Learning Specialty Certificate
Responsibilities:
  • Design and create data models that can extract information from various sources and store it in a usable format
  • Lead the design, implementation, and successful delivery of large-scale, complex data solutions
  • Utilize expertise in SQL, ETL, and data modeling to create robust data pipelines
  • Ingest data into AWS S3 and perform ETL into RDS or Redshift
  • Use AWS Lambda (C# or Python) for event-driven data transformations
  • Design and implement security measures to protect data from unauthorized access or misuse
  • Ensure data integrity by designing backup and recovery procedures
  • Automate the migration process in AWS from development to production
  • Deliver actionable and digestible data content to support business decisions
  • Be involved in the full spectrum of data engineering, from planning and estimation to architecture, pipeline design, delivery, and production implementation
  • Design and implement complex data solutions, from batch to streaming and event-driven architectures across cloud, on-premise, and hybrid technology landscapes
  • Optimize cloud workloads for cost, scalability, availability, governance, and compliance
Qualifications and Competencies:
  • Experience with AWS Glue Jobs using PySpark or AWS Glue Spark
  • Real-time ingestion using KAFKA is an added advantage
  • Strong SQL and C# or Python programming skills
  • Object-oriented principles in C# or Python: classes, inheritance
  • Expert knowledge of data engineering packages and libraries in C# or Python
  • AWS technical certifications (Developer Associate or Solutions Architect)
  • Experience with the development and delivery of microservices using serverless AWS services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
  • Ability to articulate technical and non-technical requirements to different audiences
  • Experience with RDBMS databases such as Postgres, SQL Server, and MySQL
  • Proficiency in scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl, etc.
  • Strong stakeholder management and communication skills, including problem-solving and relationship-building
  • Ability to troubleshoot data issues efficiently and effectively
  • Extensive experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies
  • Experience in implementing and delivering data solutions and pipelines on the AWS Cloud Platform
  • Strong understanding of data modeling, data structures, databases, and ETL processes
  • In-depth understanding of large-scale data sets, including both structured and unstructured data
  • Experience in delivering CI/CD and DevOps capabilities in a data environment
  • Ability to communicate complex technical ideas clearly
  • Experience in the financial industry is a plus
  • AWS Certified Machine Learning Specialty Certificate is an advantage
Apply now

  • AWS Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    We are seeking an AWS Data Engineer to develop data products and pipelines in cloud and on-premises environments. Utilize your skills in Python, Dbt, and Apache Airflow to enhance business insights and operational efficiency.Key Responsibilities:Build data lakes and APIs using AWS (S3, Quicksight).Design data models and implement CI/CD workflows.Collaborate...

  • AWS Data Engineer

    1 week ago

    Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    We are seeking an AWS Data Engineer to develop data products and pipelines in cloud and on-premises environments. Utilize your skills in Python, Dbt, and Apache Airflow to enhance business insights and operational efficiency. Key Responsibilities: Build data lakes and APIs using AWS (S3, Quicksight). Design data models and implement CI/CD workflows. ...

  • AWS Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa PRR Recruitment Full time

    We are seeking an AWS Data Engineer to develop data products and pipelines in cloud and on-premises environments. Utilize your skills in Python, Dbt, and Apache Airflow to enhance business insights and operational efficiency.Key Responsibilities:Build data lakes and APIs using AWS (S3, Quicksight).Design data models and implement CI/CD workflows.Collaborate...

  • AWS Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Minimum Experience: 5 years of experience in Python/C# development 3 years of experience in AWS data engineering Education Requirements: Bachelors Degree in Computer Science, Information Systems, or a related field Advantageous: AWS Certified Machine Learning Specialty Certificate Responsibilities: Design and create data models that can extract information...

  • AWS Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    Minimum Experience:5 years of experience in Python/C# development3 years of experience in AWS data engineeringEducation Requirements:Bachelors Degree in Computer Science, Information Systems, or a related fieldAdvantageous:AWS Certified Machine Learning Specialty CertificateResponsibilities:Design and create data models that can extract information from...

  • Senior AWS Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...

  • Senior AWS Data Engineer

    2 weeks ago

    Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.  Minimum QualificationsBachelor's Degree in Computer Science, Information Technology, or other relevant fields.Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...

  • Senior AWS Data Engineer

    2 days ago

    Johannesburg, Gauteng, South Africa Golden Rule Full time

    Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer.   Minimum Qualifications Bachelor's Degree in Computer Science, Information Technology, or other relevant fields. Has experience in any of the following AWS Athena, AWS Glue, Pyspark, AWS DynamoDB, AWS Redshift, AWS Lambda and AWS Step...

  • AWS Cloud Data Engineer

    4 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    African capital markets leader E-Merge has a comprehensive suite of products and global reach, positioning itself as a local bank with regional and international expertise. We have a vacant position for an AWS Data Engineer to work within a team solving complex problems to deliver real business value across various industries, including helping develop best...

  • AWS Data Engineering Lead

    1 day ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge OverviewE-Merge is a pioneering company specializing in cloud data solutions, aiming to revolutionize the way businesses operate through innovative technology.Job OpportunityWe invite applications from experienced professionals for the position of AWS Data Engineering Lead. As a key member of our data engineering team, you will design and implement...

  • AWS Data Cloud Engineer

    1 day ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    A leader in the insurance space is on the lookout for an AWS Data Cloud Engineer (Big Data Engineer).Knowledge / QualificationsHigh knowledge in AWS – security groups, permissions, VPC, roles, services.Experience developing engineering applications in corporate companies.Demonstrated project development and leadership skills.Master's degree in Computer...

  • AWS Cloud Data Engineer

    1 day ago

    Johannesburg, Gauteng, South Africa PBT Group Full time

    PBT Group has an opportunity for an AWS Cloud Data Engineer.Duties:Coordinate / Prioritise the work that the Developers and Product OwnerAssist with cross-team projects that involve development.AWS practices are followed with sound security and governance.Coordinate with the cloud Center of Excellence team for any AWS account level security and...

  • AWS Data Cloud Solutions Engineer

    1 day ago

    Johannesburg, Gauteng, South Africa Planet10 Full time

    A leading insurance company seeks a skilled AWS Data Cloud Engineer to design, implement, and manage large-scale data processing systems.ResponsibilitiesCreate high-performance data pipelines using AWS services such as Glue, Lake Formation, and Redshift.Develop and maintain scalable data architectures for batch and real-time data processing.Collaborate with...

  • Johannesburg AWS Data Professional

    3 days ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    E-Merge, a leading African capital markets company, seeks an experienced AWS Data Engineer to join our team in Johannesburg. As a key member of our data engineering team, you will be responsible for designing, implementing, and delivering large-scale, critical data solutions that drive business value across various industries.Key Skills and...

  • AWS Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, South Africa E-Merge Full time

    A leader in African capital markets with a comprehensive suite of products, a vast global reach while and an acute positioning as a local bank with the expertise ability to leverage on local presence with regional and international expertise has a vacant position for an AWS Data Engineer to work within a team solving complex problems to deliver real business...

  • Data Engineer

    6 days ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications:Bachelors Degree in Computer Science, Computer Engineering, or related...

  • Data Engineer(AWS)

    2 days ago

    Johannesburg, Gauteng, South Africa Falcorp Resourcing Full time

    Reference: JHB000028-MM-2Falcorp Technologies is seeking a mature and meticulous Data Analyst who will be responsible for retrieving and gathering data, organizing it, and using it to reach meaningful conclusions. We're looking for a Data Analyst who has strong SQL experience; telco experience will be advantageous.Duties & ResponsibilitiesExtract, translate,...

  • Data Engineer

    5 days ago

    Johannesburg, Gauteng, South Africa Network Recruitment Full time

    A leading technology-driven company is seeking a skilled Data Engineer to design, build, and optimize data pipelines for real-time and batch processing. If you're passionate about big data, cloud technologies, and scalable solutions, this is your chance to make an impactQualifications: Bachelors Degree in Computer Science, Computer Engineering, or a related...

  • AWS Cloud Data Architect

    1 day ago

    Johannesburg, Gauteng, South Africa Golden Rule Full time

    Company OverviewOur client is a leader in the Financial Services space with an exciting opportunity for a Senior AWS Data Engineer.The ideal candidate will have experience working with large-scale enterprise data solutions and a strong understanding of cloud computing platforms.

  • AWS Solutions Architect

    1 hour ago

    Johannesburg, Gauteng, South Africa Dimension Data Full time

    Do you want to work for a company that is willing to invest in your personal development? Do you want to make an impact on people's lives every day? Do you have experience working in the cloud, with AWS (Amazon Web Services) or related technologies? This role may be perfect for youAs an AWS Solutions Architect, you'll work closely with the technical team to...