Aws Data Engineer

4 weeks ago

Randburg, Gauteng, South Africa Zensar Technologies Full time

Role : AWS Data Engineer

Location : Johannesburg

Advantage of Zensar Technologies
We are a technology consulting and services company with 11,+ associates in 33 global locations. More than leading enterprises depend on our expertise to be more disruptive, agile, and competitive. Our success in South Africa for 24 years comes from our people-first focus that emphasizes empowerment from the ground up. Zensar is recognized as proudly South African and is the Top Employer in South Africa by the Top Employer Institute.

Zensar is a certified B-BBEE Level 2 contributor and partners with MICT, SETA, Education Africa, and Tomorrow Trust. We strongly believe in the power of communities and leveraging diversity to solve problems together. Zensar is a place where you are free to express yourself in an environment that values individuality, nurtures development, and is mindful of wellbeing. We put our people and customers at the center of everything that we do. Our core values include: Putting people first, Client-centricity, Collaboration, Grow, Own, Achieve, Learn.

About the Role:
We are seeking a highly motivated and experienced AWS Data Engineer to join our Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business.

The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark. This role offers an exciting opportunity to collaborate with leading financial institutions, contributing to the design and implementation of data pipelines to support global markets business. It will be advantageous if the candidate has the AWS Certified Machine Learning – Specialty Certificate or can develop machine learning (ML) models and automate ML pipelines.

Minimum Experience:
5 Years Python / C# Development
3 Years AWS Data Engineering

Education Requirements:
Bachelor's degree in Computer Science, Information Systems, or related field.
Advantageous: AWS Certified Machine Learning – Specialty Certificate

Responsibilities:
Creating data models that can be used to extract information from various sources and store it in a usable format.
Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data.
Utilize expertise in SQL and have a strong understanding of ETL and data modelling.
Ability to ingest data into AWS S3, perform ETL into RDS or Redshift.
Use AWS Lambda (C# or Python) for event-driven data transformations.
Designing and implementing security measures to protect data from unauthorized access or misuse.
Maintaining the integrity of data by designing backup and recovery procedures.
Work on automating the migration process in AWS from development to production.
You will deliver digestible, contemporary, and immediate data content to support and drive business decisions.
You will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation.
From day one, you will be involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes.
Optimize cloud workloads for cost, scalability, availability, governance, compliance, etc.

Qualifications and Competencies:
Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark.
Realtime ingestion using KAFKA is an added advantage.
Strong SQL and C# or Python programming knowledge.
Objective-oriented principles in C# or Python: classes and inheritance.
Expert knowledge of data engineering packages and libraries and related functions in C# or Python.
AWS technical certifications (Developer Associate or Solutions Architect).
Experience with development and delivery of microservices using serverless AWS services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM).
Ability to understand and articulate requirements to technical and non-technical audiences.
Have experience working with RDBMS databases, such as Postgres, SQL Server, and MySQL.
Apply knowledge of scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl, etc.
Stakeholder management and communication skills, including prioritizing, problem solving, and interpersonal relationship building.
Effectively and efficiently troubleshoot data issues and errors.
Strong experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies.
Experience delivering in an agile environment.
Experience in implementing and delivering data solutions and pipelines on AWS Cloud Platform.
A strong understanding of data modelling, data structures, databases, and ETL processes.
An in-depth understanding of large-scale data sets, including both structured and unstructured data.
Knowledge and experience in delivering CI / CD and DevOps capabilities in a data environment.
Ability to clearly communicate complex technical ideas.
Experience in the financial industry is a plus.
An AWS Certified Machine Learning – Specialty Certificate is an advantage.

If you are passionate about working with data and have a desire to work in a dynamic and challenging environment, we encourage you to apply.

This is an excellent opportunity to make a significant impact in a leading investment bank and to grow your career in data engineering.

#J-18808-Ljbffr

  • AWS Data Engineer

    3 weeks ago

    Randburg, Gauteng, South Africa PRR Recruitment Services Full time

    We are seeking an AWS Data Engineer to develop data products and pipelines in cloud and on-premises environments. Utilize your skills in Python, Dbt, and Apache Airflow to enhance business insights and operational efficiency.Key Responsibilities :Build data lakes and APIs using AWS (S3, Quicksight).Design data models and implement CI / CD...

  • AWS DevOps Engineer

    3 weeks ago

    Randburg, Gauteng, South Africa Datafin Full time

    An international Company, with a modern data automation and integration platform, that enables enterprises to innovate faster by unlocking and optimizing data across multiple services and systems, is seeking to employ a remotely based DevOps Engineer. You will be responsible for managing the availability, performance, security, and scalability of our cloud...

  • Senior Data Engineering Expert

    1 week ago

    Randburg, Gauteng, South Africa NTT Data Full time

    We are seeking a highly skilled Senior Data Engineering Expert to join our team at NTT Data.Job DescriptionThe Senior Data Engineering Expert will be responsible for developing, maintaining, and testing data infrastructures that support our business operations. This role involves designing and implementing optimal data pipeline architectures, assembling...

  • Data Pipeline Architect and Engineer

    1 week ago

    Randburg, Gauteng, South Africa NTT Data Full time

    We are looking for a highly skilled Data Pipeline Architect and Engineer to join our team at NTT Data.About the RoleThe Data Pipeline Architect and Engineer will be responsible for designing, developing, and maintaining data pipelines that support our business operations. This role involves building and optimizing data pipelines, assembling large and complex...

  • AWS Data Engineer – Johannesburg – R530 to R630 per hour

    4 weeks ago

    Randburg, Gauteng, South Africa E-Merge Full time

    An IT South Africa Hub delivering cutting-edge IT solutions to the global Group and specialising in innovative and comprehensive IT services, including Development and Operations for SAP, JAVA, Azure, Cloud, ensure deep integration with compliance, IT methodology, and quality standards have an opening for anResponsibilities:Responsible for designing,...

  • Senior Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa E-Merge Full time

    Senior Data Engineer (AWS) - Johannesburg – R800k to R1mil per annumPOSITION INFO :A leading African Corporate Investment Bank and part of one of the largest financial services groups that are passionate Solutionists who offer clients innovative advisory, funding, trading, corporate and principal investing solutions have a vacant role for a Senior AWS Data...

  • Aws Solutions Architect

    3 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Do you want to work for a company that is willing to invest in your personal development?Do you want to make an impact on people's lives every day?Do you have experience working in the cloud, with AWS (Amazon Web Services) or related technologies?This role may be perfect for you As an AWS Solutions Architect, you'll work closely with the technical team to...

  • Aws Solutions Architect

    2 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Do you want to work for a company that is willing to invest in your personal development? Do you want to make an impact on people's lives every day? Do you have experience working in the cloud, with AWS (Amazon Web Services) or related technologies? This role may be perfect for you As an AWS Solutions Architect, you'll work closely with the technical...

  • Data Streaming Engineer

    3 weeks ago

    Randburg, Gauteng, South Africa Golden Rule Full time

    Build, enhance, and maintain our real-time data pipeline. Work with various infrastructure and operations teams to maintain our data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the continued growth of the bank. You will collaborate with many...

  • AWS Data Scientist

    4 weeks ago

    Randburg, Gauteng, South Africa Sabenza IT & Recruitment Full time

    Exciting Data Scientist Role in Global MarketsAre you passionate about market-making models, high-frequency trading, and cutting-edge machine learning? Join a top-tier team revolutionizing equities and derivatives trading with advanced AI-driven analytics Work with AWS (S3, SageMaker), Python, and SQL to develop and optimize trading algorithms. Leverage...

  • Data Engineer

    1 week ago

    Randburg, Gauteng, South Africa CIBA Industries Full time

    Job Title: Data Engineer Location: Johannesburg Job Type: Contract (8-month contract) Work Arrangement: HybridOur client is looking for a skilled Data Engineer to join the team on a contract basis, working within a dynamic and fast-paced banking/financial services environment. The ideal candidate will have solid experience in designing and building robust...

  • Azure Data Engineer

    3 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Are you tired of micro-managing your Azure servers? Do you want to work with one of the best teams in the region? Apply for this Azure Data Engineer roleOur client requires an Azure Data Engineer to develop, deploy and monitor data pipelines across the Data Lake and into Synapse. Develop PowerBI data sets and data flows and develop curated data sets for...

  • Azure Data Engineer

    2 weeks ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Are you tired of micro-managing your Azure servers? Do you want to work with one of the best teams in the region? Apply for this Azure Data Engineer role Our client requires an Azure Data Engineer to develop, deploy and monitor data pipelines across the Data Lake and into Synapse. Develop PowerBI data sets and data flows and develop curated data sets for...

  • Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa A 1L Realization (Pty) Ltd Full time

    3-5 years of experience in data engineering or a similar role.Proficiency in SQL and Python.Experience with data pipeline tools (e.g., Apache Airflow, dbt).Hands-on experience with cloud platforms (AWS, Azure).Strong knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).Familiarity with containerization tools (Docker, Kubernetes) is a...

  • Specialist Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa Absa Group Full time

    Empowering Africa's tomorrow, together…one story at a time.With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.Job SummaryApply...

  • Specialist Data Scientist

    4 weeks ago

    Randburg, Gauteng, South Africa NTT Data Full time

    Responsibilities:Assist in the development and optimization of market-making models, focusing on equities and equity derivatives.Conduct back testing and research to improve current models and develop new ones.Analyse high-frequency trading data to identify patterns and trends.Implement machine learning techniques, particularly LSTMs and convolutional...

  • Specialist Data Scientist

    2 weeks ago

    Randburg, Gauteng, South Africa NTT Data Full time

    Responsibilities: Assist in the development and optimization of market-making models, focusing on equities and equity derivatives. Conduct back testing and research to improve current models and develop new ones. Analyse high-frequency trading data to identify patterns and trends. Implement machine learning techniques, particularly LSTMs and...

  • Cloud Data Solutions Engineer

    18 hours ago

    Randburg, Gauteng, South Africa Dimension Data Full time

    Develop and deploy data pipelines across the Data Lake and into Synapse at Dimension Data.Key ResponsibilitiesDesign, develop, and maintain scalable data marts and transformations using Azure services.Create PowerBI data sets and data flows to drive business insights.Collaborate with data scientists and BI specialists to develop curated data...

  • Jnr Data Engineer

    4 weeks ago

    Randburg, Gauteng, South Africa Salt Employee Benefits Full time

    Data is one of the most valuable resources a company owns, and savvy data engineers are required to build an infrastructure to keep it organized. This role requires a significant set of technical skills, including a deep knowledge of SQL and multiple programming languages. The incumbent should have stellar communication skills as you will work across...

  • Senior Data Engineer

    2 weeks ago

    Randburg, Gauteng, South Africa Parvana Full time

    Job DescriptionAbout the client :Our client is a highly successful NPO. The work you will be involved with is highly impactful and am sure will bring joy as well as provide a highly stimulating and fabulous work experience.What you will be doing :Collaborate with stakeholders to design, implement, and maintain data solutions, aligning with strategic...