AWS Data Engineer

2 weeks ago

Pretoria, South Africa Adzuna ZA B C2 Full time

PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.

The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources, ensuring its conformity to data quality standards, and enabling downstream users to access data promptly. This position is an integral part of an agile team.

These professionals are entrusted with the responsibility of establishing the infrastructure required to derive insights from raw data, integrating data from various sources seamlessly. They empower solutions by efficiently managing substantial volumes of data, both in batch and real-time, utilizing cutting-edge technologies from the realms of big data and cloud computing. Additional responsibilities encompass the development of proof-of-concepts and the implementation of intricate big data solutions, with a primary focus on collecting, parsing, managing, analyzing, and visualizing extensive datasets. They are adept at employing technologies to resolve challenges associated with handling vast amounts of data in diverse formats, thereby delivering innovative solutions.

Data Engineering is a technically demanding role that necessitates a broad spectrum of expertise in software development and programming. These professionals possess knowledge in data analysis, understanding end-user and business requirements, and have the ability to translate these needs into technical solutions. They exhibit a strong grasp of physical database design and the systems development lifecycle. Collaboration within a team environment is essential for success in this role.

Key Responsibilities:

  • Architecting Data analytics framework.
  • Translating complex functional and technical requirements into detailed architecture, design, and high-performance software.
  • Leading the development of data and batch/real-time analytical solutions by leveraging transformative technologies.
  • Engaging in multiple projects as a technical lead, overseeing user story analysis, design, software development, testing, and automation tool creation.

Duties: Primary Job Objectives:

  • Development and Operations
  • Database Development and Operations
  • Establishment and Adherence to Policies, Standards, and Procedures
  • Communication
  • Business Continuity and Disaster Recovery Planning
  • Research and Evaluation
  • Coaching and Mentoring

Required Skills, Knowledge, and Experience:

  • A minimum of 5 years of experience in Data Engineering or Software Engineering.
  • Demonstrated leadership experience, managing teams of engineers for 3-5 years.
  • A minimum of 2 years of experience in Big Data.
  • At least 5 years of experience with Extract, Transform, and Load (ETL) processes.
  • A minimum of 2 years of experience with AWS (Amazon Web Services).
  • Demonstrated experience with agile or other rapid application development methodologies for at least 2 years (e.g., Agile, Kanban, Scrum).
  • 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
  • Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
  • Support experience for data feeds in production on a break-fix basis (2 years).
  • A minimum of 4 years of experience in creating data marts using Talend or similar ETL development tools.
  • Proficiency in data manipulation using Python and PySpark (2 years).
  • Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS's distribution of Hadoop (2 years).
  • DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
  • Extensive knowledge of various programming or scripting languages.
  • Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases.

Additional Technical Skills Required:

  • The ability to design highly scalable distributed systems using various open-source tools.
  • Proficiency in both batch and streaming Big Data tools.
  • Experience with Talend for at least 1 year.
  • Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
  • Proficiency in Python for at least 1 year.
  • Familiarity with PySpark or Spark (desirable for at least 1 year).
  • Experience in Business Intelligence data modeling for 3 years.
  • Proficiency in SQL for 3 years.

Qualifications/Certifications:

  • A Bachelor's degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
  • AWS Certification, at least at the associate level.

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

  • Aws Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Isanqa Resourcing Full time

    Our client requires the services of a Data Engineer/Scientist (Expert) - Midrand/Menlyn/Rosslyn/Home Office rotation. Amazing brand with cutting-edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environmentPOSITION:Contract until December 2026EXPERIENCE:8+ Years related working...

  • Aws Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Isanqa Resourcing Full time

    Our client requires the services of a Technology Integrator (Chief Expert) Midrand/Menlyn/Rosslyn/Home Office Rotation Amazing brand with cutting edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environmentPOSITION:Contract until December 2026EXPERIENCE:12+ Years related working...

  • Aws Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa Isanqa Full time

    Our client requires the services of a Technology Integrator (Chief Expert) Midrand/Menlyn/Rosslyn/Home Office Rotation Amazing brand with cutting edge technologyExcellent teams in Global team collaborationHigh work-life balance with Flexible hoursAgile working environmentPOSITION:Contract until December 2026EXPERIENCE:12+ Years related working...

  • Aws Data Engineers Required

    2 weeks ago

    Pretoria, Gauteng, South Africa Africonology Full time

    Job Title:AWS Data Engineers Required - Project Based - Contractual-to start asap - JHB - HybridLocation:Gauteng, Johannesburg Metro, MidrandJob Type:Contract, expected to work Full-Time hoursPrimary Industry:Banking and FinanceSecondary Industry:Banking and FinanceJob Duties:Design, develop, and implement AWS cloud solutions for data engineering...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, South Africa PBT Group Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources,...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    Our valued client, a key player in African capital markets and a significant presence in the automotive sector, is renowned for its diverse product range and global reach. They are currently on the lookout for a talented AWS Data Engineer to join their team. This is a great opportunity to tackle complex issues and deliver substantial value across different...

  • 2050 - AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashBMW Cloud Data Hub (CDH)BMW CDEC Blueprint· Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • 2050 - AWS Data Engineer

    1 month ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS:Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashBMW Cloud Data Hub (CDH)BMW CDEC Blueprint· Any additional responsibilities assigned in the Agile Working Model (AWM)...

  • 2050 - AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data Hub (CDH) BMW CDEC Blueprint · Any additional responsibilities assigned in the Agile Working...

  • 2050 - AWS Data Engineer

    1 month ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance):e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data Hub (CDH) BMW CDEC Blueprint · Any additional responsibilities assigned in the Agile Working...

  • AWS Data Engineer

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    A leader in African capital markets with a comprehensive suite of products, a vast global reach while and an acute positioning as a local bank with the expertise ability to leverage on local presence with regional and international expertise has a vacant position for an AWS Data Engineer to work within a team solving complex problems to deliver real business...

  • AWS Data Engineer

    4 weeks ago

    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • AWS Data Engineer

    2 months ago

    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Knowledge of data...

  • AWS Data Engineer

    4 weeks ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts....

  • AWS Data Engineer

    2 months ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):TerraformPython 3xSQL - Oracle/PostgreSQLPy SparkBoto3ETLDockerLinux / UnixBig DataPowershell / BashExperience in working with Enterprise Collaboration tools such as Confluence, JIRA etc.Experience developing technical documentation and artefacts.Knowledge of data...

  • AWS Data Engineer

    2 months ago

    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance):Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts....

  • AWS Data Engineer – Hybrid – R650 per hour

    2 weeks ago

    Pretoria, Gauteng, South Africa E-Merge Full time

    Are you ready to take your career to the next level? We''''re looking for a Senior AWS Data Engineer to join our innovative team. Here''''s your chance to be part of a dynamic, global company that''''s shaping the future of the automotive industry. Ready to rev up your career? Join the team and drive innovation with us. Apply now Essential...

  • AWS Data Engineer – Hybrid – R650 per hour

    1 month ago

    Pretoria, South Africa E-Merge Full time

    Are you ready to take your career to the next level? We''''re looking for a Senior AWS Data Engineer to join our innovative team. Here''''s your chance to be part of a dynamic, global company that''''s shaping the future of the automotive industry. Ready to rev up your career? Join the team and drive innovation with us. Apply now! Essential Requirements:...

  • AWS Data Engineer – Hybrid – R650 per hour

    4 weeks ago

    Pretoria, South Africa E-Merge Full time

    Are you ready to take your career to the next level? We''''re looking for a Senior AWS Data Engineer to join our innovative team. Here''''s your chance to be part of a dynamic, global company that''''s shaping the future of the automotive industry. Ready to rev up your career? Join the team and drive innovation with us. Apply now! Essential Requirements:...