Data Engineer

Found in: Talent ZA 2A C2 - 3 weeks ago


Pretoria, South Africa HR Genie Full time

We are committed to excellence and are looking for a dynamic Data Engineer to join our team. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want you on our team.

Hybrid (once a week) - Pretoria

As a Data Engineer at Dotcom, you will play a crucial role in our engineering team, responsible for designing, implementing, and managing our cloud-based infrastructure and big data pipelines. Your expertise in DevOps practices, combined with your knowledge of big data technologies, will drive the development of scalable and efficient systems to handle our growing data needs. You will collaborate closely with data scientists, software engineers, and IT professionals to ensure our infrastructure supports our objectives and innovation goals

Key Responsibilities:
  • Design, build, and maintain the CI/CD pipeline for automated code deployment processes.
  • Manage and optimize our PostgreSQL databases, ensuring high availability and performance.
  • Develop and maintain scalable and efficient data processing pipelines using Apache Spark.
  • Write robust, efficient, and maintainable code in Python for various data and DevOps tasks.
  • Deploy, manage, and scale applications using Kubernetes, ensuring seamless deployment and operation.
  • Utilize Git/GitLab for version control and collaboration with the development team.
  • Monitor system performance, troubleshoot issues, and implement solutions to ensure optimal operation and security.
  • Stay up-to-date with emerging trends in DevOps, big data technologies, and cloud computing to drive continuous improvement and innovation within the team.
Essential Skills and Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • At least 5 years of experience in a DevOps role, with a proven track record of developing and maintaining scalable infrastructure.
  • Strong experience with PostgreSQL, Apache Spark, and Python is mandatory.
  • In-depth knowledge of Kubernetes (aka K8), including deployment, scaling, and management of containerized applications.
  • Proficient in Git/GitLab for version control and collaborative development.
  • Solid understanding of CI/CD pipelines and automation tools.
  • Excellent problem-solving skills and the ability to work independently or as part of a team.
  • Strong communication and collaboration skills, with the ability to interact effectively with different stakeholders.
Desirable:
  • Experience with cloud services (AWS, GCP, Azure) and their managed services.
  • Certifications in Kubernetes, cloud technologies, or DevOps methodologies.
  • Experience in working with big data technologies beyond Apache Spark.
  • A passion for learning and adapting to new technologies and challenges.

  • Data Engineer

    Found in: beBee jobs ZA - 2 weeks ago


    Pretoria, Gauteng, South Africa Unitrans Full time

    Unitrans's job vacancy, Career and RecruitmentJob title : Data Engineer – Template jobs in GautengJob Location : Gauteng, Deadline : May 09, 2024Quick Recommended LinksJobs by LocationJob by industries Job Advert Summary As a Data Engineer you will be responsible for both on-premises and cloud-based data infrastructure, with a focus on migrating data...

  • AWS Data Engineer

    Found in: beBee jobs ZA - 2 weeks ago


    Pretoria, Gauteng, South Africa SabenzaIT Full time

    Are you a proficient IT professional with a fervor for pioneering and state-of-the-art technology? Our client is in search of a skilled AWS Data Engineer to join their vibrant team located in Midrand/Menlyn. As a prominent figure in the automotive industry worldwide, they are dedicated to shaping the future of mobility through inventive solutions and...

  • AWS Data Engineer

    Found in: Whatjobs ZA C2 - 1 week ago


    Pretoria, South Africa Jordan HR Full time

    Responsibilities: Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team. Develop technical documentation and artifacts to support data engineering processes and initiatives. Work with various data formats including Parquet, AVRO, JSON, XML, and CSV. Utilize Data Quality Tools such as...

  • AWS Data Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Pretoria, South Africa Jordan HR Full time

    Responsibilities:Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team.Develop technical documentation and artifacts to support data engineering processes and initiatives.Work with various data formats including Parquet, AVRO, JSON, XML, and CSV.Utilize Data Quality Tools such as...

  • Data Engineer/ BI Consultant

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa People Dimension Full time

    Job Description/Duties:• To identify, conceptualize & advocate strategic data enablement opportunities (new & existing customers). • Project and activity planning. • Stakeholder expectation management. • Product installation & configuration.• Stakeholder expectation management. • Product installation & configuration.• Implement data strategies,...

  • RFX 4921036 _ Data Engineer Services

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa Tipp Focus Full time

    Objective of this Scope of WorkThe main purpose of this position is to ensure that data quality and integrity, creating advanced algorithms, develop and maintain datasets and architecture design of high calibre to also support the business goals and to build systems by collecting, validating and preparing high quality data objectives of client PA...

  • Senior AWS Data Engineer

    Found in: Whatjobs ZA C2 - 1 week ago


    Pretoria, South Africa Jordan HR Full time

    RESPONSIBILITIESYou will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis. Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms. Collaborating with cross-functional teams to understand data requirements and develop scalable...

  • Senior AWS Data Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago


    Pretoria, South Africa Jordan HR Full time

    RESPONSIBILITIESYou will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis.Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms.Collaborating with cross-functional teams to understand data requirements and develop scalable...


  • Pretoria, South Africa Carlysle Human Capital Full time

    **ROLE PURPOSE**: To analyze (using data science methods) and provide expert advice with regards to data analytics in order to achieve business objectives. **MINIMUM REQUIREMENTS**: **Qualifications & Experience**: - ** **Relevant Bachelor's Degree / Advanced Diploma (NQF 8) - AND 8-10 years' experience in Data Engineering / Business Data Intelligence /...

  • Data Scientist

    6 days ago


    Pretoria, South Africa Curiska (Pty) Ltd Full time

    **Minimum education (essential)**: Bachelor's degree in Computer Science, Statistics, Mathematics, Actuarial Science or a related field. **Minimum education (desirable)**: Honors or Masters degree Computer Science, Statistics, Mathematics, or a related field. **Minimum applicable experience (years)**: 5 years **Required nature of experience**: - Proven...


  • Pretoria, South Africa Carlysle Full time

    **Gauteng**, Tshwane (Pretoria)** **Negotiable - Negotiable Monthly Basic Salary (Market related, Negotiable)** **Our client - Interfront (a global technology solutions provider that solely focuses on the Customs and Border Management business sphere) - is looking for a Senior Specialist in Data Analytics to join their team of data specialists.** **ROLE...

  • Data Scientist

    4 days ago


    Pretoria, South Africa The Hiring House Full time

    Minimum education (essential): Bachelor's degree in Computer Science, Statistics, Mathematics, Actuarial Science or a related field. Minimum education (desirable): Honors or Masters degree Computer Science, Statistics, Mathematics, or a related field. Minimum applicable experience (years): 5 years Required nature of experience: - Proven experience in...

  • Data Architect

    5 days ago


    Pretoria, South Africa Hi-Tech Recruitment Full time

    **Gauteng**, Pretoria** **R 900 000 - R 1 4000 Annually Cost To Company (Medical, pension and 13th cheque, Market related, Negotiable)** Your expertise in data modelling, data management, data analysis, as well as experience with data warehousing, data integration, and data security are the key to this role ! READ ON! - You will be designing and developing...

  • Chief Data Systems

    3 weeks ago


    Pretoria, South Africa Ambassador Human Resource Solution Full time

    A BSc Honours degree in Systems Engineering, Computer Science, Computer Systems or related qualification A Masters degree in Systems Engineering, Computer Science, Computer Systems or related qualification will be an added adv Solid background hands-on on designing and software development of large scale complex computer systems using any of the modern...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    Found in: Whatjobs ZA C2 - 1 week ago


    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...

  • AWS Redshift Data Engineer – Bedfordview – R1.1m PA

    Found in: Talent ZA 2A C2 - 3 weeks ago


    Pretoria, South Africa E-Merge Full time

    e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovative financial services focusing on their retail customer base. Currently searching for a Data Engineer...


  • Pretoria, South Africa Kamo Placement Full time

    Gauteng, Tshwane (Pretoria) - Annually Cost To Company (Market related, Negotiable) The main purpose of this position is to assist the Data Modeller in improving data modelling and developing data maturity standards within the Financial Surveillance Department (FinSurv) to support quality-assured, cross border statistics for effective decision making **JOB...

  • Software Engineer: Radar Data Processing and Control

    Found in: beBee S ZA - 4 weeks ago


    Gauteng, Pretoria, South Africa Council for Scientific and Industrial Research Full time

    Council for Scientific and Industrial Research’s job vacancy, Career and Recruitment Job title : Software Engineer: Radar Data Processing and Control – Scientia, Pretoria (Hybrid) jobs in Gauteng Job Location : Gauteng, Pretoria Deadline : April 08, 2024 Quick Recommended Links Jobs by Location Job by industries About the job: The CSIR has a vacancy...

  • ELV Engineer

    Found in: Talent ZA C2 - 3 weeks ago


    Pretoria, South Africa TAKORA Pty Ltd (Staffing, Talent Acquisition & Recruitment) Full time

    Minimum Requirements • Diploma or BTech BSc/MSc/ BEng/ in Electrical Engineering• Minimum of 3 to 5 years of relevant experience in the ELV /Built Environment , within the built environment, preferably within a consulting engineering businessRole Responsibilities• Provide support to a team of digital designers, engineers, technicians, and modellers•...

  • AWS Data Engineer

    Found in: Whatjobs ZA C2 - 1 week ago


    Pretoria, South Africa Jordan HR Full time

    ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / TechnologyTerraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc. Experience developing technical documentation and artefacts...