Pipeline Engineer

2 weeks ago


Cape Town, Western Cape, South Africa Mastech Recruitment Full time

The Pipeline Engineer works as part of the SKA-Mid Computing and Software Telescope Operations team to analyze, develop, operate, and maintain the Mid telescope astronomy pipelines and other data analysis products such as the QA matrix.

Working with Senior Pipelines Developers and Platform developers, they identify, research and analyse the problem sets, investigate potential solutions, implement, test, and verify such solutions.


Key Responsibilities:
Design, develop, and improve data processing telescope software and data products.
Documentation and testing of the pipeline and data processing software.
Support deployment of release by engaging with interfacing teams to perform post-deployment testing.
Respond to system incidents and provide support for the SKA-Mid telescope data processing pipelines and software.
Participate in SKA-Mid Computing and Software Operations planning and continuous improvement.

Be an integral, senior member of the SKA-Mid Computing and Software Operations Teams, providing regular operations support for the SKA-Mid telescope's data processing capability.

Establish, maintain, and engage in good working relationships with all stakeholders.
Maintain external links with professional and/or specialist bodies, communities or groups.
Participate in telescope-wide and integration activities and events and represent SKA-Mid Data Processing interests and issues.
Represent the organisation and department at international meetings with partner and peer organizations.

Key Requirements:

Qualification:
A Degree/ Master's/ PHD in astronomy, astrophysics, cosmology, or related, applied/interdisciplinary sciences
#J-18808-Ljbffr

  • Cape Town, Western Cape, South Africa Ska South Africa Full time

    The National Research Foundation (NRF) ) supports and promotes research and human capital development through funding, the provision of National Research Facilities and science outreach platforms and programmes to the broader community in all fields of science and technology, including natural sciences, engineering, social sciences and humanities.The South...

  • Kafka Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...

  • Devops Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Rtt Full time

    The DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers' needs. You will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release engineering,...


  • Cape Town, Western Cape, South Africa Ska South Africa Full time

    Contract type: PermanentJob Level: ManagementWork Location: Cape Town, Western CapeClosing Date: 28 April 2024The National Research Foundation (NRF) ) supports and promotes research and human capital development through funding, the provision of National Research Facilities and science outreach platforms and programmes to the broader community in all fields...


  • Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...

  • DevOps Engineer III

    2 weeks ago


    Cape Town, Western Cape, South Africa RELX Full time

    Do you enjoy working with innovative research technology? Would you like to be part of a team creates solutions for our customers? About our Team The Platform Engineering Team is part of the Global Cloud team, with dedicated support to the wider business. We support the Engineering communities, providing best practices, consultation services,...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    Looking to kickstart your career as a Data Engineer in Cape Town?I specialize in connecting talented individuals with top players in the IT Industry who are on the lookout for Data Engineers like you. Grow your career and skills with leading employers in Cape Town that will help you reach new heights in your professional journey.Skills & Experience: -...

  • Resident Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Curiska (Pty) Ltd Full time

    Hiring: Resident Engineer (Cape Town)I am currently recruiting for an RE for supervising the construction of pipelines, pump stations and managing the construction. This person should ideally be a registered technologist or technician. Please send your CV to if you are interested.

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Ozow Group. Full time

    What to expect If you are looking for an opportunity to work with data in a different and connected way, you might be the Data Engineer we are looking for If you are an innovative Data Engineer, that likes connecting the dots in Data together and building high-performance Data Platforms that service multiple Data and Business Services, joining our team might...

  • Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Communicate Recruitment Full time

    Job Description: We are on the lookout for a talented Data Engineer with a proven track record of designing and implementing robust data architectures to join our clients team. If you have a passion for transforming raw data into valuable insights and possess the skills to create scalable and efficient data pipelines, this opportunity is made for youSkills...

  • Structural Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Eram Talent Full time

    Eram Talent, a division of ERAM Group, a global leader in talent acquisition, is seeking a Structural Engineer to join their team. E-Talent's global reach and network allows them to provide high potential professionals with sophisticated skills from a variety of industries, including oil and gas, petroleum, infrastructure, energy, water, transportation,...

  • DevOps Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa PayU Full time

    About PayU PayU, a leading payment and Fintech company in 50+ high-growth markets throughout Asia, Central and Eastern Europe, Latin America, the Middle East and Africa, part of Prosus group, one of the largest technology investors in the world is redefining the way people buy and sell online for our + merchants and millions of consumers. As a leading...

  • Devops Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Zerog - Ai In Aviation Full time

    PayU, a leading payment and Fintech company in 50+ high-growth markets throughout Asia, Central and Eastern Europe, Latin America, the Middle East and Africa, part of Prosus group, one of the largest technology investors in the world is redefining the way people buy and sell online for our merchants and millions of consumers. As a leading online payment...


  • Cape Town, Western Cape, South Africa Lexisnexis Risk Solutions Full time

    Do you enjoy working with innovative research technology? Would you like to be part of a team creates solutions for our customers? About our Team Our team is responsible for the development, performance and availability of our industry leading SciVal web-based analytics solution. We use AI technologies and big data to create solutions that provides access to...


  • Cape Town, Western Cape, South Africa FreeRecruit Full time

    Basic Requirements ● Completed Degree BSc or BEng. ● 4 or more years of software engineering experience with commercially successful systems in fintech, payments, retail banking, credit, e-commerce, or logistics ● Recent experience in architecture and technical leadership of projects within these industries ● Demonstrated expert knowledge and...

  • Devops Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa Aesafrica Full time

    The Company An innovative product development company and execution partner. They specialize in building and launching exceptional products for clients in the retail and fintech sectors. For those seeking a company that values their expertise, encourages growth, and treats them like valued individuals, this is the perfect fit. They are committed to fostering...


  • Cape Town, Western Cape, South Africa E-Merge Full time

    We are currently in search for a Software Engineer to join our fast-paced smart finance and Technology energy and Internet connection company. You need to have experience with Infrastructure-as-code, rapid and collaborative code pipelines and other DevOps principles. IS This you?? Start ApplyingRequirements: PythonAWS CloudAPI Intergration4 years of software...

  • Software Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa ARCS Full time

    Our client in the Western Cape is seeking an (Intermediate / Senior) Software Engineer (Permanent On Site). You'll be responsible for working on their integration platform across the .NET 6/7 backend and/or web app front-end (Typescript, React). With a solid track record of up to 5 years prior engineering experience, demonstrating a proven ability to debug...


  • Cape Town, Western Cape, South Africa Lula Full time

    WHAT WE DO We're Lula. We build innovative fintech products to help SMEs make cash flow. From instant access to funding to all-in-one business banking accounts and cutting-edge financial analysis tools, we're on it Our purpose is to help SMEs manage their business better, faster, simpler, Lula, so they can spend more time doing what they love. Speaking of...

  • DevOps Data Engineer

    2 weeks ago


    Cape Town, Western Cape, South Africa PBT Group Full time

    PBT Group has a requirement for an intermediate DevOps Data Engineer. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, Kafka CC, PySpark, DynamoDB, , RedShift, Lambda, DeltaLake, Python,.Analyze,...