Pipeline Engineer

Found in: Talent ZA 2A C2 - 2 weeks ago

Cape Town, South Africa Tasiso Full time
Key Responsibilities:
  • Design, develop and improve data processing telescope software and data products.
  • Documentation and testing of the pipeline and data processing software
  • Support deployment of release by engaging with interfacing teams to perform post-deployment testing
  • Respond to system incidents and provide support for the telescope data processing pipelines and software
  • Participate in Computing and Software Operations planning and continuous improvement
  • Be an integral, senior member of the Computing and Software Operations Teams, providing regular operations support for the telescope's data processing capability
  • Establish, maintain and engage in good working relationships with all stakeholders
  • Maintain external links with professional and/or specialist bodies, communities or groups.
  • Participate in telescope-wide and integration activities and events and represent Data Processing interests and issues
  • Represent the organisation and department at international meetings with partner and peer organisations.
  • Adhere to the spirit and practice of both organisational Values as well as the Code of Conduct, Health, Safety and
  • Environment procedures and policy, Diversity initiatives and Making Safety Personal goals.

Key Requirements:
Qualification:
  • A Degree/ Master's/ PhD in astronomy, astrophysics, cosmology, or related, applied/interdisciplinary sciences

Experience:
  • A Degree coupled with 4 years relevant working experience; or A Master's Degree coupled with 3 years relevant working experience;
  • or PHD coupled with 1 year relevant working experience in astronomy, astrophysics, cosmology, or related, applied/interdisciplinary sciences encompassing development, testing, deployment, commissioning, release and support of scientific software or data analytics projects and developing scientific software using Python and Python libraries or similar languages.
Knowledge:
  • Radio astronomy data analysis calibration and imaging techniques and tools
  • Radio Astronomy instrumentation and observatory practices
  • Performing data-driven astronomy research
  • Software development, preferably scientific programming using Python and Python libraries
  • Large science data curation, manipulation, transfer, management and archival
  • Understanding of system architecture concepts
  • Understanding of scaled agile methodologies and DevOps processes
  • Knowledge of Systems Engineering and systems delivery practices
Additional Notes:
Related Skills:
  • Teamwork and Collaboration: Cooperates with others to achieve organisational objectives. Collaborates with other teams as well as industry colleagues. Sharing skills and knowledge with team members as required.
  • Judgement and Problem Solving: Anticipates and manages problems in ambiguous situations. Develops and selects an appropriate course of action and provides for contingencies. Evaluates, interprets and integrates complex bodies of information and draws logical conclusions, synthesises proposals and defends options with reasoned arguments.
  • Adaptability: Demonstrates flexibility in thinking and adapts to and manages the increasing rate of organisational change by adjusting strategies, goals and priorities.
  • Experience working in interdisciplinary environments and matrix teams during some project phases such as integration, deployment, testing, verification as well as during telescope operations.
Essential:
  • Quantitative research skills in a relevant or translatable area
  • Radio Interferometer telescopes scheduling, observation and calibration techniques
  • Radio astronomy data cleansing, calibration techniques and tools
  • Scientific software and pipelines development using Python and Python libraries, e.g. NumPy, SciPy. Matplotlib
  • IT and Information systems analysis, design, implementation, integration, delivery and operations
  • Agile approaches to systems development
  • IT systems architecture concepts
  • An understanding of DevOps processes (CI/CD)
  • Data curation, transfer, management, archival and governance
  • IT Services, Operations and Support
Desirable :
  • Experience working with Radio astronomy software packages, e.g. CASA, MeqTREES
  • Radio Astronomy data formats and other formal or informal standards
  • Radio Astronomy data and science products analysis
  • A record of publication of scientific articles in an area of expertise, demonstrating ability to conduct research and collaboration with peers
  • Knowledge of Radio Astronomy techniques, instrumentation and observatory practices
  • Ability to develop and convey a technical vision to team members
  • Working with senior members as a mentee, learning from them and other experts, informally and informally
  • Commissioning of scientific instruments
  • Ability to work as part of a globally distributed team, which may include travel or accommodating work in different time zones
  • Ability to communicate effectively to a wide audience and a wide range of stakeholders
  • Ability to reliably estimate and plan software developments with long (multi-year) time horizons
  • Health, Safety and Environment
  • Organisational governance and administration

  • Pipeline Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa Tasiso Full time

    Key Responsibilities: Design, develop and improve data processing telescope software and data products. Documentation and testing of the pipeline and data processing software Support deployment of release by engaging with interfacing teams to perform post-deployment testing Respond to system incidents and provide support for the telescope data processing...

  • Pipeline Engineer

    Found in: Adzuna ZA B C2 - 2 weeks ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of release by engaging with interfacing teams to perform post-deployment testingRespond to system incidents and provide support for the telescope data processing...

  • Pipeline Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago

    Cape Town, South Africa Kamo Placements Full time

    JOB DESCRIPTION Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of release by engaging with interfacing teams to perform post-deployment testingRespond to system incidents and provide support for the SKA-Mid telescope data processing...

  • Pipeline Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa Kamo Placements Full time

    JOB DESCRIPTION Design, develop and improve data processing telescope software and data products. Documentation and testing of the pipeline and data processing software Support deployment of release by engaging with interfacing teams to perform post-deployment testing Respond to system incidents and provide support for the SKA-Mid telescope data processing...

  • Pipeline Engineer

    Found in: Adzuna ZA B C2 - 2 weeks ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    JOB DESCRIPTION Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of release by engaging with interfacing teams to perform post-deployment testingRespond to system incidents and provide support for the SKA-Mid telescope data processing...

  • Senior Pipeline Engineer

    Found in: Adzuna ZA B C2 - 2 weeks ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    JOB DESCRIPTION Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of releasesRespond to system incidents and provide support for the company -Mid telescope data processing pipelines and softwareParticipate in company -Mid Computing and...

  • Senior Pipeline Engineer

    Found in: Talent ZA 2A C2 - 2 weeks ago

    Cape Town, South Africa Tasiso Full time

    Key Responsibilities:Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of releasesRespond to system incidents and provide support for the telescope data processing pipelines and softwareParticipate in Computing and Software Operations...

  • Senior Pipeline Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa Tasiso Full time

    Key Responsibilities: Design, develop and improve data processing telescope software and data products. Documentation and testing of the pipeline and data processing software Support deployment of releases Respond to system incidents and provide support for the telescope data processing pipelines and software Participate in Computing and Software Operations...

  • Senior Pipeline Engineer

    Found in: Adzuna ZA B C2 - 2 weeks ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    Key Responsibilities:Design, develop and improve data processing telescope software and data products.Documentation and testing of the pipeline and data processing softwareSupport deployment of releasesRespond to system incidents and provide support for the telescope data processing pipelines and softwareParticipate in Computing and Software Operations...

  • Kafka Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...

  • DevOps Engineer

    Found in: Whatjobs ZA C2 - 6 days ago

    Cape Town, South Africa RTT Full time

    T he DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. Y ou will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release...

  • DevOps Engineer

    Found in: Adzuna ZA B C2 - 1 week ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    The DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. You will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release engineering,...

  • Kafka Big Data Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...

  • DevOps Engineer

    Found in: beBee jobs ZA - 3 weeks ago

    Cape Town, Western Cape, South Africa OneDayOnly Full time

    's job vacancy, Career and RecruitmentJob title : DevOps Engineer – Woodstock jobs in Western CapeJob Location : Western Cape, Cape TownDeadline : May 02, 2024Quick Recommended LinksJobs by LocationJob by industries About youWe are looking for a DevOps engineer to help us keep our systems running as smoothly as they can. Someone that loves to problem solve...

  • Data Streaming Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the...

  • Senior DevOps Engineer

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Progressive Edge Full time

    Senior DevOps EngineerPermanentCape TownA company who specialises in the development of cutting-edge fintech solutions aimed to serve small and medium enterprises, has a Senior DevOps Engineer position available. As an Azure DevOps Engineer, you will play a critical role in optimising our software development and delivery processes by leveraging Microsoft...

  • Senior DevOps Engineer

    Found in: Talent ZA 2A C2 - 3 weeks ago

    Cape Town, South Africa Progressive Edge Full time

    Senior DevOps EngineerPermanentCape TownA company who specialises in the development of cutting-edge fintech solutions aimed to serve small and medium enterprises, has a Senior DevOps Engineer position available. As an Azure DevOps Engineer, you will play a critical role in optimising our software development and delivery processes by leveraging Microsoft...

  • DevOps Engineer

    Found in: beBee S ZA - 4 weeks ago

    Western Cape, Cape Town, South Africa OneDayOnly.co.za Full time

    OneDayOnly.co.za’s job vacancy, Career and Recruitment Job title : DevOps Engineer – Woodstock jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : May 02, 2024 Quick Recommended Links Jobs by Location Job by industries About you We are looking for a DevOps engineer to help us keep our systems running as smoothly as they can....

  • DevOps Engineer

    Found in: beBee S ZA - 3 weeks ago

    Western Cape, Cape Town, South Africa OneDayOnly.co.za Full time

    OneDayOnly.co.za’s job vacancy, Career and Recruitment Job title : DevOps Engineer – Woodstock jobs in Western Cape Job Location : Western Cape, Cape Town Deadline : May 02, 2024 Quick Recommended Links Jobs by Location Job by industries About you We are looking for a DevOps engineer to help us keep our systems running as smoothly as they can....

  • Analytics Engineer II

    Found in: Talent ZA C2 - 3 weeks ago

    Cape Town, South Africa Shoprite Full time

    Purpose The purpose of the Senior Analytics Engineer role is to build and model data into robust, integrated and efficient data products to support and deliver best-in-class use case led analytics across the organisation. The role works collaboratively within and across a multi-functional agile team, building data products and pipelines for high impact...