Pipeline Engineer

3 weeks ago

Cape Town, South Africa Tasiso Full time
Key Responsibilities:
  • Design, develop and improve data processing telescope software and data products.
  • Documentation and testing of the pipeline and data processing software
  • Support deployment of release by engaging with interfacing teams to perform post-deployment testing
  • Respond to system incidents and provide support for the telescope data processing pipelines and software
  • Participate in Computing and Software Operations planning and continuous improvement
  • Be an integral, senior member of the Computing and Software Operations Teams, providing regular operations support for the telescope's data processing capability
  • Establish, maintain and engage in good working relationships with all stakeholders
  • Maintain external links with professional and/or specialist bodies, communities or groups.
  • Participate in telescope-wide and integration activities and events and represent Data Processing interests and issues
  • Represent the organisation and department at international meetings with partner and peer organisations.
  • Adhere to the spirit and practice of both organisational Values as well as the Code of Conduct, Health, Safety and
  • Environment procedures and policy, Diversity initiatives and Making Safety Personal goals.

Key Requirements:
Qualification:
  • A Degree/ Master's/ PhD in astronomy, astrophysics, cosmology, or related, applied/interdisciplinary sciences

Experience:
  • A Degree coupled with 4 years relevant working experience; or A Master's Degree coupled with 3 years relevant working experience;
  • or PHD coupled with 1 year relevant working experience in astronomy, astrophysics, cosmology, or related, applied/interdisciplinary sciences encompassing development, testing, deployment, commissioning, release and support of scientific software or data analytics projects and developing scientific software using Python and Python libraries or similar languages.
Knowledge:
  • Radio astronomy data analysis calibration and imaging techniques and tools
  • Radio Astronomy instrumentation and observatory practices
  • Performing data-driven astronomy research
  • Software development, preferably scientific programming using Python and Python libraries
  • Large science data curation, manipulation, transfer, management and archival
  • Understanding of system architecture concepts
  • Understanding of scaled agile methodologies and DevOps processes
  • Knowledge of Systems Engineering and systems delivery practices
Additional Notes:
Related Skills:
  • Teamwork and Collaboration: Cooperates with others to achieve organisational objectives. Collaborates with other teams as well as industry colleagues. Sharing skills and knowledge with team members as required.
  • Judgement and Problem Solving: Anticipates and manages problems in ambiguous situations. Develops and selects an appropriate course of action and provides for contingencies. Evaluates, interprets and integrates complex bodies of information and draws logical conclusions, synthesises proposals and defends options with reasoned arguments.
  • Adaptability: Demonstrates flexibility in thinking and adapts to and manages the increasing rate of organisational change by adjusting strategies, goals and priorities.
  • Experience working in interdisciplinary environments and matrix teams during some project phases such as integration, deployment, testing, verification as well as during telescope operations.
Essential:
  • Quantitative research skills in a relevant or translatable area
  • Radio Interferometer telescopes scheduling, observation and calibration techniques
  • Radio astronomy data cleansing, calibration techniques and tools
  • Scientific software and pipelines development using Python and Python libraries, e.g. NumPy, SciPy. Matplotlib
  • IT and Information systems analysis, design, implementation, integration, delivery and operations
  • Agile approaches to systems development
  • IT systems architecture concepts
  • An understanding of DevOps processes (CI/CD)
  • Data curation, transfer, management, archival and governance
  • IT Services, Operations and Support
Desirable :
  • Experience working with Radio astronomy software packages, e.g. CASA, MeqTREES
  • Radio Astronomy data formats and other formal or informal standards
  • Radio Astronomy data and science products analysis
  • A record of publication of scientific articles in an area of expertise, demonstrating ability to conduct research and collaboration with peers
  • Knowledge of Radio Astronomy techniques, instrumentation and observatory practices
  • Ability to develop and convey a technical vision to team members
  • Working with senior members as a mentee, learning from them and other experts, informally and informally
  • Commissioning of scientific instruments
  • Ability to work as part of a globally distributed team, which may include travel or accommodating work in different time zones
  • Ability to communicate effectively to a wide audience and a wide range of stakeholders
  • Ability to reliably estimate and plan software developments with long (multi-year) time horizons
  • Health, Safety and Environment
  • Organisational governance and administration

  • Kafka Engineer

    4 weeks ago

    Cape Town, South Africa PBT Group Full time

    Kafka Engineer Job Description As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities.Kafka Engineer Job ProfileKafka engineer is a big data...

  • DevOps Engineer

    3 weeks ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    The DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. You will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release engineering,...

  • DevOps Engineer

    3 weeks ago

    Cape Town, South Africa RTT Full time

    T he DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. Y ou will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release...

  • Kafka Big Data Engineer

    4 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed systems as well as excellent communication abilities. Kafka engineer is a big data...

  • Resident Engineer

    7 days ago

    Cape Town, South Africa Curiska Full time

    Hiring: Resident Engineer (Cape Town) I am currently recruiting for an RE for supervising the construction of pipelines, pump stations and managing the construction. This person should ideally be a registered technologist or technician. 

  • Resident Engineer

    7 days ago

    Cape Town, South Africa Curiska Full time

    Hiring: Resident Engineer (Cape Town)   I am currently recruiting for an RE for supervising the construction of pipelines, pump stations and managing the construction. This person should ideally be a registered technologist or technician.  

  • Resident Engineer

    7 days ago

    Cape Town, South Africa Adzuna ZA B C2 Full time

    Hiring: Resident Engineer (Cape Town) I am currently recruiting for an RE for supervising the construction of pipelines, pump stations and managing the construction. This person should ideally be a registered technologist or technician.

  • Data Streaming Engineer

    4 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the...

  • Resident Engineer

    7 days ago

    Cape Town, South Africa Curiska (Pty) Ltd Full time

    Hiring: Resident Engineer (Cape Town) I am currently recruiting for an RE for supervising the construction of pipelines, pump stations and managing the construction. This person should ideally be a registered technologist or technician. Please send your CV to info@curiska.co.za if you are interested. 

  • DevSecOps Engineer

    3 days ago

    Cape Town, South Africa Hire Resolve Full time

    Hire Resolve is a leading recruitment agency specializing in matching talented professionals with top companies. We are currently seeking a skilled DevSecOps Engineer to join our client's team in an exciting and dynamic work environment. As a DevSecOps Engineer, you will be responsible for implementing security measures and best practices throughout the...

  • Senior DevOps Engineer

    4 weeks ago

    Cape Town, South Africa Progressive Edge Full time

    Senior DevOps EngineerPermanentCape TownA company who specialises in the development of cutting-edge fintech solutions aimed to serve small and medium enterprises, has a Senior DevOps Engineer position available. As an Azure DevOps Engineer, you will play a critical role in optimising our software development and delivery processes by leveraging Microsoft...

  • Senior DevOps Engineer

    4 weeks ago

    Cape Town, South Africa Progressive Edge Full time

    Senior DevOps EngineerPermanentCape TownA company who specialises in the development of cutting-edge fintech solutions aimed to serve small and medium enterprises, has a Senior DevOps Engineer position available. As an Azure DevOps Engineer, you will play a critical role in optimising our software development and delivery processes by leveraging Microsoft...

  • Card Quality Engineer

    4 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group is seeking a skilled Card Quality Engineer with the following job description:10+ years of experience in Quality Assurance, specializing in Automation and Performance testing.Proficiency in Automation tools (Web, Mobile) with expertise in designing automation frameworks.Familiarity with Atlassian tools such as Jira, Confluence, GITHub.Experience in...

  • Card Quality Engineer

    4 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group is seeking a skilled Card Quality Engineer with the following job description:10+ years of experience in Quality Assurance, specializing in Automation and Performance testing.Proficiency in Automation tools (Web, Mobile) with expertise in designing automation frameworks.Familiarity with Atlassian tools such as Jira, Confluence, GITHub.Experience in...

  • Card Quality Engineer

    3 weeks ago

    Cape Town, South Africa PBT Group Full time

    PBT Group is seeking a skilled Card Quality Engineer with the following job description: 10+ years of experience in Quality Assurance, specializing in Automation and Performance testing. Proficiency in Automation tools (Web, Mobile) with expertise in designing automation frameworks. Familiarity with Atlassian tools such as Jira, Confluence, GITHub....

  • Intermediate Analytics Engineer

    2 weeks ago

    Cape Town, South Africa Shoprite Full time

    Role Purpose  The Intermediate Analytics Engineer is an emerging data professional who will kick start their careers as part of the the analytics engineering team to build robust, integrated and efficient data products that delivers best-in-class use case led analytics across the organisation. The role works with a senior or lead analytics engineering...

  • Senior DevOps Engineer

    4 weeks ago

    Cape Town, South Africa LexisNexis Full time

    Do you enjoy working with innovative research technology? Would you like to be part of a team creates solutions for our customers? About our Team Our team is responsible for the development, performance and availability of our industry leading SciVal web-based analytics solution. We use AI technologies and big data to create solutions that provides access...

  • Analytics Engineer I

    3 weeks ago

    Cape Town, South Africa Shoprite Full time

    Role Purpose The Analytics Engineer I is an emerging data engineering professional who will kick start their careers by supporting the analytics engineering team to build and model data into robust, integrated and efficient data products that delivers best-in-class use case led analytics across the organisation. The role works under the guidance of the...

  • DevOps Engineer

    19 hours ago

    Cape Town, South Africa RTT Full time

    The DevOps engineer is responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. You will work with developers and engineers to ensure that software development follows established processes and works as intended. The DevOps engineer will combines release engineering,...

  • Senior Mechanical Engineer

    2 days ago

    Cape Town, South Africa Engineered Sourcing Full time

    Job DescriptionExperienced in produtibility analysis techniques.Experienced in assembly line requirement and design.Skilled in production aid documentation requirements and establishment.Planning, definition and establishment of assembly lines, its commissioning and acceptanceSolid fundamental knowledge of industrial engineering principles and assembly line...