Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4390

Implement example workflows to SRC workflow repo

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      MWA VCS Workflow:
      Enables high-quality, time-domain data processing which is crucial for pulsar and FRB studies, providing insights into the early universe.
      ASKAP CELEBI Workflow:
      Facilitates precise localisation and detailed analysis of FRBs, pushing forward the frontiers of time-domain astronomy.

      FRB AI and PRESTO Search Workflow:
      Enhances the ability to quickly and accurately identify FRBs, improving our understanding of these transient phenomena and contributing to real-time astronomy.

      Pulsar Polarization Analysis:
      Crucial for pulsar classification and understanding pulsar-related astrophysics, aiding in the study of magnetic fields and pulsar evolution.
      VLBI Pipeline:
      Enhances data management and processing capabilities, leading to more efficient and scalable radio astronomy research.
      Image Quality Enhancement:
      Improves the scientific output from images of radio galaxies, facilitating a better understanding of their structures and magnetic fields.

      Show
      MWA VCS Workflow: Enables high-quality, time-domain data processing which is crucial for pulsar and FRB studies, providing insights into the early universe. ASKAP CELEBI Workflow: Facilitates precise localisation and detailed analysis of FRBs, pushing forward the frontiers of time-domain astronomy. FRB AI and PRESTO Search Workflow: Enhances the ability to quickly and accurately identify FRBs, improving our understanding of these transient phenomena and contributing to real-time astronomy. Pulsar Polarization Analysis: Crucial for pulsar classification and understanding pulsar-related astrophysics, aiding in the study of magnetic fields and pulsar evolution. VLBI Pipeline: Enhances data management and processing capabilities, leading to more efficient and scalable radio astronomy research. Image Quality Enhancement: Improves the scientific output from images of radio galaxies, facilitating a better understanding of their structures and magnetic fields.
    • Hide

      Acceptance Criteria

      1. A new workflow is done, and merged to SRCNet repo (this is most likely Presto)
      2. Gold team have resolved any merge issues with the workflow without relying on others to make changes 
      3. Acceptance by the Feature Owner

       

      Further workflows may be developed BUT prioritise the delivery of all the other PI23 features.

       

      -------------------

      Adapt a commonly used MWA VCS workload into a containerised task and add it to the Gitlab repo.

      Adapt a commonly used Presto single pulse search workload into a containerised task and add it to the Gitlab repo.

      Adapt a commonly used FRB CNNs search workload into a containerised task and add it to the Gitlab repo.

      Investigate  ASKAP CELEBI Workflow and add Documents to the confluence page.

      Adapt examples of analysed highly polarised pulsars into a containerised task and add it to the Gitlab repo.

      Adapt a commonly used VLBI workload into a containerised task and add it to the Gitlab repo.

      Adapt a commonly used Image Quality Enhancement workload into a containerised task and add it to the Gitlab repo.

      Show
      Acceptance Criteria A new workflow is done, and merged to SRCNet repo (this is most likely Presto) Gold team have resolved any merge issues with the workflow without relying on others to make changes  Acceptance by the Feature Owner   Further workflows may be developed BUT prioritise the delivery of all the other PI23 features.   ------------------- Adapt a commonly used MWA VCS workload into a containerised task and add it to the Gitlab repo. Adapt a commonly used Presto single pulse search workload into a containerised task and add it to the Gitlab repo. Adapt a commonly used FRB CNNs search workload into a containerised task and add it to the Gitlab repo. Investigate  ASKAP CELEBI Workflow and add Documents to the confluence page. Adapt examples of analysed highly polarised pulsars into a containerised task and add it to the Gitlab repo. Adapt a commonly used VLBI workload into a containerised task and add it to the Gitlab repo. Adapt a commonly used Image Quality Enhancement workload into a containerised task and add it to the Gitlab repo.
    • 3
    • 3
    • 0
    • Team_GOLD

    • PI23 - UNCOVERED

    • SRC23-PB SRCNet0.x example-workflows-and-benchmarks tests-compilation

    Description

      This enhanced feature set includes comprehensive workflows for radio astronomy data processing and analysis, preparing for the SKA's operation and supporting current pathfinder projects. It integrates the following components:

      MWA VCS Workflow:
      Configuration and operation of the MWA Voltage Capture System (VCS) workflow for high time and frequency resolution voltage data processing, tailored for time-domain studies such as pulsar and FRB research.
      ASKAP CELEBI Workflow:
      Deployment of the CELEBI pipeline for automated offline processing of FRB data detected with ASKAP, focusing on high-resolution localization and time-domain data product generation.

      FRB AI and PRESTO Search Workflow:
      Implementation of an AI-driven workflow using PRESTO for fast and efficient detection and analysis of Fast Radio Bursts (FRBs), integrating machine learning models to enhance detection accuracy and reduce false positives.

      Pulsar Polarization Analysis:
      Utilization of DSPSR and PSRCHIVE to analyze polarization profiles, position angles, and rotation measures (RM) of detected pulsars with illustrative polarization figures.
      VLBI Pipeline Deployment and Optimization:
      Deployment and optimization of a VLBI pipeline for sub-mas-level resolution radio observations, facilitated by a singularity container for easy deployment across SRC systems.
      Image Quality Enhancement Using WSClean and CASA:
      Development of a new Python script for specialized tasks in WSClean and CASA to enhance image quality by reducing sidelobes and improving the recovery of clean components from radio galaxy images.

      Attachments

        Issue Links

          depends on

          Spike - A time limited investigation to get some knowledge SP-4175 Feature level spike: Transient buffer data and workflow for SRCNet

          • Should have - Items labelled as "Should have" are important but not necessary for delivery in the current delivery timebox. While "Should have" items can be as important as "Must have", they are often not as time-critical or there may be another way to satisfy the requirement so that it can be held back until a future delivery timebox.
          • Implementing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-3863 Add a time domain task to the workloads Gitlab repository

          • Could have - Items labelled as "Could have" are desirable but not necessary and could improve the user experience or customer satisfaction for a little development cost. These will typically be included if time and resources permit.
          • Done

          Structure

            Activity

              People

                A.Clarke Clarke, Alex
                Robert.Perry Perry, Robert
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (8.77%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do2543.0
                  In Progress   59.0
                  Complete35.0
                  Total3357.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel