Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3829

Enable operators to upload and use static input data in pipelines

Details

    • Enabler
    • Must have
    • PI21
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      See Why? in description

      Show
      See Why? in description
    • Hide

      See What? in description

      Show
      See What? in description
    • Intra Program
    • 3
    • 3
    • 0
    • Team_NALEDI, Team_ORCA, Team_YANDA
    • Sprint 4
    • Overdue
    • Hide

      Inputs for testing real-time pipelines are collected and made available in the appropriate repositories. 

      [ YANDA ] An investigation of typical sky models was undertaken and examination of the current requirements for AA0.5. A JSON representation of the GLEAM all-sky model has been added to the telmodel data repository together a schema and the associated validation tests. This is not considered the complete solution to this problem - but has started a discussion on the form the sky model representations should take. More features in subsequent PIs are expected to further develop this

      A HDF5 representation of a static RFI model was also added to the data repository to meet the needs of ORCA.

      [ YAN-1617, YAN-1618, YAN-1628 ]

       

      Real-time pipelines use the telescope model library to retrieve these data.

      [ ORCA ] The pointing offset calibration pipeline has been updated to read static RFI mask data from the Telescope Model Data Repository. We tested it with the data file uploaded by Yanda (currently on a branch): MR69 

      We also updated the pointing-offset script to determine the location of the RFI mask buy implementing the use of the `telescope_model` parameter: MR118, MR120  

      Show
      Inputs for testing real-time pipelines are collected and made available in the appropriate repositories.   [ YANDA ] An investigation of typical sky models was undertaken and examination of the current requirements for AA0.5. A JSON representation of the GLEAM all-sky model has been added to the telmodel data repository together a schema and the associated validation tests. This is not considered the complete solution to this problem - but has started a discussion on the form the sky model representations should take. More features in subsequent PIs are expected to further develop this A HDF5 representation of a static RFI model was also added to the data repository to meet the needs of ORCA. [ YAN-1617, YAN-1618, YAN-1628 ]   Real-time pipelines use the telescope model library to retrieve these data. [ ORCA ] The pointing offset calibration pipeline has been updated to read static RFI mask data from the Telescope Model Data Repository. We tested it with the data file uploaded by Yanda (currently on a branch ): MR69   We also updated the pointing-offset script to determine the location of the RFI mask buy implementing the use of the `telescope_model` parameter: MR118 , MR120   
    • PI22 - UNCOVERED

    • Low G3 Mid G3

    Description

      See frame in PI21 Backlog board


      Who? (Beneficiaries)

      • AIV engineers.
      • Commissioning scientists.
      • Telescope operators.

      Why? (Benefit hypothesis)

      • Enables operators of SDP pipelines to upload static input data and make use of them in the processing.
      • Input data for the pipelines are versioned and stored in common repositories.

      What? (Acceptance criteria)

      • Telescope model library can be used to provision static input data for pipelines, including bandpasses, RFI masks and sky models.
      • Inputs for testing real-time pipelines are collected and made available in the appropriate repositories. (YANDA - minimal to meet ORCA dependency)
      • Real-time pipelines use the telescope model library to retrieve these data. (pointing: ORCA)
      • User documentation is provided on how to discover which input data are available, upload new input data, and use these data in the pipelines. (NALEDI)

      Attachments

        Issue Links

          Structure

            Activity

              People

                p.wortmann Wortmann, Peter
                m.ashdown Ashdown, Mark
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1137.5
                  Total1137.5

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel