Details

    • Feature
    • Must have
    • PI22
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      Batch pre-processing will provide early important stages of data processing and system interfacing for accessing relevant data e.g. calibration, flags. As we begin to incorporate the batch processing into SDP and the wider system for testing, starting with the early stages of processing will be needed for early feedback.

      Show
      Batch pre-processing will provide early important stages of data processing and system interfacing for accessing relevant data e.g. calibration, flags. As we begin to incorporate the batch processing into SDP and the wider system for testing, starting with the early stages of processing will be needed for early feedback.
    • Hide
      1. Description of pre-processing pipeline in Solution Intent (YANDA ~ 1 fp)
      2. Documented pipeline provided with suitable test data (pipeline release?) which will be tested by the FO.
      3. Demonstration of processing which includes the pre-processing and ability to continue to self-calibration.
      Show
      Description of pre-processing pipeline in Solution Intent ( YANDA  ~ 1 fp) Documented pipeline provided with suitable test data (pipeline release?) which will be tested by the FO. Demonstration of processing which includes the pre-processing and ability to continue to self-calibration.
    • 5
    • 5
    • 0
    • Team_YANDA
    • Sprint 5
    • Show
      https://confluence.skatelescope.org/display/SWSI/SDP+Batch+Pre-processing+Pipeline+AA2
    • PI22 - UNCOVERED

    Description

      One of the first batch processing stages will be the pre-processing pipeline, expected to include application of current/known calibration, flagging, de-mixing and averaging as required. This where possible should make use of the similar components that are used in the real-time pre-processing. However, the way these will be exercised for the batch processing will be likely more computationally intensive and introduce stages that are not used in the real-time pipeline. This ticket aims to first look at what demixing is required for both Low and Mid and to give a detailed description of the pipeline requirements in Solution Intent. This will enable quick development from PI23 to put in place a first batch pipeline which can be demonstrated in use with self-calibration. This can focus on one or more stages but should be provided as a release for others to use. As this will be aimed at AA2 usage, this should consider expected scaling mechanisms

      See Miro for details: https://miro.com/app/board/uXjVN2k7zp0=/?moveToWidget=3458764581039835517&cot=14

      Attachments

        Structure

          Activity

            People

              D.Fenech Fenech, Danielle
              D.Fenech Fenech, Danielle
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Feature Progress

                Story Point Burn-up: (0%)

                Feature Estimate: 5.0

                IssuesStory Points
                To Do00.0
                In Progress   13.0
                Complete00.0
                Total13.0

                Dates

                  Created:
                  Updated:

                  Structure Helper Panel