Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2556

AA0.5 real-time calibration pipeline for Low

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Spike
    • Must have
    • PI16
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      To satisfy a number of the AA0.5 commissioning scenarios, SDP will need to calculate complex gain corrections (Jones Matrices) for a single tied-array beam on boresight (in the direction of the centre of the primary beam) and provide these to the CBF beamformer at regular intervals (i.e. in near-real-time) during an observation.

      A working prototype of a real-time calibration pipeline for AA0.5 that can be tested on simulations will enable us gain insight into how to operate the pipeline and provide the gain solutions. This will inform the development of an integrated RCAL pipeline in future PIs.

      Show
      To satisfy a number of the AA0.5 commissioning scenarios , SDP will need to calculate complex gain corrections (Jones Matrices) for a single tied-array beam on boresight (in the direction of the centre of the primary beam) and provide these to the CBF beamformer at regular intervals (i.e. in near-real-time) during an observation. A working prototype of a real-time calibration pipeline for AA0.5 that can be tested on simulations will enable us gain insight into how to operate the pipeline and provide the gain solutions. This will inform the development of an integrated RCAL pipeline in future PIs.
    • Hide
      • Working prototype of real-time calibration pipeline with documentation in an SKA GitLab repository.
      • Simulations of AA0.5 data sets for testing the pipeline.
      • Calibration pipeline/report for AA0.5 LOW, available via a notebook to facilitate exploration of suitable parameters for real-time calibration.
      • Stretch: investigation of how the pipeline can be scaled up for later array assemblies.
      Show
      Working prototype of real-time calibration pipeline with documentation in an SKA GitLab repository. Simulations of AA0.5 data sets for testing the pipeline. Calibration pipeline/report for AA0.5 LOW, available via a notebook to facilitate exploration of suitable parameters for real-time calibration. Stretch: investigation of how the pipeline can be scaled up for later array assemblies.
    • Intra Program
    • 3
    • 3
    • 0
    • Team_YANDA
    • Sprint 5
    • Show
      Report in notebook format https://gitlab.com/ska-telescope/sdp/ska-sdp-jones-solvers/-/blob/master/examples/notebooks/LOW_AA0.5_RCAL_report.ipynb Further results as comment below and here https://jira.skatelescope.org/browse/YAN-1109?focusedCommentId=177471&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-177471 2 Processing CoP demos: https://confluence.skatelescope.org/display/SE/2022-11-21+Processing+CoP+Meeting+Notes https://confluence.skatelescope.org/display/SE/2022-09-19+Processing+CoP+Meeting+Notes
    • 17.5
    • Demonstrated

    Description

      Introduction

      For AA0.5, the SDP needs to be able to produce real-time calibration solutions to enable the CBF to form a single tied-array beam along the boresight (in the direction of the centre of the primary beam). This purpose of this spike is to get a working prototype of a real-time calibration pipeline, and answer some fundamental questions about how to operate it.

      We want a pipeline that can read simulated AA0.5 observations and produce calibration solutions in quasi-real-time. The pipeline does not need to be integrated into the prototype SDP. Once we have a working pipeline, we can start to answer questions like:

      • How much data (in time and frequency) is needed to get a good calibration solution?
      • What data are useful for assessing the quality of the calibration solutions? (Thinking of QA displays.)
      • What are the computational requirements of the pipeline?

      As part of this work you should generate simulations for SKA-Low corresponding to the commissioning scenarios and test the pipeline on them.

      As a stretch, you could also look at how the pipeline can be scaled up for later array assemblies (AA1, etc.).


      Who?

      • SDP real-time pipeline developers
      • Commissioning scientists

      What?

      See acceptance criteria.

      Why?

      See benefit hypothesis.

      Attachments

        1. phase_error.png
          phase_error.png
          114 kB
        2. sim_n_cal_f0.png
          sim_n_cal_f0.png
          253 kB
        3. sim_n_cal_f1.png
          sim_n_cal_f1.png
          419 kB

        Issue Links

          Structure

            Activity

              People

                b.nikolic Nikolic, Bojan
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete718.0
                  Total718.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel