Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2555

SDP interface for providing 'RCAL' tied-array beamformer calibration

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Must have
    • PI15
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      The real-time calibration feedback loops from SDP are one of the less tested features of the SKA architecture - and the descriptions of the interfaces involved are fairly immature. Some detailed discussion and prototyping should lead to some more in-depth understanding of the issues.

      Show
      The real-time calibration feedback loops from SDP are one of the less tested features of the SKA architecture - and the descriptions of the interfaces involved are fairly immature. Some detailed discussion and prototyping should lead to some more in-depth understanding of the issues.
    • Hide
      • Proposal made for resolution of ADR-58 and discussed with TMC & CBF stakeholders, ideally covering all real-time calibration mentioned in the SDP-TM ICD, i.e.:
        • Antenna / station Jones matrix tables (to CSP/CBF)
        • Delay and Gain corrections (to TMC)
      • Processing script publishing mock calibration solutions at data rates / dimensions appropriate for ~AA2 via mechanism agreed on previous point (likely Tango device)
      • As usual, should have (BDD) integration test.
      • Stretch: Scale to full AA4 data rates / dimensions
      Show
      Proposal made for resolution of ADR-58 and discussed with TMC & CBF stakeholders, ideally covering all real-time calibration mentioned in the SDP-TM ICD, i.e.: Antenna / station Jones matrix tables (to CSP/CBF) Delay and Gain corrections (to TMC) Processing script publishing mock calibration solutions at data rates / dimensions appropriate for ~AA2 via mechanism agreed on previous point (likely Tango device) As usual, should have (BDD) integration test. Stretch: Scale to full AA4 data rates / dimensions
    • Intra Program
    • 3
    • 3
    • 0

    • Architectural Decision ADR-58 SDP to CBF real-time calibration interface

    • Team_NALEDI
    • Sprint 5
    • Hide

      During PI15 the Naledi team picked up the feature SP-2555 as part of an uncommitted objective.  We were not able to achieve any of the items in the acceptance criteria, spending the time we had available towards this feature on 3 tickets that entailed learning and familiarisation related to this work:

      NAL-192: Learning Tango

      The Naledi team received an overview of Tango presented by Gerhard Le Roux on the 13^th^ of July 2022. In addition we reviewed some content on Tango, TangoGQL and the Taranta-Suite.

      NAL-193: Understand the RCAL (real-time calibration) feedback loops from SDP SKA architecture and NAL-194: Review and understand ADR-58 SDP to CBF real-time calibration interface.

      We spent some time to get familiar with the status of the RCAL feedback loops, reading through some of the content of the following sources:

      Show
      During PI15 the Naledi team picked up the feature SP-2555 as part of an uncommitted objective.  We were not able to achieve any of the items in the acceptance criteria, spending the time we had available towards this feature on 3 tickets that entailed learning and familiarisation related to this work: NAL-192: Learning Tango The Naledi team received an overview of Tango presented by Gerhard Le Roux on the 13^th^ of July 2022. In addition we reviewed some content on Tango, TangoGQL and the Taranta-Suite. NAL-193: Understand the RCAL (real-time calibration) feedback loops from SDP SKA architecture and NAL-194: Review and understand ADR-58 SDP to CBF real-time calibration interface. We spent some time to get familiar with the status of the RCAL feedback loops, reading through some of the content of the following sources: ADR-58 SDP to CBF real-time calibration interface - Solution Intent - SKAO Community Confluence (skatelescope.org) RCAL Pipeline - Software Engineering - SKAO Community Confluence (skatelescope.org) SKAO / External / RASCIL · GitLab Radio Astronomy Simulation, Calibration and Imaging Library — RASCIL 0.7.0 documentation (ska-telescope.gitlab.io) Workflows — RASCIL 0.7.0 documentation (ska-telescope.gitlab.io) RCAL Pipeline - Software Engineering - SKAO Community Confluence (skatelescope.org) Attended and reviewed ADR meetings related to the   ADR-58 SDP to CBF real-time calibration interface. 
    • 18.2
    • Stories Completed

    • PI24 - UNCOVERED

    • SPO-1777

    Description

      Prototype of SDP provided interface for "RCAL" tied array beamformer gain solutions

      Who?

      • CBF and/or TMC developer
      • SDP developer
      • System Scientist

      What? (outcomes)

      • Work towards updated ICD (Interface control document) in SI (Solution Intent) with proposed interface design and data models.
      • Prototype Tango (or an agreed-upon alternative) interface that publishes mock calibration solutions (possibly in the form of Jones matrices) driven by a data source from an SDP processing script.
      • Will likely require deploying a backend infrastructure (like Apache Kafka), for which we will likely also need to define a data model. Might want to coordinate with QA work here. Note that the architecture suggests to use the same in-memory data models as processing functions - eventually.

      Why?

      • De-risk architecture by establishing interface tests and exploring risks (technology mismatches, scaling...)

      References

      Attachments

        Issue Links

          is informed by

          Architectural Decision - Software Architectural Decision ADR-58 SDP to CBF real-time calibration interface

          • Analyzing
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                p.wortmann Wortmann, Peter
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete37.0
                  Total37.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel