Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-1554

Exploration of SDP real-time RFI flagging for AA0.5

Details

    • Spike
    • Not Assigned
    • PI10
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      Successful RFI management is fundamentally necessary to ensure correct handling of RFI-related information to minimise the effect of RFI within the system and the astronomical data. Understanding the interface requirements within the RFI management system is required for this.

      Show
      Successful RFI management is fundamentally necessary to ensure correct handling of RFI-related information to minimise the effect of RFI within the system and the astronomical data. Understanding the interface requirements within the RFI management system is required for this.
    • Hide
      • Documented assessment (in confluence) of the planned RFI management system outlining what the relevant interfaces to/from SDP are.
      • Begin outlining the required RFI data model including a review of the suitability of katsdpmodel for this purpose.
      Show
      Documented assessment (in confluence) of the planned RFI management system outlining what the relevant interfaces to/from SDP are. Begin outlining the required RFI data model including a review of the suitability of katsdpmodel for this purpose.
    • 4
    • 4
    • 6.5
    • Team_PLANET
    • Sprint 5
    • Hide

      A list of available RFI mitigation/flagging techniques identified and an extensive literature review on these techniques was conducted. This survey includes pre-correlator, post-correlator, and machine learning-based algorithms. Also, a summary of the techniques and architecture used in MeerKAT was provided through conversation with MeerKAT RFI team. Also, exploration of the code started, but more meetings will be required. The outcome of this ticket reported in the following confluence pages:
      https://confluence.skatelescope.org/display/SE/List+of+RFI+Mitigation+Technologies+for+Exploration
      https://confluence.skatelescope.org/display/SE/A+Survey+on+RFI+Flagging+and+Mitigation+Algorithms
      https://confluence.skatelescope.org/display/SE/RFI+Management+System+in+MeerKAT

      Show
      A list of available RFI mitigation/flagging techniques identified and an extensive literature review on these techniques was conducted. This survey includes pre-correlator, post-correlator, and machine learning-based algorithms. Also, a summary of the techniques and architecture used in MeerKAT was provided through conversation with MeerKAT RFI team. Also, exploration of the code started, but more meetings will be required. The outcome of this ticket reported in the following confluence pages: https://confluence.skatelescope.org/display/SE/List+of+RFI+Mitigation+Technologies+for+Exploration https://confluence.skatelescope.org/display/SE/A+Survey+on+RFI+Flagging+and+Mitigation+Algorithms https://confluence.skatelescope.org/display/SE/RFI+Management+System+in+MeerKAT
    • 11.1
    • Stories Completed, Outcomes Reviewed, NFRS met, Satisfies Acceptance Criteria, Accepted by FO
    • SPO-1002

    Description

      The aim is to review the current state of the RFI management system (see RFI management workshop) to establish the required handling and format of RFI information to enable mitigation in SDP. This should include assessment of what interface requirements with other elements are and a potential minimal PoC (if time allows). This is aimed at providing a simple working solution for AA0.5 and should start to resolve important system level RFI management questions, of which SDP is a part. Producing a minimal SDP prototype of this pipeline to drive these requirements would be valuable though will be contingent on sufficient time and resource. This should specifically address what the RFI monitoring system needs to provide to SDP and how the RFI-related information from SDP should be handled and passed back into the RFI monitoring system. This will likely require discussion with the RFI team from SKAO (Federico di Vruno and Braam Otto).
      This is also expected to provide an initial RFI data model, which should consider the use of the katsdpmodel.

      Note: other RFI work (e.g. low-level DD RFI simulations) is also expected to continue in tickets related to the imaging pipeline development and simulations related to these.

      Attachments

        Issue Links

          Structure

            Activity

              People

                D.Fenech Fenech, Danielle
                r.brederode Brederode, Ray
                Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 4.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete312.0
                  Total312.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel