Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2706

Visibility receive provides health statistics

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Must have
    • PI16
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      Receiving visibilities is one of the most important ways that SDP participates in observations. Therefore it is critical that we can monitor that it is performing this function correctly.

      Show
      Receiving visibilities is one of the most important ways that SDP participates in observations. Therefore it is critical that we can monitor that it is performing this function correctly.
      • Relevant health data - such as received heaps, data layout or scan ID - are published on data queues (i.e. via Kafka)
      • Stretch: Demonstrate use for the health statistics, e.g. via QA displays or Grafana
    • Inter Program, Intra Program
    • 2
    • 2
    • 0
    • Team_NALEDI
    • Sprint 5
    • Hide

      The display shows the Scan IDs from plasma and from the SPEED2 receiver. (If those are not the same then there is a clash somewhere/or there are 2 scans running at the same time)
      The number of errors [incomplete heaps] are shown on the dashboards.

      An example of the dashboard has been deployed in the NALEDI namespace:
      https://sdhp.stfc.skao.int/dp-naledi-dominic/qa/display

      The API endpoint for receiving all messages from the SPEED2 receiver is has been deployed in the NALEDI namespace (newest first):
      https://sdhp.stfc.skao.int/dp-naledi-dominic/qa/api/stats/receiver/all_events

      The data is updated once per second (that is how often the SPEED2 receiver sends stats). It will also show nothing when not receiving.

      Once the new "receive modules" has been deployed, the correct list can be obtained.

      Show
      The display shows the Scan IDs from plasma and from the SPEED2 receiver. (If those are not the same then there is a clash somewhere/or there are 2 scans running at the same time) The number of errors [incomplete heaps] are shown on the dashboards. An example of the dashboard has been deployed in the NALEDI namespace: https://sdhp.stfc.skao.int/dp-naledi-dominic/qa/display The API endpoint for receiving all messages from the SPEED2 receiver is has been deployed in the NALEDI namespace (newest first): https://sdhp.stfc.skao.int/dp-naledi-dominic/qa/api/stats/receiver/all_events The data is updated once per second (that is how often the SPEED2 receiver sends stats). It will also show nothing when not receiving. Once the new "receive modules" has been deployed, the correct list can be obtained.
    • 18.2
    • Stories Completed, Integrated, Solution Intent Updated, BDD Testing Passes (no errors), Outcomes Reviewed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
    • PI24 - UNCOVERED

    • DP-SDP: G1 SOL: G1

    Description

      Who?

      • AIV engineers
      • SDP Developers

      What?

      • Can determine while an observation is running whether data was ingested correctly
      • Diagnose concrete problems with configuration mismatch between sub-systems
      • Might need to be at a relatively low level at this point - but should ensure that it fits into existing visibility receive / QA work.

      Why?

      • see benefit hypothesis

      Attachments

        Issue Links

          Structure

            Activity

              People

                p.wortmann Wortmann, Peter
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete512.0
                  Total512.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel