Details
-
Feature
-
Not Assigned
-
Data Processing
-
-
-
1
-
1
-
16
-
Team_YANDA
-
Sprint 4
-
-
-
-
7.4
-
-
SDP-Software Team_YANDA
-
SPO-567
Description
This feature should extend the great work done by the YANDA team (s.ord) in PI6 which design an developed an updated visibility receive workflow targeted at the PSI (and AA0.5) requirements (see links below).
The critical next step for this is to test and implement this updated workflow in the SDP prototype code controlled though commands issues to the SDP Subarray device and as part of a tested SKAMPI deployment in a suitable integration environment. If possible this should extend to consider configuration and deployment of a multi-node receive workflow.
If time permits this work should also consider some (or all) of the of the following next steps:
- Working closely alongside the team/teams who select
SP-1001to test this workflow with associated real-time signal plots - Working closely alongside the team/teams who select
SP-1023to provide a PoC of how additional RT processing (eg flagging) might be associated with visibility receive. - Working closely alongside the team/teams who select
SP-1048to test deployment latency associated with the risk of assigning and (re-)configuring SDP resources - Testing and adding other protocols (eg. RoCE)
- Adding additional payloads
- Consideration and PoC of an improved mechanism to obtain MS meta-data for use in the receive workflow. As only limited data is provided by the CBF data stream currently the source of additional meta-data required to construct the MS written by the receive workflow is not architecturally correct.
- Consideration and testing of error / failure modes relating missing data, dropped connections, failure of a node where receive is started etc.
Links to work from PI6:
Features:
Code:
Demo:
Attachments
Issue Links
- relates to
-
SP-794 CBF visibility data stream emulator for testing PSI deployment
- Done
-
SP-836 Visibility receive workflow configured and tested for use with the PSI
- Done
-
SP-1001 RT visibility receive signal display developed and integrated into the SDP prototype
- Done
-
SP-1023 Proof-of-concept of visibility streaming over apache arrow/plasma for real-time processing
- Done
-
SP-1048 Assess performance latency needed to launch a containerised (receive) workflow using k8s
- Done
-
SP-1654 Testing of the visibility receive workflow for AA0.5 use
- Done
-
SP-257 Scientific Quality Assessment information/metrics storage and visualisation architecture
- Discarded
-
SP-438 [Needs splitting] Operator Feedback
- Discarded