Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Enabler
Priority: Won't have (this time)
Fix Version/s: None
Component/s: COM SDP SW
Labels:
None

ARTs:

Data Processing
Benefit hypothesis:

Hide

If the CSP-SDP ICD is modified to support RDMA rather than default SPEAD UDP packets, then there will be downstream modifications required within SKAMPI. This feature would prototype a potential "front-end" for the SDP that could slot in front of the SKAPI SDP software, to reduce the necessary downstream changes.

It would allow the data to either be forwarded to the CBF-SDP Emulator (which distributes the data to flexible consumers) or else directly into some (eg real-time) pipelines or to storage.

Show
If the CSP-SDP ICD is modified to support RDMA rather than default SPEAD UDP packets, then there will be downstream modifications required within SKAMPI. This feature would prototype a potential "front-end" for the SDP that could slot in front of the SKAPI SDP software, to reduce the necessary downstream changes. It would allow the data to either be forwarded to the CBF-SDP Emulator (which distributes the data to flexible consumers) or else directly into some (eg real-time) pipelines or to storage.
Acceptance criteria:

Hide

The prototype code is on-boarded into GitLab, demonstrated to run with actual FPGA-generated visibilities, allows basic TANGO configuration (to be improved in future PI), and either receives the data in a local pipeline or else forwards the data to an CBF-SDP Emulator.

In PI#9 it would only be a proof-of-concept prototype, so might not have Kubernetes intergration.

Show
The prototype code is on-boarded into GitLab, demonstrated to run with actual FPGA-generated visibilities, allows basic TANGO configuration (to be improved in future PI), and either receives the data in a local pipeline or else forwards the data to an CBF-SDP Emulator. In PI#9 it would only be a proof-of-concept prototype, so might not have Kubernetes intergration.
Feature Points:
2
WSJF:
3
Story Point Burn-up:
Overdue:

Requirement Status:

PI24 - UNCOVERED

Description

A prototype SDP visibiltiy receiver will be developed which accepts visibilities from CBF via RDMA. It will work as a potential front end to the CBF-SDP Emulator to handle the case when visibilities are transported via RDMA, allowing the visibilities to be delivered directly to RAM, pinned GPU host memory, or redelivered as UDP packets to the CBF-SDP Emulator.

It might also (depending on time availability or in a later PI) support RDMA directly to GPU device memory and/or SSD storage (or potentially written to a local Plasma object store).

It will expose a TANGO interface for configuring the receiver, to set up/clean up queues and destinations on demand.

Attachments

Issue Links

relates to

ADR-29 RDMA for visibilities

Analyzing

SP-910 Create an RDMA-based receive code for ingest into the Imaging/Gain Calibration Pipeline

Done

mentioned in: Page Loading...; Page Loading...

Structure

Activity

People

Assignee:: Wortmann, Peter

Reporter:: Ensor, Andrew [X] (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (0%)

Feature Estimate: 2.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	0	0.0
Total	0	0.0

Dates

Created:: 11/Nov/20 2:33 AM

Updated:: 12/Aug/24 12:29 PM

Prototype an RDMA-based SDP visibility receiver