Details
-
Feature
-
Medium
-
Data Processing
-
-
-
5
-
5
-
0
-
-
-
-
AA2 SDP_AA2_services_realtime_pipelines
Description
See Feature frame on DP ART board.
Context
The SDP buffer is a store managed by SDP to hold data in support of processing. As such, it is expected to hold only objects that are ephemeral in some fashion (with expected lifetimes of eventually ~2-3 days), so we will need a service that monitors and manages it. This especially includes deleting objects - clearly a risky prospect, but required for day-to-day operations of the telescope once we start ingesting significant amounts of data. We need to make sure this is firmly under control, and we make it as transparent and predictable as possible when and where a deletion happens.
References
ADR-101 - SDP buffer management and interface to Data Lifecycle Management