Details
-
Feature
-
Must have
-
None
-
SRCnet
-
-
-
0.5
-
0.5
-
0
-
Team_MAGENTA
-
-
-
-
SRC23-PB SRCNet0.1 data-lifecycle
Description
For SRCNet v0.1, there is a plan to have a set of ingestion nodes to allow the dissemination of data and registration of data into the SRCNet data lake
This should cover all the candidates, at least:
- Description of data to be included from this node, including size and, if applicable, production rate
- Requirements on storage (staging area) and compute (ingestion daemon service)
- Requirements on network connectivity with other nodes
- Description of the metadata data model that could be provided for the data (e.g. IVOA Obscore metadata)
Candidates will be locations close to the telescope locations (under the coordination of pipelines operators/team) and SRC nodes that will provide ingestion of data sources like synthetically produced data, precursors data, or other types
In all the nodes, the software to be used will be the SRCNet ingestion software (and/or evolution):
https://gitlab.com/ska-telescope/src/ska-src-ingestion
This information will be provided to the candidates of ingestion nodes for analysis and provision.