Details
-
Feature
-
Could have
-
None
-
None
-
SRCnet
-
-
-
Team_RED
-
Sprint 2
-
-
-
23.3
-
-
PI20-PB
Description
User processing in a science platform requires access to data files in the data management (archive). Traditionally, users had to stage (copy) the data from archival storage into storage attached to processing resources in order to run software on it.
Since the MSND data management system (storage inventory) implementations use a mix of file system and object store back end, it is feasible to prototype the minimal APIs necessary for the deployer to configure their system and allow users to create a link in a science container to a data file in archival storage and access it directly out of storage. Permission checking happens at link creation time. No bytes are copied and user software has read-only random access to the file.
architectural note: there will be a future prototype feature to enable link to data in object store
There are (should be?) deployment stories since there will probably be config changes needed in SI, so where does this belong? AC: Demonstrate a user creating a link and then accessing an archival data file in the science platform (visualise a cube with Carta?) and has dependencies.
Attachments
Issue Links
- mentioned in
-
Page Loading...