Details
-
Feature
-
Could have
-
None
-
SRCnet
-
-
-
2
-
0
-
Team_CORAL
-
Sprint 5
-
-
-
20.1
-
-
PI18-PB SRC-DataAccess SRC-SI
-
SRC-G2
Description
Develop a demonstrator of 3 use cases:
a) An authorised user can query on ObsCore table with TOPCAT or astroquery, in order to access metadata of datasets stored in the distributed data system based on SI.
b) An authorised user can query and access files from the storage inventory with astroquery.
c) show support for anonymous access to public data.
Basic concept: there is a primary metadata database with all the observation metadata. Mini-SRC prototype sites will make a complete local copy of the metadata. Unlike storage inventory, this is single-direction sync from a primary to clones.
Softare dev: add grants endpoint to metadata repository service and provide a stand alone grants service for mini-src nodes.
Deploy primary metadata site: metadata database (PostgreSQL) and metadata repository service; add to global service registry; populate SI science metadata database identified in SP-2840 but with storage identifiers changed to refer to the SRCNet global inventory in SP-2829.
Software dev: the CAOM metadata sync tool is a command line tool used at CADC and ESAC; need to package it up in a docker image for easier config and deployment.
Software dev: add a StorageResolver for the `ska` artifact scheme; this is used by the CAOM DataLink service to generate links for accessing data in storage.
Mini-SRC metadata sites: deploy metadata database and metadata synchcronisation from primary; deploy CAOM services: TAP, DataLink, grant service (readGrantProvider for use by local minoc)
This prototype involves four CAOM software components; CADC will provide docker images for all components: repo service, sync tool, TAP service, DataLink service.
Mini-SRCNet Demonstrator Roadmap: https://docs.google.com/spreadsheets/d/1Kri0Bc0n9PE30Nv7b1LkeUhh88ZatuFuYYJ2T2CSRUU/edit?usp=sharing