Metadata Management v0.1 - Roadmap

Key Functionalities and Objectives

Data Model Refactoring:

• Consolidation of data modeling efforts from previous features (SP-4397 and SP-4420) to align with a proposed radio astronomy model, specifically for the LoTSS DR2 data.

Hierarchical Data Support:

• Enhancements to allow the upload of hierarchical datasets with discoverable IVOA ObsCore metadata into Rucio, improving the system's capability to manage complex data structures.

Proof-of-Concept for CAOM2.5:

• Implementation of a proof-of-concept for a radio astronomy-aware CAOM2.5 data model, along with the setup of a TAP (Table Access Protocol) service for querying this model.

Metadata Service Upgrade:

• Replacement of the current metadata TAP service with an OpenCADC TAP service that includes AAI (Authentication and Authorization Infrastructure) integration, ensuring better alignment with SRCNet requirements and evolving standards.

Compliance with IVOA Standards:

• Ensuring that services comply with the latest IVOA DALI (Data Access Layer Interface) and VOSI (Virtual Observatory Simple Image Access) standards, focusing on resource availability and capabilities.

Documentation and Schema Analysis:

• Documenting the current science metadata schema to understand existing structures and plan necessary changes.

Service Deployment and Configuration:

• Deployment of the modified youcat service at a designated site, configured to interact with the current metadata tables.

Bug Fixes and Enhancements:

••Addressing a critical bug in the metadata database related to connection management, with specific steps outlined for resolving related pull requests (PRs) to improve system responsiveness and security.