Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3071

Deploy external Rucio metadata database and connect IVOA discovery and access interfaces

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      Up to now the Rucio IVOA sandbox has used its own ephemeral metadata database brought up inside a docker-compose environment solely for the purposes of developing and demonstrating metadata based functionality (IVOA data discoverability and access). The result of this feature would be a longer-lived metadata database that is connected to the SKAO Rucio prototype datalake, allowing all this previously developed functionality to run against a "live" instance of Rucio. Coupled with this would be the ingestion of representative data/metadata into the datalake. This would not only enable the new functionality to be more widely tested on real data, but also builds a visible platform whereby integrations with other services e.g. visualisation can more easily be developed.

      Show
      Up to now the Rucio IVOA sandbox has used its own ephemeral metadata database brought up inside a docker-compose environment solely for the purposes of developing and demonstrating metadata based functionality (IVOA data discoverability and access). The result of this feature would be a longer-lived metadata database that is connected to the SKAO Rucio prototype datalake, allowing all this previously developed functionality to run against a "live" instance of Rucio. Coupled with this would be the ingestion of representative data/metadata into the datalake. This would not only enable the new functionality to be more widely tested on real data, but also builds a visible platform whereby integrations with other services e.g. visualisation can more easily be developed.
    • Hide

      AC1: Rucio get/set/delete commands (API or CLI) working against external database
      AC2: Ingest some example data/metadata e.g. https://confluence.skatelescope.org/display/SRCSC/%5BORA-21%5D+Collection+of+demo+data+with+downloadable+links
      AC3: Previous IVOA data discovery and access workflow shown to work with this "live" implementation

      Show
      AC1 : Rucio get/set/delete commands (API or CLI) working against external database AC2: Ingest some example data/metadata e.g. https://confluence.skatelescope.org/display/SRCSC/%5BORA-21%5D+Collection+of+demo+data+with+downloadable+links AC3 : Previous IVOA data discovery and access workflow shown to work with this "live" implementation
    • 1.5
    • 1.5
    • 0
    • Team_MAGENTA
    • Sprint 4
    • Show
      AC1: Done (see demo below) AC2: https://confluence.skatelescope.org/pages/viewpage.action?pageId=227175537 AC3: Demoed as part of https://drive.google.com/file/d/1ZL0TuxLmLXBbPBZ4gJqRKONEoTfgmiIR/view?usp=drive_link (discovers data from live Rucio instance)
    • 20.4
    • Stories Completed, Integrated
    • PI23 - UNCOVERED

    • PI19-PB SRC-DataAccess

    Attachments

      Issue Links

        Structure

          Activity

            People

              Jesus.Salgado Salgado, Jesus
              R.Barnsley Barnsley, Rob
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (100.00%)

                Feature Estimate: 1.5

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete711.0
                Total711.0

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel