Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3592

Rucio demo with scientific data products

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Won't have (this time)
    • None
    • None
    • None
    • SRCnet
    • Hide
      1. A demo (with dashboard views) showing how data locations are visible in rucio, that transfers are initiated and re-tried until rules are met
      2. Estimation of the time taken to write rules / manage the instance
      3. Extension to protected data products using SRC IAM if possible
      Show
      A demo (with dashboard views) showing how data locations are visible in rucio, that transfers are initiated and re-tried until rules are met Estimation of the time taken to write rules / manage the instance Extension to protected data products using SRC IAM if possible
    • 1
    • 0
    • 22.5
    • PI23 - UNCOVERED

    Description

      In order to make a fair and meaningful comparison between Rucio and Storage Inventory, to support a down-selection process, it would be good to have comparable tests running in the two distributed data management suites.

      SI has been shown to work nicely (see demo by Franz linked from here: https://confluence.skatelescope.org/pages/viewpage.action?pageId=227163873 ). The public data sets are well defined and available at CADC.

      This feature would be to place these data sets into Rucio, ideally with some appropriate metadata too, and write data distribution rules that trigger the replication of products accordingly, and which are robust to additions to the data catalogues at the source location.

      A demo (with dashboard views where appropriate) showing how data locations are visible in rucio, that transfers are initiated and re-tried until rules are met, would be beneficial.

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                r.bolton Bolton, Rosie
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel