Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3901

Ingest science archival data into Rucio and replicate to another RSE

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Should have
    • PI21
    • None
    • SRCnet
    • Hide

      AC1: A subset of the archives described at https://confluence.skatelescope.org/display/SRCSC/COR-221+Multi-site+Storage+Inventory%3A+Data+distribution+plan are uploaded into one of the RSEs in the SRCNet.

      AC2: Data is replicated to at least one other RSEs in the network.

      AC3: Documentation and/or demo available showing steps required to ingest/replicate data, and ideally, approximate durations of data replication. Also to show use made / consideration of of Rucio data sets / data collections and scopes.

      Show
      AC1: A subset of the archives described at https://confluence.skatelescope.org/display/SRCSC/COR-221+Multi-site+Storage+Inventory%3A+Data+distribution+plan are uploaded into one of the RSEs in the SRCNet. AC2: Data is replicated to at least one other RSEs in the network. AC3: Documentation and/or demo available showing steps required to ingest/replicate data, and ideally, approximate durations of data replication. Also to show use made / consideration of of Rucio data sets / data collections and scopes.
    • 1
    • 1
    • 0
    • Team_MAGENTA
    • Sprint 5
    • Hide

      AC 1-3 met, shown by notes and linked demo at: https://confluence.skatelescope.org/display/SRCSC/SP-3901+Ingest+science+archival+data+into+Rucio+and+replicate 

      Show
      AC 1-3 met, shown by notes and linked demo at: https://confluence.skatelescope.org/display/SRCSC/SP-3901+Ingest+science+archival+data+into+Rucio+and+replicate  
    • 21.6
    • Stories Completed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

    • PI24 - UNCOVERED

    • PI21-PB

    Description

      As described at https://confluence.skatelescope.org/display/SRCSC/COR-221+Multi-site+Storage+Inventory%3A+Data+distribution+plan several existing surveys have been ingested into the Storage Inventory demonstrator.

      To aid DDM evaluation, it has been proposed to ingest (a subset of) these data into the Rucio prototype, whereupon it can be replicated to other RSEs in the network. This is not envisaged to be a large amount of work, although it could present an opportunity to test out the recently developed data ingestion service (https://jira.skatelescope.org/browse/SP-3680).

      Attachments

        Structure

          Activity

            People

              r.bolton Bolton, Rosie
              j.collinson Collinson, James
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (100.00%)

                Feature Estimate: 1.0

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete57.0
                Total57.0

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel