Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2866

SDC Data Transfer Challenge

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Should have
    • PI16
    • None
    • SRCnet
    • Hide

      Example SDC3 datasets (about 1TB) already exist and could be used to test the feasibility of data distribution for SRC3(and beyond) using Rucio or the SI DM instances. The benefit here is that we can get ready to do transfers for the real SDC3a by using this early data and generate tooling that can be re-used with minimal effort. This will serve as a proof of concept for a practical data transfer.

      Show
      Example SDC3 datasets (about 1TB) already exist and could be used to test the feasibility of data distribution for SRC3(and beyond) using Rucio or the SI DM instances. The benefit here is that we can get ready to do transfers for the real SDC3a by using this early data and generate tooling that can be re-used with minimal effort. This will serve as a proof of concept for a practical data transfer.
    • Hide

      AC1: SDC3a-type data (visibility measurement sets amounting to ~1-2TBytes in size per data collection) have been demonstrated to be moved from the location where they are created onto location(s) offering user support to Science Data challenge participants.
      AC2: The methods for achieving this are documented in a "how to" guide explaining assumed pre-requisites for the source and destination sites and clearly explaining the tools used to facilitate the transfers (be this via Rucio or via a more direct method (such as within FTS or peer-to-peer tools)).

      Show
      AC1: SDC3a-type data (visibility measurement sets amounting to ~1-2TBytes in size per data collection) have been demonstrated to be moved from the location where they are created onto location(s) offering user support to Science Data challenge participants. AC2: The methods for achieving this are documented in a "how to" guide explaining assumed pre-requisites for the source and destination sites and clearly explaining the tools used to facilitate the transfers (be this via Rucio or via a more direct method (such as within FTS or peer-to-peer tools)).
    • 1.5
    • 1.5
    • 0
    • Team_MAGENTA
    • Sprint 3
    • Hide

      Hierarchical upload/downloads enabled by extended client; code and documentation available at: https://gitlab.com/ska-telescope/src/ska-rucio-extended-client 

      Show
      Hierarchical upload/downloads enabled by extended client; code and documentation available at:  https://gitlab.com/ska-telescope/src/ska-rucio-extended-client  
    • 20.1
    • Stories Completed, Demonstrated
    • PI23 - UNCOVERED

    • SRC-DM SRC-SDC

    Attachments

      Issue Links

        Structure

          Activity

            People

              a.bonaldi Bonaldi, Anna
              a.bonaldi Bonaldi, Anna
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Feature Progress

                Story Point Burn-up: (100.00%)

                Feature Estimate: 1.5

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete710.0
                Total710.0

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel