Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3731

Extend Science gateway functionality to request data staging via the SRCNet Data Management API

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      When a user has discovered a data set they would like to use for their analysis, it could be that (part of) this data set is stored on cold storage, or that not all data products in the data set are not stored at the same location as the processing system they want to work on. This requires the science gateway to have functionality to initiate the replication of a data product to the storage that can be directly accessed from the processing system.

       

      The actual execution of the replication is out of scope of this feature and is the task of the Data Management System.

      Show
      When a user has discovered a data set they would like to use for their analysis, it could be that (part of) this data set is stored on cold storage, or that not all data products in the data set are not stored at the same location as the processing system they want to work on. This requires the science gateway to have functionality to initiate the replication of a data product to the storage that can be directly accessed from the processing system.   The actual execution of the replication is out of scope of this feature and is the task of the Data Management System.
    • Hide

      AC1: The science gateway has functionality enabling a user to define a data collection
      AC2: This data collection can be submitted to the DM API to create a Rucio DID of that data collection
      AC3: The user can request replication of that data collection via the DM API
      AC4: The resulting functionality is documented and demonstrated to the ART
      AC5: The user can only invoke the DM Service in compliance with DM policies

      Show
      AC1: The science gateway has functionality enabling a user to define a data collection AC2: This data collection can be submitted to the DM API to create a Rucio DID of that data collection AC3: The user can request replication of that data collection via the DM API AC4: The resulting functionality is documented and demonstrated to the ART AC5: The user can only invoke the DM Service in compliance with DM policies
    • 2
    • 2
    • 0

    • PI23 - UNCOVERED

    • SRCNet0.1 science-gateway

    Description

      Tasks could include (sequence likely important):

      • Utilise Auth API client to request a token exchange for Site Capabilities API
      • Utilise Site Capabilities API to pull information about destination RSE (i.e. UUID)
      • Utilise Auth API client to request a token exchange for Data Management API 
      • Utilise DM API client to issue staging requests

      Attachments

        Issue Links

          depends on

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-3679 Dissemination of data management API architecture and supporting services

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Done
          relates to

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4421 Stage 1 System Architecture Design for Distributed Compute and Storage

          • Not Assigned - Priority is not assigned yet.
          • Funnel
          mentioned in

          Page Loading...

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                j.collinson Collinson, James
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel