Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3719

Prototype Linking Tool for Mini SRCNet Demonstrator

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Could have
    • None
    • None
    • SRCnet
    • Hide

      User software in science platform containers that can only read data from a file system obtains read-only random access to a data file in archival storage without staging (copying the whole file ahead of time). Permissions enforced.

      Show
      User software in science platform containers that can only read data from a file system obtains read-only random access to a data file in archival storage without staging (copying the whole file ahead of time). Permissions enforced.
    • Hide

      AC 1: Publish API documentation (design).

      AC 2: Publish updated SI images.

      AC 3: Augment SI deployment documentation.

      AC 4: Publish link creation tool so it can be installed in science images.

       

      Show
      AC 1: Publish API documentation (design). AC 2: Publish updated SI images. AC 3: Augment SI deployment documentation. AC 4: Publish link creation tool so it can be installed in science images.  
    • Team_RED
    • Sprint 2
    • 23.3
    • PI24 - UNCOVERED

    • PI20-PB

    Description

      User processing in a science platform requires access to data files in the data management (archive). Traditionally, users had to stage (copy) the data from archival storage into storage attached to processing resources in order to run software on it.

      Since the MSND data management system (storage inventory) implementations use a mix of file system and object store back end, it is feasible to prototype the minimal APIs necessary for the deployer to configure their system and allow users to create a link in a science container to a data file in archival storage and access it directly out of storage. Permission checking happens at link creation time. No bytes are copied and user software has read-only random access to the file.

      architectural note: there will be a future prototype feature to enable link to data in object store

      There are (should be?) deployment stories since there will probably be config changes needed in SI, so where does this belong? AC: Demonstrate a user creating a link and then accessing an archival data file in the science platform (visualise a cube with Carta?) and has dependencies.

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                P.Dowler Dowler, Patrick
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 0.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete10.5
                  Total10.5

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel