Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4099

Explore User Storage Options

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      BH: Having a user storage area accessible by users, allow the integration of analysis workflows with the SRCNet data lake.

      Show
      BH: Having a user storage area accessible by users, allow the integration of analysis workflows with the SRCNet data lake.
    • Hide

      Analyse possibilities for SRCNet0.1 and make a recommendation for how to proceed.

       

      AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document

      AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session.

      AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance. 

      Show
      Analyse possibilities for SRCNet0.1 and make a recommendation for how to proceed.   AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session. AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance. 
    • Intra Program
    • 1
    • Team_CORAL
    • Sprint 4
    • Hide

      AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document

      See comment from FO: https://jira.skatelescope.org/browse/SP-4099?focusedId=302626&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-302626

      AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session.

      AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance. 

      Demo: "Exploring User Storage options within CANFAR"

      Show
      AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document See comment from FO: https://jira.skatelescope.org/browse/SP-4099?focusedId=302626&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-302626 AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session. https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance.  https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub Demo:  "Exploring User Storage options within CANFAR" Recording: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846042

    • PI23 - UNCOVERED

    • service-integration

    Description

      For the two options of Data Management software stack, the following features should be defined for v0.1:

      • Identify possible ways to define areas for users where data from the data lake (standard data) and user data could be accessible for processing. This could be a definitive solution or a temporal one only for v0.1
      • Identify how to create an accessible data product from the data lake, e.g. ODP, by invoking a close to the node copy and, maybe, creating a visible link to data (to prevent copies just for individual users of the standard data)
      • Implement at server side the replica invocation close to user (same analysis node)
      • Implement a client able to invoke replication, access user storage (navigation and access). This could be integrated into astroquery or similar standard python client

      Attachments

        Issue Links

          relates to

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4155 Integrate Science Gateway with (CANFAR) Cavern User Storage

          • Not Assigned - Priority is not assigned yet.
          • Funnel
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                Jesus.Salgado Salgado, Jesus
                Jesus.Salgado Salgado, Jesus
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 0.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete46.0
                  Total46.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel