Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Should have
Fix Version/s: PI22
Component/s: SRCnet Data Management
Labels:
- service-integration

ARTs:

SRCnet
Benefit hypothesis:

Hide

BH: Having a user storage area accessible by users, allow the integration of analysis workflows with the SRCNet data lake.

Show
BH: Having a user storage area accessible by users, allow the integration of analysis workflows with the SRCNet data lake.
Acceptance criteria:

Hide

Analyse possibilities for SRCNet0.1 and make a recommendation for how to proceed.

AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document

AC1: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session.

AC2: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance.

Show
Analyse possibilities for SRCNet0.1 and make a recommendation for how to proceed. AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document AC1: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session. AC2: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance.
Expect Dependencies:

Intra Program
Initial Size:
1
Epic Link:
Data Management v0.1 - Roadmap
Agile Teams:

Team_CORAL
Due Sprint:
Sprint 4
Story Point Burn-up:
Overdue:
Outcomes:
Hide

AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document

See comment from FO: https://jira.skatelescope.org/browse/SP-4099?focusedId=302626&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-302626

@Jesus Salgado: A proper identification of the use-cases will be done with the collaboration of other groups and scientists so it is out of the scope of this feature

AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session.

https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub

AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance.

https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub

Demo: "Exploring User Storage options within CANFAR"

Recording: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846042
Show
AC1: Add 'user storage' use-cases to SRCNet0.1 use-cases document See comment from FO: https://jira.skatelescope.org/browse/SP-4099?focusedId=302626&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-302626 @Jesus Salgado: A proper identification of the use-cases will be done with the collaboration of other groups and scientists so it is out of the scope of this feature AC2: Document options to provide a data environment accessible by, at least, notebooks so users can use the data products in an interactive interface, and save derived products to return to at a later session. https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub AC3: Document how CADC user storage deployed at ESSRC can be seen from outside the local CANFAR instance. https://confluence.skatelescope.org/display/SRCSC/COR-579+-+Mount+PV+with+the+user+data+to+external+JupyterHub Demo: "Exploring User Storage options within CANFAR" Recording: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846042
Resolved PI.Sprint:
23.3

Feature Checklist:

Stories Completed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

Requirement Status:

PI24 - UNCOVERED
Labels_MIRO:
service-integration

Description

For the two options of Data Management software stack, the following features should be defined for v0.1:

Identify possible ways to define areas for users where data from the data lake (standard data) and user data could be accessible for processing. This could be a definitive solution or a temporal one only for v0.1
Identify how to create an accessible data product from the data lake, e.g. ODP, by invoking a close to the node copy and, maybe, creating a visible link to data (to prevent copies just for individual users of the standard data)
Implement at server side the replica invocation close to user (same analysis node)
Implement a client able to invoke replication, access user storage (navigation and access). This could be integrated into astroquery or similar standard python client

Attachments

Issue Links

Child Of

SP-4871 Data Management v0.1 - Roadmap

Implementing

relates to

SP-4155 Integrate Science Gateway with (CANFAR) Cavern User Storage

Funnel

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(4 mentioned in)

Structure

Activity

People

Assignee:: Salgado, Jesus

Reporter:: Salgado, Jesus

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 0.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	4	6.0
Total	4	6.0

Dates

Created:: 19/Feb/24 11:44 AM

Updated:: 1 week ago 6:09 AM

Resolved:: 18/Jul/24 2:14 PM

Due Sprint Date:: 07/May/24

Explore User Storage Options