Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Should have
Fix Version/s: PI20
Component/s: SRCnet Science Enabling
Labels:
- PI20-PB
- Team_Magenta

ARTs:

SRCnet
Benefit hypothesis:

Hide

Previously we have demoed the datalake as a service; a JupyterHub instance capable of reading data directly from RSE-managed storage. The simplest case of CANFAR science platform reading data in-place from data lake storage would be to mount said storage in a similar way. The first iteration of this would bypass authentication but demonstrate a proof of concept for launching user containers, e.g. CARTA, with access to data on RSE disk.

Show
Previously we have demoed the datalake as a service; a JupyterHub instance capable of reading data directly from RSE-managed storage. The simplest case of CANFAR science platform reading data in-place from data lake storage would be to mount said storage in a similar way. The first iteration of this would bypass authentication but demonstrate a proof of concept for launching user containers, e.g. CARTA, with access to data on RSE disk.
Acceptance criteria:

Hide

AC1: CANFAR deployment at one of the RSE sites

AC2: RSE storage mounted in user containers

AC3: Demo of launching CARTA or other application in container with access to RSE storage.

Show
AC1 : CANFAR deployment at one of the RSE sites AC2 : RSE storage mounted in user containers AC3 : Demo of launching CARTA or other application in container with access to RSE storage.
Feature Points:
1.5
Initial Size:
1.5
WSJF:
0
Epic Link:
SRC science analysis platform
Agile Teams:

Team_MAGENTA
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

Documentation: https://confluence.skatelescope.org/display/SRCSC/SP-3729+CANFAR+Science+Platform+with+RSE+Storage+attached

Demo: https://confluence.skatelescope.org/display/SRCSC/2023-11-23+SRC+ART+System+Demo+20.6+Part+1+PM

Instance running at: https://canfar.srcdev.skao.int/skaha

Show
Documentation: https://confluence.skatelescope.org/display/SRCSC/SP-3729+CANFAR+Science+Platform+with+RSE+Storage+attached Demo: https://confluence.skatelescope.org/display/SRCSC/2023-11-23+SRC+ART+System+Demo+20.6+Part+1+PM Instance running at: https://canfar.srcdev.skao.int/skaha
Resolved PI.Sprint:
21.4

Feature Checklist:

Stories Completed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

Requirement Status:

PI24 - UNCOVERED
Labels_MIRO:
PI20-PB Team_Magenta

Description

Analogous to the Datalake-as-a-service principle which allowed read-access to Rucio Storage Element data. Given that the DataLink response can provide a PFN to a file on disk, if a CANFAR platform could be deployed at a site hosting a RSE, it would be possible to attach the RSE volume to the spawned containers.

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

Structure

Activity

People

Assignee:: Bolton, Rosie

Reporter:: Collinson, James

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 1.5

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	6	13.0
Total	6	13.0

Dates

Created:: 18/Aug/23 2:47 PM

Updated:: Yesterday 6:38 AM

Resolved:: 29/Jan/24 11:13 AM

Due Sprint Date:: 21/Nov/23

CANFAR science platform with RSE data attached