Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Could have
Fix Version/s: PI22
Component/s: None
Labels:
- software-sharing

ARTs:

SRCnet
Benefit hypothesis:

Hide

The benefit of this work is to investigate (and demonstrate) the potential integration of EESSI's CVMFS-based software distribution in Kubernetes, thereby testing whether CVMF-based software distribution can be suitable for a variety of compute environments (HPC, Cloud/VM and Kubernetes) and platforms/applications (CANFAR, JupyterHub).

Show
The benefit of this work is to investigate (and demonstrate) the potential integration of EESSI's CVMFS-based software distribution in Kubernetes, thereby testing whether CVMF-based software distribution can be suitable for a variety of compute environments (HPC, Cloud/VM and Kubernetes) and platforms/applications (CANFAR, JupyterHub).
Acceptance criteria:

Hide

AC 1: Documentation on how the software from the proof of concept could be exposed to a Kubernetes instance, and thereby CANFAR and other applications hosted on Kubernetes

AC 2: If applicable a demo of the implementation.

Show
AC 1: Documentation on how the software from the proof of concept could be exposed to a Kubernetes instance, and thereby CANFAR and other applications hosted on Kubernetes AC 2: If applicable a demo of the implementation.
Agile Teams:

Team_TANGERINE
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

The tests of integrating CVMFS and EESSI into Kubernetes applications were successful. We've shown that an analysis with EESSI software (distributed via CVMFS) can be run in a Jupyter Notebook running on CANFAR/Kubernetes.

AC1: The documentation of our work can be found here: https://confluence.skatelescope.org/display/SRCSC/%5BSP-4185%5D+Investigate+the+integration+of+the+EESSI+CVMFS-based+PoC+in+Kubernetes

AC 2: The demo can be found here: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846031

Show
The tests of integrating CVMFS and EESSI into Kubernetes applications were successful. We've shown that an analysis with EESSI software (distributed via CVMFS) can be run in a Jupyter Notebook running on CANFAR/Kubernetes. AC1: The documentation of our work can be found here: https://confluence.skatelescope.org/display/SRCSC/%5BSP-4185%5D+Investigate+the+integration+of+the+EESSI+CVMFS-based+PoC+in+Kubernetes AC 2: The demo can be found here: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846031
Resolved PI.Sprint:
22.5

Feature Checklist:

Stories Completed, Outcomes Reviewed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

Requirement Status:

PI23 - UNCOVERED
Labels_MIRO:
software-sharing

Description

Until now, we have been testing software distribution with CVMFS on HPC systems. We want to ensure that this method of software distribution can work well in a variety of contexts, in particular Kubernetes, so the software can be used within, for example CANFAR workspaces and JupyterHub.

The goal of this feature is to test whether we can provide access to CVMFS on Kubernetes/CANFAR in two ways:

1) by integrating CVMFS into Kubernetes using a storage driver developed by CERN or installing a CVMFS client on the Kubernetes nodes;

2) by building a CVMFS client into a container.

The former option would be most ideal in a production Kubernetes environment, the latter would be a way to provide a consistent software environment for developers and researchers on different platforms, from their laptops to cloud and HPC systems.

If one or both of these integrations are successful, we will conduct a test analysis with the software provided on CVMFS.

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...

Structure

Activity

People

Assignee:: Bolton, Rosie

Reporter:: Grange, Yan

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 0.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	5	5.0
Total	5	5.0

Dates

Created:: 27/Feb/24 3:48 PM

Updated:: 16/May/24 4:26 PM

Resolved:: 16/May/24 4:26 PM

Investigate integration of the EESSI CVMFS-based PoC in Kubernetes/CANFAR