Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Enabler
Priority: Not Assigned
Fix Version/s: PI6, PI7
Component/s: None
Labels:
- OPS-SRC
- Team_ESCAPEES

ARTs:

Data Processing
Benefit hypothesis:

Hide

A containerised simulation pipeline should allow SDC2 simulations run by the SKA science team to be more easily run on proto-SRC resources avoiding difficulties of package management. Creating the simulation cube at proto-SRCs will avoid the need for transporting large cubes.

A PoC demonstrating this approach to the SKA science team is needed to be able to gather feedback to establish if this model would also be suitable to provide as an option for teams wanting to run science data challenge analysis scripts on proto-SRC resources.

This PoC should also be able to provide a use case for analysing the suitability of this approach to build upon as the basis of a prototype of an SR science analysis platform.

The Science team will gain familiarity with the process of containerising applications, and using containers.

Show
A containerised simulation pipeline should allow SDC2 simulations run by the SKA science team to be more easily run on proto-SRC resources avoiding difficulties of package management. Creating the simulation cube at proto-SRCs will avoid the need for transporting large cubes. A PoC demonstrating this approach to the SKA science team is needed to be able to gather feedback to establish if this model would also be suitable to provide as an option for teams wanting to run science data challenge analysis scripts on proto-SRC resources. This PoC should also be able to provide a use case for analysing the suitability of this approach to build upon as the basis of a prototype of an SR science analysis platform. The Science team will gain familiarity with the process of containerising applications, and using containers.
Acceptance criteria:
Hide

Docker image for running the SDC2 simulation pipeline

Demonstration of this PoC to the SKA science team to gather feedback to establish roadmap for how to help with running future SDCs.

Stretch: Jupyter notebook interface for the containerised simulation pipeline
Show
Docker image for running the SDC2 simulation pipeline Demonstration of this PoC to the SKA science team to gather feedback to establish roadmap for how to help with running future SDCs. Stretch: Jupyter notebook interface for the containerised simulation pipeline
Feature Points:
2
Initial Size:
3
WSJF:
5
Epic Link:
SRC Prototyping
Agile Teams:

Team_ESCAPEES
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

https://confluence.skatelescope.org/display/SE/ESCAP-110+Packaged+SDC2+sim+pipeline

Gitlab: https://gitlab.com/ska-telescope/sdc/sdc2-sim-environment

Show
https://confluence.skatelescope.org/display/SE/ESCAP-110+Packaged+SDC2+sim+pipeline Gitlab: https://gitlab.com/ska-telescope/sdc/sdc2-sim-environment
Resolved PI.Sprint:
8.3

Feature Checklist:

Demonstrated, Satisfies Acceptance Criteria

Requirement Status:

PI22 - UNCOVERED

Description

Key stakeholders: SKA Science team

Containerised setup for running the simulation pipeline and generating the SDC2 datasets.

Knowledge share with the Science team the process of containerising an application and creating/running docker images

The result of this work should be demoed to the SKA science team.

Stretch : Containerised notebook interface for running the simulation scripts used by the science team for generating the SDC2 data sets. This notebook should be executable through a jupyterhub deployment on IRIS (or equivalent).

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(1 mentioned in)

Structure

Activity

People

Assignee:: Hartley, Philippa

Reporter:: Mort, Ben

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 2.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	5	11.0
Total	5	11.0

Dates

Created:: 14/Feb/20 2:38 PM

Updated:: 15/Jul/22 12:12 PM

Resolved:: 13/Oct/20 10:17 AM

Containerised SDC2 simulation pipeline demonstrated as PoC for future SRC (&SDC) analysis platform