Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Must have
Fix Version/s: PI21
Component/s: None
Labels:
- PI21-PB

ARTs:

SRCnet
Benefit hypothesis:

Hide

This demonstrates how data can be accessed at regional centre sites, and processing can be done on them at the sites where the data is located.

This is a stepping stone towards distributed data storage and compute.

Show
This demonstrates how data can be accessed at regional centre sites, and processing can be done on them at the sites where the data is located. This is a stepping stone towards distributed data storage and compute.
Acceptance criteria:

Hide

AC1: A significant astronomical dataset is stored at at least one regional centre site: LoTSS LOFAR mosaics.

AC2: A data processing task is run at that site on the data: e.g. PYBDSF, image cutouts.

Show
AC1: A significant astronomical dataset is stored at at least one regional centre site: LoTSS LOFAR mosaics. AC2: A data processing task is run at that site on the data: e.g. PYBDSF, image cutouts.
Feature Points:
1.5
Initial Size:
1.5
WSJF:
0
Epic Link:
Collation of Runnable Example Workflows
Agile Teams:

Team_MAGENTA
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

Example notebook: https://gitlab.com/ska-telescope/src/src-workloads/-/blob/master/tasks/source-finding-pybdsf/jupyter/scripts/pybdsf-sf-with-rucio.ipynb?ref_type=heads

Demoed: https://confluence.skatelescope.org/display/SRCSC/2024-02-15+SRC+ART+System+Demo+21.5+Part+2+PM

Show
Example notebook: https://gitlab.com/ska-telescope/src/src-workloads/-/blob/master/tasks/source-finding-pybdsf/jupyter/scripts/pybdsf-sf-with-rucio.ipynb?ref_type=heads Demoed: https://confluence.skatelescope.org/display/SRCSC/2024-02-15+SRC+ART+System+Demo+21.5+Part+2+PM
Resolved PI.Sprint:
21.6

Feature Checklist:

Stories Completed, Outcomes Reviewed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

Requirement Status:

PI24 - UNCOVERED
Labels_MIRO:
PI21-PB

Description

Upload at least 10 LoTSS mosaics (5-10 degrees across) to Rucio, and run at least one task using this data.

Source finding using PYBDSF is an obvious one.

Image convolution task could be used to change the resolution of the images.

Cutouts could be made for thousands of sources from multiple mosaics.

Mosaicking could be done but would be a bit irrelevant since the LoTSS images are already mosaicked into large fields. To use the mosaicking task we would need to store the original LoTSS pointings (LOFAR FWHM of ~3 degrees) in Rucio and mosaic them.

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(1 mentioned in)

Structure

Activity

People

Assignee:: Bolton, Rosie

Reporter:: Clarke, Alex

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 1.5

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	11	12.0
Total	11	12.0

Dates

Created:: 15/Nov/23 12:09 PM

Updated:: 15/Apr/24 9:35 AM

Resolved:: 26/Feb/24 11:14 AM

Run a task at an SRC site using data stored in Rucio