Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Must have
Fix Version/s: PI20
Component/s: None
Labels:
- PI20-PB
- Team_BL

ARTs:

SRCnet
Benefit hypothesis:

Hide

Gives people an idea what components are necessary to produce and maintain a radio survey. Components include: data extraction techniques, component storage, multi-wavelength xmatching, tagging, release strategies etc and what challenges are faced scaling it up to SKA level.

Show
Gives people an idea what components are necessary to produce and maintain a radio survey. Components include: data extraction techniques, component storage, multi-wavelength xmatching, tagging, release strategies etc and what challenges are faced scaling it up to SKA level.
Acceptance criteria:

Hide

1) Produce confluence document describing EMUCat pipeline, associated services and challenges scaling up to SKA level.

2) The 'cut back' workflow (public components) will be available from the SRCNet workflows repository. The full versions will be linked (run from ASKAP/AUSRC public repo).

Show
1) Produce confluence document describing EMUCat pipeline, associated services and challenges scaling up to SKA level. 2) The 'cut back' workflow (public components) will be available from the SRCNet workflows repository. The full versions will be linked (run from ASKAP/AUSRC public repo).
Feature Points:
1
Initial Size:
1
WSJF:
0
Epic Link:
Collation of Runnable Example Workflows
Agile Teams:

Team_LAVENDER
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

https://confluence.skatelescope.org/pages/viewpage.action?pageId=245597304

Merge Request here: https://gitlab.com/ska-telescope/src/src-workloads/-/merge_requests/6

Show
https://confluence.skatelescope.org/pages/viewpage.action?pageId=245597304 Merge Request here: https://gitlab.com/ska-telescope/src/src-workloads/-/merge_requests/6
Resolved PI.Sprint:
21.4

Feature Checklist:

Outcomes Reviewed

Requirement Status:

PI23 - UNCOVERED
Labels_MIRO:
PI20-PB Team_BL

Description

The EMUCat Survey pipeline uses a technical platform which is in place. It uses Nextflow. The components and how they are put together is described in: https://confluence.skatelescope.org/display/SRCSC/BLU-37+-+Summarise+the+AusSRC+precursor+data+processing+pipeline+experience

There is some public data which can be put into an SRCnet repo.

Some parts of the pipeline are proprietary (such as extended source aspects) and will be left out.

Doing this work will give people an idea what components are necessary to produce and maintain a radio survey. Components include: data extraction techniques, catalog storage and schemas, multi-wavelength xmatching, tagging, release strategies, IVOA services etc.

Requirements:

A SLURM HPC cluster with Nextflow and Singularity modules

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...

mentioned on

Commit - Merge branch 'master' into 'master'

Merge request - SP-3594: Add cutback version of EMUCat pipeline

(1 mentioned on)

Structure

Activity

People

Assignee:: Clarke, Alex

Reporter:: Pallot, Dave

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (0%)

Feature Estimate: 1.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	0	0.0
Total	0	0.0

Dates

Created:: 13/Jul/23 5:24 AM

Updated:: 13/Feb/24 2:02 PM

Resolved:: 30/Jan/24 11:57 AM

Document ASKAP EMUCat Survey pipeline and associated services.