Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Not Assigned
Fix Version/s: PI6
Component/s: COM SDP SW
Labels:
- OPS-SCI
- Team_SIM
- demo_6.5
- goal_D1
- goal_S2
- goal_S3

ARTs:

Data Processing
Benefit hypothesis:
Hide

Implementing a scientific workflow in the SDP MVP, even on a small scale, will help us to elucidate the interfaces that are needed, such as:

Describing workflow parameters in a standard form (for future UIs) and parsing them;

Deploying execution engines and running workflow stages on them;

Reading and writing data from/to buffer reservations.

This will in turn inform the design of the workflow library.
Show
Implementing a scientific workflow in the SDP MVP, even on a small scale, will help us to elucidate the interfaces that are needed, such as: Describing workflow parameters in a standard form (for future UIs) and parsing them; Deploying execution engines and running workflow stages on them; Reading and writing data from/to buffer reservations. This will in turn inform the design of the workflow library.
Acceptance criteria:

Hide

A calibration and imaging workflow that is capable of being executed as a batch processing block in the SDP MVP.

Show
A calibration and imaging workflow that is capable of being executed as a batch processing block in the SDP MVP.
Feature Points:
3
Initial Size:
3
WSJF:
2.333
Epic Link:
SDP Prototype
Agile Teams:

Team_SIM
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

A new SDP workflow called "batch_imaging" has been implemented. It integrates RASCIL simulation and ICAL pipelines with the SDP protototype: https://developer.skatelescope.org/projects/sdp-prototype/en/latest/workflows/batch_imaging.html

Show
A new SDP workflow called "batch_imaging" has been implemented. It integrates RASCIL simulation and ICAL pipelines with the SDP protototype: https://developer.skatelescope.org/projects/sdp-prototype/en/latest/workflows/batch_imaging.html
Resolved PI.Sprint:
6.6

Requirement Status:

PI22 - UNCOVERED

Description

Implement a proof-of-concept batch workflow to calibrate and image visibility data in the SDP MVP. It should use existing code as far as possible, for example RASCIL with Dask as an execution engine.

The workflow parameters should be read from the processing block, and the data should be read from and written to buffer reservations (which may be mocked-up at this stage).

Attachments

Issue Links

relates to

SP-909 Enhance and automate the GPU Imaging/Gain Calibration Pipeline for end users

Done

SP-911 Further the adaption of GPU Imaging/Gain Calibration Pipeline as an SDP Workflow

Done

SP-839 SDP workflow library PoC

Discarded

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(8 mentioned in)

Structure

Activity

People

Assignee:: Mort, Ben

Reporter:: Ashdown, Mark

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 3.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	6	6.0
Total	6	6.0

Dates

Created:: 12/Feb/20 1:25 PM

Updated:: 22/Aug/22 10:07 PM

Resolved:: 26/May/20 7:46 AM

Implement a proof-of-concept batch workflow in the SDP MVP