Loading...

Xporter

XML

Word

Printable

Details

Type: Enabler
Priority: Should have
Fix Version/s: PI13
Component/s: COM SDP SW
Labels:
None

ARTs:

Data Processing
Benefit hypothesis:

Hide

The end goal of the SDP processing function and pipeline development is to create end-to-end pipelines for SKA.

To drive this development we need to identify sets of functions we will need to build to put together these pipelines.

This was started in PI12 with mapping of LOFAR and RASCIL codes to processing functions.

We now need to take this information to identify the list of functions and data structures we will need to build SKA pipelines.

Show
The end goal of the SDP processing function and pipeline development is to create end-to-end pipelines for SKA. To drive this development we need to identify sets of functions we will need to build to put together these pipelines. This was started in PI12 with mapping of LOFAR and RASCIL codes to processing functions. We now need to take this information to identify the list of functions and data structures we will need to build SKA pipelines.
Acceptance criteria:
Hide

Map out a set of processing functions we will need to develop to build a SKA solution for one or more imaging pipelines.

Stretch: Identify and implement reference pipelines that can be used to test against when writing a new pipeline out of processing function
Show
Map out a set of processing functions we will need to develop to build a SKA solution for one or more imaging pipelines. Stretch: Identify and implement reference pipelines that can be used to test against when writing a new pipeline out of processing function
Feature Points:
2
Initial Size:
2
Cost of Delay:
5
WSJF:
2.5
Epic Link:
SDP Initial workflows
Agile Teams:

Team_ORCA, Team_SCHAAP
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:

Hide

We have made a side-by-side comparison of the deconvolution step in the RASCIL and WSClean pipelines to find the common structure, processing functions and data models. The was based on detailed analyses of RASCIL and WSClean.

We have also performed a detailed analysis of the predict step in the RASCIL pipeline.

Show
We have made a side-by-side comparison of the deconvolution step in the RASCIL and WSClean pipelines to find the common structure, processing functions and data models. The was based on detailed analyses of RASCIL and WSClean . We have also performed a detailed analysis of the predict step in the RASCIL pipeline .
Resolved PI.Sprint:
17.5

Feature Checklist:

Stories Completed, Accepted by FO

Demos:
- DP_ART_13.5
Requirement Status:

PI22 - UNCOVERED
Goals_MIRO:
SPO-1454

Description

Use this ticket to drive processing function library development - could pivot the direction of the other Processing Function library tickets (which are nominally placeholders).

Architectural qualities to consider:

Ability to recombine processing functions in different ways for different pipelines
Scalability
Maintainability

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(10 mentioned in)

Structure

Activity

People

Assignee:: Nikolic, Bojan

Reporter:: Mort, Ben

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 2.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	9	11.5
Total	9	11.5

Dates

Created:: 24/Nov/21 12:08 PM

Updated:: 15/Apr/24 9:45 AM

Resolved:: 09/Feb/23 3:15 PM

Iterate design of processing function library following pipeline processing function mapping