Details
-
Component Version
-
Resolution: Resolved
-
None
-
Data Processing
-
Team_HIPPO
-
SDP batch pre-processing pipeline
-
2.2.0
-
MINOR
-
2.2.0 Latest
-
Sprint 4
-
-
-
Description
Summary
Added option to use dask distribution.
Added
- Ability to distribute over multiple dask workers, where one input MS corresponds to one task. CLI app now accepts an optional `--dask-scheduler` argument followed by the network address of the scheduler to use.
Changed
- None
Deprecated
- None
Removed
- None
Fixed
- None
Test Evidence
- <TBD>
Security
- None
Attachments
Issue Links
- relates to
-
SP-4962 Pre-processing for end-to-end Low imaging test
-
- Implementing
-
- links to
- mentioned on
Type | Key | Summary | Status | Assignee | ARTs | Agile Teams | FPs | P | FixVersion | Due Sprint | |
---|---|---|---|---|---|---|---|---|---|---|---|
|
SP-4962 | Implementing | Fenech, Danielle |
Data Processing
|
Team_HIPPO, Team_SCOOP
|
13 | PI25 | Sprint 5 |