Details
-
Epic
-
None
-
None
-
None
-
Processing Component Library
-
Data Processing
-
0
Description
Start development towards the SKA Processing Components library. This activity will be used to gain the experience and expertise required to implement a library of reusable components with well defined functional interfaces that provide the low-level building blocks needed to develop high-performance, high-throughput Execution Engine workflow processing stages.
Once developed, this is will be tested and integrated as part of the regular development of the Data Processing MVP (SP-595) and associated Feature Sets (eg SP-604, SP-606, and SP-608).
Epic Hypothesis Statement (https://www.scaledagileframework.com/epic/)
| For | execution engine and processing component developers |
| who | develop highly performant distributed pipelines |
| the | Processing Component Library |
| is a | scientific function library with a clearly defined performance-oriented interface |
| that | allows both bulk data and meta-data to be exchanged between execution engines and processing components |
| Unlike | data exchange via file systems, such as using measurement sets, or software tightly coupling execution engine to processing component implementation (e.g. MPI) |
| our solution============== | should have minimal data transfer overhead (minimal copying), support many relevant languages and environments for execution engine and processing component development (especially concerning future emerging technologies) |
| Outcome hypothesis | |
| Leading Indicators | |
| NFRs |
Attachments
Issue Links
- Child Of
-
SS-5
Evolutionary Prototype/SKAMPI
-
- Done
-