Details
-
Enabler
-
Must have
-
None
-
Data Processing
-
-
-
Intra Program
-
3
-
3
-
0
-
Team_HIPPO
-
Sprint 3
-
-
-
-
18.2
-
Stories Completed, Integrated, Solution Intent Updated, BDD Testing Passes (no errors), Outcomes Reviewed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
-
-
SPO-1784
Description
Who?
- SDP workflow developers
What? (outcomes)
- Set of well defined and documented data models (structures) for use with SDP Processing Function Library (PFL) methods for Self-calibration and Fast Imaging workflows.
Why?
- Processing Function Library (PFL) methods need clean portable interfaces but in order to build workflows
- This will also enable definition of higher-level data structures to manage data in workflows, as well as de/serialisation from/to storage.
Other considerations:
- Future proofing - can the chosen data models represent everything we will want to pass between processing functions?
- Dependency on existing PFL and related developments and development of initial Self-cal and fast imaging workflows
- Consideration for C, C++ and Python bindings. Try to keep within general meta-"data model" of primitives, tensors (i.e. arrays) and possibly later tables.
- Consideration for use with existing workflows and data reduction packages & applications
- Consideration to load / save (deserialise/serialise) to storage/disk (possibly also important for testing)
References
- Processing Functions Data Models Miro board: https://miro.com/app/board/uXjVODxOIyc=/?share_link_id=73527994687