Enable batch instrumental calibration processing

Instrumental calibration is required to calculate and provide calibration solutions for processing the data through SDP. As these represent fundamental calibration required for all further data processing, these are likely to be amongst the first required for testing within the SDP and wider system. The expectation is that this will be tested by commissioning scientists alongside current solutions to ensure we have confidence in the software and can feedback understanding as quickly as possible. As such early development of this functionality with consideration for scaling to AA2 will ensure sufficient time for development and its availability for testing during commissioning.

The expected stages are outlined in the diagram, though this should be discussed and updated to reflect the planned scope. This will potentially necessitate development of the interface to the bandpass solver.

• Release and demonstration of instrumental calibration pipeline with documentation including a suitable test data set (simulated and/or real-world) for both Mid and Low
• Must be parallelised across >1 nodes
• Some further work may be required to understand the use cases needed (what input data, how this will be done for zoom modes).

Previous work looking at requirements and processing for other instrumental calibration has been captured in pages in Solution Intent (https://confluence.skatelescope.org/display/SWSI/Requirements+and+design+of+SDP+pipelines). This work should also consider cover any similar work for other stages of calibration not already complete as well as a prioritisation of inclusion of those stages into the instrumental calibration pipeline in future development.

See What on Feature frame on DP ART board: https://miro.com/app/board/uXjVK6Lrdw4=/?moveToWidget=3458764597704714308&cot=14