Release batch pre-processing pipeline

Pre-processing is expected to include application of current/known calibration, flagging, de-mixing and averaging as needed as the first stage of the batch processing in SDP. Building out and testing the functionality at scale will be required to fully establish all necessary processing for both telescopes in time for AA2, as such early development of this pipeline with consideration for scaling to AA2 will ensure sufficient lead time.

1. Enabling use of AOflagger (or equivalent) for distributed flagging within the pipeline and testing
2. Enabling de-mixing capability within the pipeline (see link in references for further information of existing use of demixing) and testing
3. Release of the pre-processing pipeline
4. including functionality agreed for PI24 (see diagram - this should be updated after discussion during planning)
5. suitable test data set and parameters (simulated and/or real-world)

1. Documentation improvements to give more information about how the pipeline can be run and what data can be used to test on what platforms