SRC workflow example: Image cutouts

SRCs will provide pre-built scripts for standard workflows that users expect to run. We aim to implement some of these, and test their effectiveness with regards to hardware limitations and data storage schemes. 

This particular workflow looks at providing the user with lots of small cut outs of individual sources based on an input list of RA/DEC location. To start off with, a single image is in one location, which is then extended to searching multiple images in the same location.

In the future, this will be developed into a more expansive test where thousands of images can be distributed across storage systems, and this workflow can search all of them for the users requested sources, and return cut outs of them to a single location for the user.

AC1: Have a containerised script that downloads a LOFAR LOTSS image, then gets cut-outs images of individual sources based on a users list of RA/DEC positions and size.

AC2: Extend this script to download multiple LOFAR LOTSS images and search through them in the same storage location to get cut-outs. e.g. checking fits header information on accessible images.

(not done) Stretch AC3: Upload a handful of LOFAR LOTSS images (that overlap with SDSS and other relevant multi-wavelength data) to a single Rucio RSE.

(not done) Stretch AC4: Enable the script to download data from Rucio instead of the LOFAR archive.

(not done) Stretch AC5: Obtain cut-outs from a distributed survey data set and return those cut-outs to a single location for the user.

Demo presented on the System Demo 19.4 part I (27th July). 

Slides: https://docs.google.com/presentation/d/159tl5ZOG3DLq4s74-PgsDzZpYxxRa7I3fUzmuL4Ez78/edit?usp=sharing

Recording: https://confluence.skatelescope.org/display/SRCSC/2023-07-27+SRC+ART+System+Demo+19.4+Part+1

Outcomes: 

Repository: https://gitlab.com/ska-telescope/src/src-workloads