Pick a workflow and a workflow engine, and API that can be used to execute the pipeline that we want to use for demonstration

The science platform will need to be able to run pipelines (ideally SDP-like workflows). Therefore workflow engines suited to these tasks will be a part of the eventual science platform stack. The benefit of this feature is to take a first step towards running such a pipeline on SRC resources, and building an understanding of the API such a component should have. What the engine and workflow are depends on the results of the earlier spike.

AC1: Workflow identified and inputs/outputs/requirements documented on Confluence/similar

We have developed a NextFlow workflow using a CASA pipeline to create a spectral-index map from a VLA measurement set.

The NextFlow script is stored in git at https://gitlab.com/srcnet-tangerine/nextflow-prototyping/nextflow-scripts/.

The CASA scripts are stored in git at https://gitlab.com/srcnet-tangerine/nextflow-prototyping/casa-scripts/.

The web page that runs the scripts is stored in git at https://gitlab.com/srcnet-tangerine/web-prototyping/.

AC2: API described for selected workflow engine

There is no API for running NextFlow. Instead, we have described the process for running a workflow from a webpage at https://confluence.skatelescope.org/display/SRCSC/Running+NextFlow+scripts+from+a+web+page.

AC3: Demo of workflow running on SRC resources

The whole prototype was demo'd on 18th May.