Test the EMUcat pipeline, using Nextflow and slurm

This workflow uses the Nextflow workload management language. This is one of many potential languages we could use to make complex processing pipelines easier to manage and use. Understanding the pros and cons of this will be important from the perspective of SRC functionality and user facing systems. Ask Dave Pallot for details.

AC1: Prepare computing resources/Slurm cluster to run the pipeline:   https://confluence.skatelescope.org/pages/viewpage.action?pageId=252396484 Nextflow deployment: https://confluence.skatelescope.org/display/SRCSC/COR-507+%5BEMUCAT%5D+Deploy+Nextflow+on+the+Spanish+platform Test the pipeline: https://confluence.skatelescope.org/display/SRCSC/COR-525++%5BEMUcat%5D+Test+the+Pipeline Slides and demo: https://confluence.skatelescope.org/display/SRCSC/2024-02-22+SRC+ART+System+Demo+21.6+Part+1+AM https://docs.google.com/presentation/d/1pAa0uWFIVv6mz82S9w-gvBvb9V7IptckARENbWTjlCg/edit?usp=sharing Repo:  https://gitlab.com/DrWhatson/emucat   AC2:  Test the pipeline: https://confluence.skatelescope.org/display/SRCSC/COR-525++%5BEMUcat%5D+Test+the+Pipeline Slides and demo: https://confluence.skatelescope.org/display/SRCSC/2024-02-22+SRC+ART+System+Demo+21.6+Part+1+AM https://docs.google.com/presentation/d/1pAa0uWFIVv6mz82S9w-gvBvb9V7IptckARENbWTjlCg/edit?usp=sharing