SRC workflow example: deployment of processMeerKAT pipeline

Integrating the ProcessMeerKAT pipeline into the SRCNet workflow repository will give us the opportunity to test/study how to fulfill different requirements. In particular this workflow:

• requires a different computing environment (SLURM )
• is designed to deal with big datasets and it will produce high workloads

This feature will also produce documentation on how to adapt the pipeline to SRCNet computing infrastructures, ensuring compatibility and accessibility for several SRCNet infrastructures.

By achieving this integration, the SRCNet workflow repository will be enhanced with a powerful pipeline for MeerKAT data processing, facilitating collaborative research and detecting the necessities  of the computing infrastructures within the SRCNet community.

AC1: Successful Deployment of ProcessMeerKAT Workflow able to analyse big datasets: The SRC workflow example involving the deployment of the ProcessMeerKAT pipeline must be successfully implemented within the SRCNet environment in at least one SRC with access to the data. Verification: it will involve confirmation of a scientific team that the ProcessMeerKAT workflow has been deployed, executed, and completed successfully within the SRCNet environment. This will include evidence of calibrated and imaged MeerKAT data.

AC2: SRCNet repository with a new entry gathering the ProcessMeerKAT Workflow, including all the element (documentation, input data and parameters) to be executed and produce a high workload. Verification: a Demo

AC3:  Documentation on how to deploy the pipeline:  documentation must be created detailing the deployment of the ProcessMeerKAT pipeline, including step-by-step instructions, configuration settings, and any computing dependencies. Verification: a wiki document