Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3925

Mapping MSND computing environments to workflows in the SRCNet repository 

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      By mapping MSND computing environments to workflows in the SRCNet repository, we aim to provide a more versatile and comprehensive computing experience for users on the OpenCADC science platform. This will enable users to seamlessly execute a wider range of workflows, applications, or services on containers, improving efficiency and accommodating several scientific requirements.

      Show
      By mapping MSND computing environments to workflows in the SRCNet repository, we aim to provide a more versatile and comprehensive computing experience for users on the OpenCADC science platform. This will enable users to seamlessly execute a wider range of workflows, applications, or services on containers, improving efficiency and accommodating several scientific requirements.
    • Hide

      AC1: Compatibility Assessment: The mapping process should comprehensively analyse the SRCNet workflow repository, precursor/pathfinder pipelines (with a special focus on Apertif pipelines by SWE team), and Olive's workflow categorisation. Verification: A wiki and demo detailing the analysis results, highlighting the identified computing environments required for different workflows, should be generated and reviewed having this mapping workflows & computing environments ready.

      AC2: Demos: Demo of at least 2 of those mappings, using a SRCNet/precursor/pathfinder workflow and a computing environment supported by the OpenCADC science platform

      AC3: Identification of Missing Environments: The analysis should clearly identify any computing environments that are not currently supported by the OpenCADC/CANFAR platform. Verification: A wiki document list of missing computing environments, along with a brief explanation of their significance in SRCNet workflows, should be provided for review.

      Show
      AC1:  Compatibility Assessment: The mapping process should comprehensively analyse the SRCNet workflow repository, precursor/pathfinder pipelines (with a special focus on Apertif pipelines by SWE team), and Olive's workflow categorisation. Verification: A wiki and demo detailing the analysis results, highlighting the identified computing environments required for different workflows, should be generated and reviewed having this mapping workflows & computing environments ready. AC2: Demos : Demo of at least 2 of those mappings, using a SRCNet/precursor/pathfinder workflow and a computing environment supported by the OpenCADC science platform AC3: Identification of Missing Environments: The analysis should clearly identify any computing environments that are not currently supported by the OpenCADC/CANFAR platform. Verification: A wiki document list of missing computing environments, along with a brief explanation of their significance in SRCNet workflows, should be provided for review.
    • Intra Program
    • 2
    • 2
    • 0
    • Team_CORAL
    • Sprint 5
    • Show
      Docs:  https://confluence.skatelescope.org/display/SRCSC/Mapping+MSDN Demo in PI22.2: https://confluence.skatelescope.org/pages/viewpage.action?pageId=265846039 Slides: https://docs.google.com/presentation/d/1HtvlFErgAc_I8kTnxW2aErFTpjU5kxrczyyDE-xwcmc/edit?usp=sharing
    • 24.3
    • Stories Completed, Outcomes Reviewed
    • PI24 - UNCOVERED

    • PI21-PB Science_Platform

    Description

      In PI20 the OpenCADC science platform (based on CANFAR) has been deployed on some of the sites of the MSND. This platform allows users to create and access a computing environment where they can execute their codes.  The computing environment is defined by “type” (this is either notebook, desktop, CARTA session ( the visualisation tool) or contributed) and the “container image” (this is a list of containers that can be used).

      Are these types of computing environments enough to cover the different workflows that are expected to be executed on the SRCNet? Which computing environments are missing? What is the effort to add those environments to a science platform such as OpenCADC/CANFAR ?

      Looking at 1) the SRCNet workflow repository 2) precursor/pathfinder pipeline ( special interest on Apertif pipelines by SWE team) and at 3) the workflow categorisation by Olive, we can have an idea of the different computing environment required to run those different workflows. Can all of them be instantiated by the OpenCADC/CANFAR platform?.

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                M.Parra Parra, Manuel
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete614.0
                  Total614.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel