Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4493

Investigate when and where the two-level container issue will (may) impact SRCNet

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      Software packaging in container is a solution to deploy/execute software in a network of heterogeneous computing environment like the SRCNet. Science platforms such as CANFAR use this approach to facilitate the execution of scientific software.

      By better understanding the “two-level container” problem (the problem that it is not possible to run a container inside another container) we can make informed decisions regarding the design and implementation of SRCNet software.

      (Eventually) solving the “two-level container” problem should facilitate the execution of widely used pipelines on SRCNet.

      Show
      Software packaging in container is a solution to deploy/execute software in a network of heterogeneous computing environment like the SRCNet. Science platforms such as CANFAR use this approach to facilitate the execution of scientific software. By better understanding the “two-level container” problem (the problem that it is not possible to run a container inside another container) we can make informed decisions regarding the design and implementation of SRCNet software. (Eventually) solving the “two-level container” problem should facilitate the execution of widely used pipelines on SRCNet.
    • Hide

      AC1: A documentation page describing the problem with specific context where SRCNet is/shall encounter this issue given the current software stack and/or architectural design. Include all outcomes of the spike.

      AC2: Demo describing the problem and any potential solutions discovered as part of the investigation.

      AC3 (stretch): Include in the demo a pipeline demonstrating or solving the two-level container problem. (This may be based on container execution deployed on CANFAR).

      Show
      AC1: A documentation page describing the problem with specific context where SRCNet is/shall encounter this issue given the current software stack and/or architectural design. Include all outcomes of the spike. AC2 : Demo describing the problem and any potential solutions discovered as part of the investigation. AC3 (stretch) : Include in the demo a pipeline demonstrating or solving the two-level container problem. (This may be based on container execution deployed on CANFAR).
    • 1
    • 1
    • 0
    • Team_CORAL
    • Sprint 4
    • PI24-PB SRCNet0.x

    Description

      There exist pipelines to process radio data that are managed by workflow systems (e.g., CGAT, Snakemake, etc.), and each pipeline step is based on container execution (e.g., Stimela/Caracal for processing data from MeerKAT, Aperitif pipeline).

      If we package those pipelines as containers to facilitate their deployment and execution in different computing environments, we will encounter the problem that it is not possible to run a container inside another container.

      This problem has been shown in these demos:

      Also it was commented in this demo:

       

      This feature will be focus on analyzing this “two-level container” problem and explore (potential) solutions, including those that may have been implemented by other communities

       

      Attachments

        Issue Links

          mentioned in

          Page Loading...

          Structure

            Activity

              People

                b.mort Mort, Ben
                S.SanchezExposito Sanchez Exposito, Susana
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   13.0
                  Complete00.0
                  Total13.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel