Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3544

CANFAR Science Platform Portability

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide
      • The CANFAR Science Platform will be easily deployable on a kubernetes installation next to their SRC data storage, thus removing the need to move data to perform analysis, but instead using the CANFAR Science Platform to deploy and run scientific containers next to the data.
      • The improvements to the CANFAR Science Platform deployment model will result in a better software product that will allow for changes, feature additions, extensions, and plug-ins to be made more rapidly, benefiting the SRCNet prototyping effort.
      • This will allow other containerized applications to be added, for example, VisIVO.
      Show
      The CANFAR Science Platform will be easily deployable on a kubernetes installation next to their SRC data storage, thus removing the need to move data to perform analysis, but instead using the CANFAR Science Platform to deploy and run scientific containers next to the data. The improvements to the CANFAR Science Platform deployment model will result in a better software product that will allow for changes, feature additions, extensions, and plug-ins to be made more rapidly, benefiting the SRCNet prototyping effort. This will allow other containerized applications to be added, for example, VisIVO.
    • Hide

      The CANFAR Science Platform is deployable on a fresh kubernetes installation (not necessarily a cluster of nodes) with minimal effort.  

      • Deployers can configure the platform to use a specific Authentication and Authorization System.
      • Deployers can configure the container image registry (or registries) that are to be used by the platform.
      • Deployers can specify, through configuration, the nature of the storage available to the platform.
      • There shall be no technical barriers incurred by the deployment process that make the platform incompatible with the target infrastructure.

      The completed deployment will then allow for users to launch, list, and use running software containers ("sessions") to analyze data available locally to the installation.

      • Using credentials from the configured Authentication and Authorization service, a user should be able to launch a session (such as CARTA) to view data available in the configured Data Storage.
      • With those same credentials, a user should be able to list and delete sessions that were previously launched.
      Show
      The CANFAR Science Platform is deployable on a fresh kubernetes installation (not necessarily a cluster of nodes) with minimal effort.   Deployers can configure the platform to use a specific Authentication and Authorization System. Deployers can configure the container image registry (or registries) that are to be used by the platform. Deployers can specify, through configuration, the nature of the storage available to the platform. There shall be no technical barriers incurred by the deployment process that make the platform incompatible with the target infrastructure. The completed deployment will then allow for users to launch, list, and use running software containers ("sessions") to analyze data available locally to the installation. Using credentials from the configured Authentication and Authorization service, a user should be able to launch a session (such as CARTA) to view data available in the configured Data Storage. With those same credentials, a user should be able to list and delete sessions that were previously launched.
    • 2
    • 2
    • 0
    • Team_RED
    • Show
      Incomplete stories moved to https://jira.skatelescope.org/browse/SP-3799 and https://jira.skatelescope.org/browse/SP-3801
    • 20.5
    • Stories Completed, Integrated, Outcomes Reviewed, Accepted by FO
    • PI24 - UNCOVERED

    • PI19-PB SRC-MiniNode Team_RED

    Description

      The CANFAR Science Platform is a simple but powerful set of web services that allow users, through their browser, to spawn and then interact with analysis tools that execute close to large data sets.  The user analysis tools are software containers, often created by users, that are made available, through container image registries, to the science platform.  Examples of such software containers are JupyterLab and the Cube Analysis and Rendering Tool for Astronomy (CARTA), though there are no limits to the scope what comprises a container.

      The CANFAR Science Platform runs and executes user containers on kubernetes, and thus can be made to scale very easily.  Though it has been demonstrated that the CANFAR Science Platform can be deployed on other kubernetes instances (such as Google Kubernetes Engine (GKE) in 2020), it was overly complicated and arduous, and required the special knowledge of the CANFAR development team.  These difficulties were largely due to assumptions in the services about the nature and details of dependent services and infrastructure.  This feature addresses those assumptions and removes the technical barriers of installing CANFAR on an arbitrary kubernetes.

      Git repository here: https://github.com/opencadc/science-platform/tree/SP-3544

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                B.Major Major, Brian
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1033.0
                  Total1033.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel