Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3907

Rubin Science Platform: Deployment Assessment

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      The Rubin Science Platform (RSP) offers a modular framework in which SAP components can be developed, deployed and managed. A predominantly K8s-based deployment, the RSP dev team are prioritising modularity, reusability and use of existing off-the-shelf components (several of the CNCF-backed projects for instance).

      Therefore, though the needs of the SRCNet are likely to differ in several ways from Rubin and its (I)DACs, it is probable that the core underlying infrastructure will be suitable for both projects' SAP needs.

      Other factors to consider are the collaboration agreement between SKAO and Rubin Observatory, connections to ESCAPE collaborators involved in RSP operations, and SRCNet partners (e.g. CADC) who will be operating RSP deployments to support Rubin users in the future. RSP has also been tested with the same images developed for the CANFAR science platform user sessions, offers an existing collection of IVOA-compliant services using the FastAPI framework, and the Rubin Observatory is using Rucio and PANDA to serve the needs of the Observatory's data distribution and workload management systems (though it should be noted that these are not currently coupled to the RSP itself).

      With all this in mind, RSP seems worth some further evaluation as a component (likely platform-level) of the SKAO SAP.

      Show
      The Rubin Science Platform (RSP) offers a modular framework in which SAP components can be developed, deployed and managed. A predominantly K8s-based deployment, the RSP dev team are prioritising modularity, reusability and use of existing off-the-shelf components (several of the CNCF-backed projects for instance). Therefore, though the needs of the SRCNet are likely to differ in several ways from Rubin and its (I)DACs, it is probable that the core underlying infrastructure will be suitable for both projects' SAP needs. Other factors to consider are the collaboration agreement between SKAO and Rubin Observatory, connections to ESCAPE collaborators involved in RSP operations, and SRCNet partners (e.g. CADC) who will be operating RSP deployments to support Rubin users in the future. RSP has also been tested with the same images developed for the CANFAR science platform user sessions, offers an existing collection of IVOA-compliant services using the FastAPI framework, and the Rubin Observatory is using Rucio and PANDA to serve the needs of the Observatory's data distribution and workload management systems (though it should be noted that these are not currently coupled to the RSP itself). With all this in mind, RSP seems worth some further evaluation as a component (likely platform-level) of the SKAO SAP.
    • Hide

      AC1: Documentation to clarify the deployment needs of the RSP on SRCNet resources (e.g. bare metal type K8s clusters).

      Show
      AC1: Documentation to clarify the deployment needs of the RSP on SRCNet resources (e.g. bare metal type K8s clusters).
    • 2
    • 2
    • 0
    • SRCNet0.x science-platform-services

    Description

      RSP is a K8s-based deployment for managing Science Platform services. Though it doesn't meet all of the SRCNet SAP's needs out of the box, it is built with extensibility in mind, and  the goal of this feature-level spike is to better understand the potential role it could play in the SRCNet SAP, through deploying an instance of the RSP on SRCNet resources.

      This may prove challenging, since the RSP dev team recommends installing on commercial cloud resources ('on premise' resources like OpenStack will require more manual configuration of e.g. secrets, storage, registries which will add complexity), but at the least it should be possible to better understand the scope of operating this stack following this exploratory work.

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                j.collinson Collinson, James
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel