Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3885

Prototype queueing software integration with CANFAR Science Platform (CADC-12984 #6)

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      Kubernetes queueing software for users, without users having to interact with k8s will result in:

      1. for users
        1. no need to come up with their own job management and queuing solution
      2. for operators
        1. better resource utilization and sharing
        2. no user's custom solution over-whelming available resources
        3. inform institutional providers' architectural choices, including how to allocation resources to kubernetes deployments. Identify whether or not there is a need for multiple deployments (for the Science Platform, and a separate one for the Batch processing)
      3. for implementors
        1. identify token refresh complications with long-running jobs
      Show
      Kubernetes queueing software for users, without users having to interact with k8s will result in: for users no need to come up with their own job management and queuing solution for operators better resource utilization and sharing no user's custom solution over-whelming available resources inform institutional providers' architectural choices, including how to allocation resources to kubernetes deployments. Identify whether or not there is a need for multiple deployments (for the Science Platform, and a separate one for the Batch processing) for implementors identify token refresh complications with long-running jobs
    • Hide

      AC1: Document deployment of kueue with CANFAR Science Platform
      AC2: Demonstrate the queueing and execution of a job in the CANFAR Science Platform

      Show
      AC1: Document deployment of kueue with CANFAR Science Platform AC2: Demonstrate the queueing and execution of a job in the CANFAR Science Platform
    • 0.5
    • 2
    • 0
    • Team_RED
    • Hide

      This prototype work is being followed-up with this Feature: https://jira.skatelescope.org/browse/SP-4266

      The AC for this Feature will be met in Feature https://jira.skatelescope.org/browse/SP-4266.

      Show
      This prototype work is being followed-up with this Feature: https://jira.skatelescope.org/browse/SP-4266 The AC for this Feature will be met in Feature https://jira.skatelescope.org/browse/SP-4266 .
    • 24.3
    • Outcomes Reviewed
    • PI21-PB science-platform-services

    Description

      Prototype use of a job management, queueing and priorities software (kueue) with CSP

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                s.gaudet Gaudet, Séverin
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 0.5

                  IssuesStory Points
                  To Do36.0
                  In Progress   26.0
                  Complete00.0
                  Total512.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel