Uploaded image for project: 'SAFe Solution'
  1. SAFe Solution
  2. SS-83

Data processing testing platform

    XporterXMLWordPrintable

Details

    • Enabler
    • Should have
    • PI13, PI14
    • None
    • Data Processing, Services
    • Hide
      • A testing platform is available on IRIS according to the established SKAO allocation (and/or other suitable cloud resources)
      • The platform infrastructure is defined as code in SKAO repositories, and it adheres to the criteria of portability and reproducibility. 
      • All developers in the workflow CoP can access the testing platform according to an established procedure
      • The Services and DP trains provide and establish points of contact for assistance and support.
      • Documentation on how to access the platform is available. 
      Show
      A testing platform is available on IRIS according to the established SKAO allocation (and/or other suitable cloud resources) The platform infrastructure is defined as code in SKAO repositories, and it adheres to the criteria of portability and reproducibility.  All developers in the workflow CoP can access the testing platform according to an established procedure The Services and DP trains provide and establish points of contact for assistance and support. Documentation on how to access the platform is available. 
    • Overdue

    • PI22 - UNCOVERED

    Description

      The development of the data processing workflows needs to be consolidated around a testing platform where enough resources can be allocated to test relevant performance aspects. Such testing platform shall be accessible by all developers involved in this effort and managed as part of the SKAO platforms, with related quality processes and tools. 

      Recently, an allocation has been granted to SKAO on the IRIS platform, but this is still unused for this purpose. 

      The intent of this capability is to make such platform available to the DP train so that the related work can proceed. 

      We also note that an unused allocation on the IRIS platform might cause further requests to be rejected in the future. 

      Teams from the Services ART shall liaise with IRIS and make the platform accessible in the first place. The base software platform shall also be developed and deployed in a way that adheres to SKAO quality practices, possibly building on top of the existing definitions of infrastructure as code. 

      Collaboration on this capability shall involve DP teams in correctly framing the requirements and use cases for such platform. DP shall also be in a position to greatly contribute to the technical implementation and deployment of the testing framework of choice for this activity. If necessary it is also expected that DP shall contribute to the development of the aspects more related to the platform development and deployment, in direct contact with the Services ART. 

       

      Attachments

        Issue Links

          Child Of

          Spike - A time limited investigation to get some knowledge SP-1329 Exploration of resource availability for SDP simulations and workflows

          • Could have - Items labelled as "Could have" are desirable but not necessary and could improve the user experience or customer satisfaction for a little development cost. These will typically be included if time and resources permit.
          • Funnel
          Parent Of

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2070 Deploy SLURM cluster on STFC cloud SKA-TechSDH&P project

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Funnel

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2072 Instructions for access and use of SKA-TechSDH&P infrastructure

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Analyzing

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-1509 Establish environment for SDP workflow testing

          • Should have - Items labelled as "Should have" are important but not necessary for delivery in the current delivery timebox. While "Should have" items can be as important as "Must have", they are often not as time-critical or there may be another way to satisfy the requirement so that it can be held back until a future delivery timebox.
          • Analyzing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2174 Resource monitoring of IRIS SKA-SDH&PTech project

          • Should have - Items labelled as "Should have" are important but not necessary for delivery in the current delivery timebox. While "Should have" items can be as important as "Must have", they are often not as time-critical or there may be another way to satisfy the requirement so that it can be held back until a future delivery timebox.
          • Analyzing

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-2081 Demonstrate execution of at least one SDP prototype pipeline on shared infrastructure using SKA1 simulated data.

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Done

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2069 Deploy CUDA enabled k8s cluster in STFC cloud SKA-TechSDH&P project

          • Should have - Items labelled as "Should have" are important but not necessary for delivery in the current delivery timebox. While "Should have" items can be as important as "Must have", they are often not as time-critical or there may be another way to satisfy the requirement so that it can be held back until a future delivery timebox.
          • Done

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2071 Deploy Gitlab runners on STFC cloud SKA-TechSDH&P project

          • Should have - Items labelled as "Should have" are important but not necessary for delivery in the current delivery timebox. While "Should have" items can be as important as "Must have", they are often not as time-critical or there may be another way to satisfy the requirement so that it can be held back until a future delivery timebox.
          • Discarded

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-1668 Revisit data management solution for SDP pipeline development

          • Could have - Items labelled as "Could have" are desirable but not necessary and could improve the user experience or customer satisfaction for a little development cost. These will typically be included if time and resources permit.
          • Discarded
          relates to

          PI Risk - Program Increment risk for ROAMing ROAM-246 Access to computing resources for imaging pipeline work

          • Active Risk
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Wiki Page

          Wiki Page Loading...

          Structure

            Activity

              People

                Unassigned Unassigned
                m.bartolini Bartolini, Marco
                Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (28.57%)

                  Feature Estimate: 0.0

                  IssuesStory Points
                  To Do12.0
                  In Progress   33.0
                  Complete22.0
                  Total67.0

                  Capability Progress

                    Feature Point Burn-up: (28.57%)

                    Capability Estimate: 0

                    CountFeature Points
                    Todo45
                    In Progress   00
                    Done22
                    Total67

                    Dates

                      Created:
                      Updated:

                      Structure Helper Panel