Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4257

Develop the tests and monitoring for v0.1 Data Challenge

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      It will be essential to have a suite of data transfer tests to run during SRCNet0.1 testing challenges (orchestrated tests within a particular identified and agreed time window that involve all the participating SRCNet v0.1 sites to exercise the resources pledged). We already have a framework for this in the rucio task manager (https://gitlab.com/ska-telescope/src/ska-rucio-task-manager) but some work is needed to ensure that these tests cover the range of test options, and gather all the test results that we want.

      Developing/updating these tests (as required) in PI24 will allow us to execute the challenge during PI25, when the network has achieved SRCNet 0.1. We will also ensure that the dashboard of results (https://monit.srcdev.skao.int/grafana/d/BfW0IQQVk/rucio-events?orgId=1) is sufficient for our needs.

      Show
      It will be essential to have a suite of data transfer tests to run during SRCNet0.1 testing challenges (orchestrated tests within a particular identified and agreed time window that involve all the participating SRCNet v0.1 sites to exercise the resources pledged). We already have a framework for this in the rucio task manager ( https://gitlab.com/ska-telescope/src/ska-rucio-task-manager ) but some work is needed to ensure that these tests cover the range of test options, and gather all the test results that we want. Developing/updating these tests (as required) in PI24 will allow us to execute the challenge during PI25, when the network has achieved SRCNet 0.1. We will also ensure that the dashboard of results ( https://monit.srcdev.skao.int/grafana/d/BfW0IQQVk/rucio-events?orgId=1 ) is sufficient for our needs.
    • Hide

      AC1: Full suite of Data Challenge (defined here: https://confluence.skatelescope.org/display/SRCSC/Data+Moving+challenge+ideas+for+SRCNet+v0.1) tests added to Rucio task manager repository

      AC2: Dashboard views showing data replication and the corresponding data transfer performance, confirming that each test runs as planned.

      AC3: Demo of written tests running manually at small scale (e.g. 1% of target volume).

       

      Show
      AC1: Full suite of Data Challenge (defined here: https://confluence.skatelescope.org/display/SRCSC/Data+Moving+challenge+ideas+for+SRCNet+v0.1) tests added to Rucio task manager repository AC2: Dashboard views showing data replication and the corresponding data transfer performance, confirming that each test runs as planned. AC3: Demo of written tests running manually at small scale (e.g. 1% of target volume).  
    • 2
    • 1.5
    • 0
    • Team_MAGENTA
    • Sprint 4

    • PI24 - UNCOVERED

    • PI24-PB SRCNet0.x network-tests tests-compilation

    Description

      The data movement challenge will be one category of tests verifying v0.1 achievement. These will exercise the network and storage with full network mesh tests conducted with data of various file sizes using a tool such as the task manager (or something similar).

      Now several tests that could form part of the data challenge have been defined at: https://confluence.skatelescope.org/display/SRCSC/Data+Moving+challenge+ideas+for+SRCNet+v0.1 , these need to be developed (code/configs written) in the rucio task manager.

      Attachments

        Issue Links

          Child Of

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SP-4866 Admin Tooling v0.1 - Roadmap

          • Not Assigned - Priority is not assigned yet.
          • Implementing
          relates to

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4228 Define the test campaigns

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4668 SWESRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4669 UKSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4670 CHSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4672 CASRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4675 NLSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Program Backlog

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4492 ESPSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4671 CNSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4673 ITSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4674 JPSRC - Meet *full* v0.1 storage, compute and network requirements in time

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4275 Execute 0.1 Data Challenge - Verification of Operational Readiness

          • Not Assigned - Priority is not assigned yet.
          • Funnel

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4274 Develop metadata-based replication tests as part of regular functional testing

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Done
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                J.Walder Walder, James
                r.joshi Joshi, Rohini
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (80.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   12.0
                  Complete68.0
                  Total710.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel