Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4257

Development of sufficient functionality for v0.1 Data Challenge tests

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      It will be essential to have a suite of data transfer tests to run during SRCNet0.1 testing campaigns (orchestrated tests within a particular identified and agreed time window that involve all the participating SRCNet v0.1 sites to exercise the resources pledged). We already have a framework for this in the rucio task manager (https://gitlab.com/ska-telescope/src/ska-rucio-task-manager) but some work is needed to ensure that these tests cover the range of test options, and gather all the test results that we want.

      Updating these tests in PI23 will allow time for feedback on missing areas that can be developed in PI24, including making sure that the dashboard of results (https://monit.srcdev.skao.int/grafana/d/BfW0IQQVk/rucio-events?orgId=1) is sufficient for our needs.

      Show
      It will be essential to have a suite of data transfer tests to run during SRCNet0.1 testing campaigns (orchestrated tests within a particular identified and agreed time window that involve all the participating SRCNet v0.1 sites to exercise the resources pledged). We already have a framework for this in the rucio task manager ( https://gitlab.com/ska-telescope/src/ska-rucio-task-manager ) but some work is needed to ensure that these tests cover the range of test options, and gather all the test results that we want. Updating these tests in PI23 will allow time for feedback on missing areas that can be developed in PI24, including making sure that the dashboard of results ( https://monit.srcdev.skao.int/grafana/d/BfW0IQQVk/rucio-events?orgId=1 ) is sufficient for our needs.
    • Hide

      AC1: New or expanded tests added to Rucio task manager repository with guidance on how to run these.
      AC2: Dashboard views showing data replication and the corresponding data transfer performance, confirming that each test runs as planned.
      AC3: Feedback gathered from the ART and sites to identify gaps in the test framework or dashboard and identify any further work needed.

      AC4: Demo of written tests running manually at small scale (e.g. 1% of target volume).

       

      Show
      AC1: New or expanded tests added to Rucio task manager repository with guidance on how to run these. AC2: Dashboard views showing data replication and the corresponding data transfer performance, confirming that each test runs as planned. AC3: Feedback gathered from the ART and sites to identify gaps in the test framework or dashboard and identify any further work needed. AC4: Demo of written tests running manually at small scale (e.g. 1% of target volume).  
    • 1.5
    • 0
    • PI23 - UNCOVERED

    • SRCNet0.1 network-tests tests-compilation

    Description

      These will be one category of tests driving the test Campaigns for v0.1.
      The data transfer tests will exercise the network and storage with full network mesh tests conducted with data of various file sizes using a tool such as the task manager (or something similar).

       

      Exercise the network and storage with full network mesh tests conducted with data of various file sizes using the rucio task manager.

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                r.joshi Joshi, Rohini
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 1.5

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel