Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4274

Develop metadata-based replication tests as part of regular functional testing

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      As we head towards SRCNet0.1 delivery, more robust test coverage will be required to assess component performance. A fast way to achieve this is full-stack data transfer tests, together with descriptive monitoring infrastructure that flags issues for operators to act on. Therefore increasing the scope of the Rucio automated test campaign is a high-value task.

      Show
      As we head towards SRCNet0.1 delivery, more robust test coverage will be required to assess component performance. A fast way to achieve this is full-stack data transfer tests, together with descriptive monitoring infrastructure that flags issues for operators to act on. Therefore increasing the scope of the Rucio automated test campaign is a high-value task.
    • Hide

      (To be refined at Backlog Prioritisation/PI Planning)

      AC1: Additional tests added to the regular functional test suite which demonstrate additional Rucio functionality (at least subscription-based data transfers)

      AC2: Modifications to the monitoring infrastructure (including dashboard views) to make clear success/failure criteria (and/or performance) for new tests

      AC3: Additional tests added to the regular functional test suite which demonstrate larger scale transfers between sites, including at least one intercontinental link (e.g. AusSRC to Europe)

      Show
      (To be refined at Backlog Prioritisation/PI Planning) AC1: Additional tests added to the regular functional test suite which demonstrate additional Rucio functionality (at least subscription-based data transfers) AC2: Modifications to the monitoring infrastructure (including dashboard views) to make clear success/failure criteria (and/or performance) for new tests AC3: Additional tests added to the regular functional test suite which demonstrate larger scale transfers between sites, including at least one intercontinental link (e.g. AusSRC to Europe)
    • 2
    • 1.5
    • 0
    • Team_MAGENTA

    • PI23 - UNCOVERED

    • SRC23-PB SRCNet0.1 data-ingestion-dissemination-and-replication network-tests team_DAAC tests-compilation

    Description

      To date, Rucio tests built in the rucio-task-manager (https://gitlab.com/ska-telescope/src/ska-rucio-task-manager) have been fairly small scale full mesh functional tests.

      Now that Rucio has been adopted as the DDM solution of choice for SRCNet 0.1, and as sites start to increase the storage resources they make available to the network, it is a good time to increase the scope of the tests running on a regular cadence.

      This could include:

      • Increasing the size of test data files moved around the network
      • Increasing Rucio code coverage through adding e.g. subscription-based transfer tests
      • Moving real/simulated science data (in addition to randomly generated data) around the network

      Corresponding improvements to the monitoring/dashboards should also be made to facilitate easier 'quick-look' assessment of network health and performance.

      Attachments

        Issue Links

          relates to

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4257 Development of sufficient functionality for v0.1 Data Challenge tests

          • Not Assigned - Priority is not assigned yet.
          • Funnel

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4256 Develop rucio-task-manager to ingest data using the ska-src-ingestion tool as part of tests

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing
          mentioned in

          Page Loading...

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                j.collinson Collinson, James
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (46.67%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do68.0
                  In Progress   00.0
                  Complete67.0
                  Total1215.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel