Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4216

Compile v0.1 storage benchmarking tests in common gitlab repo

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      Infrastructure level tests are an important part of bootstrapping v0.1 SRCSites. These storage tests are a way of capturing storage performance. While they are documented on Confluence, these tests need to be made more reusable, and easily reproducible by all. 

      As these tests have been mentioned in SRCNet documents (Implementation plan v0.1 and SRCNet v0.1 Node requirements ), this feature is to allow for the tests to be run more widely by the participating v0.1 Sites and build a collective picture of storage quality.

      Show
      Infrastructure level tests are an important part of bootstrapping v0.1 SRCSites. These storage tests are a way of capturing storage performance. While they are documented on Confluence, these tests need to be made more reusable, and easily reproducible by all.  As these tests have been mentioned in SRCNet documents ( Implementation plan v0.1 and SRCNet v0.1 Node requirements ), this feature is to allow for the tests to be run more widely by the participating v0.1 Sites and build a collective picture of storage quality.
    • Hide

      Container images, container image definitions, and scripts for running the tests need to be made available via the a repo in the SRC group on Gitlab. Container images need to not be .sif images, ie it should be possible to run them via any container engine, including but not limited to Singularity. 

      They can be made available either in a new repo or they can be consolidated here: https://gitlab.com/ska-telescope/src/src-workloads/-/tree/master/bench?ref_type=heads 

      The latter option would be in discussion with the maintainers of the repo.

      Show
      Container images, container image definitions, and scripts for running the tests need to be made available via the a repo in the SRC group on Gitlab. Container images need to not be .sif images, ie it should be possible to run them via any container engine, including but not limited to Singularity.  They can be made available either in a new repo or they can be consolidated here: https://gitlab.com/ska-telescope/src/src-workloads/-/tree/master/bench?ref_type=heads   The latter option would be in discussion with the maintainers of the repo.
    • Team_TEAL
    • 22.6

    • PI23 - UNCOVERED

    • SRCNet0.1 storage-tests team_DAAC tests-compilation

    Description

      There are plans for CASA measurement set tests, on a single node, for serial read, serial write, parallel read and parallel write operations. These CASA tests will make use of a representative set of visibilities and image cubes, likely using a combination of publicly available LOFAR data and simulated SKA data sets.

      The initial version of those tests can be found here:

      https://confluence.skatelescope.org/display/SRCSC/Benchmarking

      Attachments

        Issue Links

          is duplicated by

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-4293 Develop the Storage Benchmarking functionality required for v0.1

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Implementing

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                r.joshi Joshi, Rohini
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 0.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel