Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3747

Batch workflow testing

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      SRCs will provide pre-built scripts for standard workflows that users expect to run. We aim to implement some of these, and test their effectiveness with regards to hardware limitations and data storage schemes. 

      This feature will provide a way to run multiple workflows automatically in a batch system for the purposes of testing compute infrastructure. It will provide a score and run metrics so comparisons can be made. 

      Show
      SRCs will provide pre-built scripts for standard workflows that users expect to run. We aim to implement some of these, and test their effectiveness with regards to hardware limitations and data storage schemes.  This feature will provide a way to run multiple workflows automatically in a batch system for the purposes of testing compute infrastructure. It will provide a score and run metrics so comparisons can be made. 
    • Hide

      AC1: A script that can run a number of selected workflows automatically, and return the run-time per task, total run-time, and track resource usage. 

      AC2: Record a demo.

      Show
      AC1: A script that can run a number of selected workflows automatically, and return the run-time per task, total run-time, and track resource usage.  AC2: Record a demo.
    • 22.5

    • PI23 - UNCOVERED

    • SRCNet0.x tests-compilation

    Description

      Write a batch testing system that runs all tasks start to finish to create a sustained load on a compute system. A score would be returned based on the performance (speed/efficiency).

      We are unlikely to implement this until we have decided on a mechanism to run multiple tasks. We could use a workload management language like Nextflow to achieve this. Also, we could use CI/CD to ensure this is more efficient. It would be better understanding of those things before making a batch-testing system. 

      Attachments

        Structure

          Activity

            People

              r.bolton Bolton, Rosie
              A.Clarke Clarke, Alex
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (0%)

                Feature Estimate: 0.0

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete00.0
                Total00.0

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel