Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-1784

CLONE - Provide a test data manager component

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Obs Mgt & Controls
    • Hide

      To simplify and organize handling of data to be used by BDD and system tests.

      Show
      To simplify and organize handling of data to be used by BDD and system tests.
    • Hide

      These are thw acceptance criteria for this enabler:

      • the CLI script should be enriched with some way to specify the pathname where to locally store the data resource, when downloading it;
      • the CLI script should be enriched with some way to specify the new version of the new uploaded data resource, when uploading it;
      • the tool requires a predefined root directory in nexus (something like 'data-manager') and is not allowed to manipulate nexus resources that are stored outside this root.

      These were the acceptance criteria of the preceeding issue (https://jira.skatelescope.org/browse/SP-1577, see comment https://jira.skatelescope.org/browse/SP-1577?focusedCommentId=80087&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-80087):

      • as a tester I should be able to put my input data under version control in a git repo; 
      • as an initial example, let's say data=JSON configuration strings of subarrays and other devices/components; 
      • such data should be referred to/used by test code (pytest fixtures or the like); testers would use "name/ID" and "version" to identify, within the data manager, a particular data object; (version might be a git tag);
      • the data manager module/package will allow the tester to list existing data objects, to filter them, to select one; the "data curator" should be able to update data.
      • How to include and refer test data is clearly documented as part of the developer portal and the code is part of the testing runway.
      • The Solution Intent is updated accordingly, possibly at https://confluence.skatelescope.org/pages/viewpage.action?pageId=93224993 
      Show
      These are thw acceptance criteria for this enabler: the CLI script should be enriched with some way to specify the pathname where to locally store the data resource, when downloading it; the CLI script should be enriched with some way to specify the new version of the new uploaded data resource, when uploading it; the tool requires a predefined root directory in nexus (something like 'data-manager') and is not allowed to manipulate nexus resources that are stored outside this root. These were the acceptance criteria of the preceeding issue ( https://jira.skatelescope.org/browse/SP-1577 , see comment  https://jira.skatelescope.org/browse/SP-1577?focusedCommentId=80087&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-80087): as a tester I should be able to put my input data under version control in a git repo;  as an initial example, let's say data=JSON configuration strings of subarrays and other devices/components;  such data should be referred to/used by test code (pytest fixtures or the like); testers would use "name/ID" and "version" to identify, within the data manager, a particular data object; (version might be a git tag); the data manager module/package will allow the tester to list existing data objects, to filter them, to select one; the "data curator" should be able to update data. How to include and refer test data is clearly documented as part of the developer portal and the code is part of the testing runway. The Solution Intent is updated accordingly, possibly at  https://confluence.skatelescope.org/pages/viewpage.action?pageId=93224993  
    • 1
    • 1
    • 1
    • Hide

      most of the SKA teams will have tests that use the data manager code and their scripts are isolated from details about where and how the data is stored.

      Show
      most of the SKA teams will have tests that use the data manager code and their scripts are isolated from details about where and how the data is stored.
    • 17.5
    • PI22 - UNCOVERED

    Description

      this is a followup of the work done against SP-1577, which was not completed in PI-10. See comment https://jira.skatelescope.org/browse/SP-1577?focusedCommentId=79940&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-79940 and following ones.

      What needs yet to be done are minor things (following points taken from acceptance criteria - repeated here to provide a more complete description):

      • the CLI script should be enriched with some way to specify the pathname where to locally store the data resource, when downloading it;
      • the CLI script should be enriched with some way to specify the new version of the new uploaded data resource, when uploading it;
      • the tool requires a predefined root directory in nexus (something like 'data-manager') and is not allowed to manipulate nexus resources that are stored outside this root.

      Original description of SP-1577

      The need

      The problem is that system-level tests (and BDD ones) need to use test reference data* in order to control the SUT and check its output. Such data needs to produced, validated, versioned. And therefore we need mechanisms to store them, to update them, to reference them. We will need also a policy and a process to define such data, revise them, approve changes, version it, and likely somebody who is in charge (a "data curator").

      It might make sense to distinguish handling of input data to drive/control the SUT vs data used when checking the output of the SUT.

      One aspect that needs to be considered is the size of the data. When we will start using images and test vectors then storing them, versioning them and transferring them would become an issue.

      In general terms we are focusing here on a component of the Test Automation Architecture which could be called Test Data Manager.

      TEST REFERENCE DATA

      this is data that is used by tests to exercise & check the SUT; the test script would not change these data. For example, configuration strings, user credentials, etc. These data are different from the data produced by the SUT when working. 

       

      Attachments

        Issue Links

          Structure

            Activity

              People

                s.vrcic Vrcic, Sonja
                g.brajnik Brajnik, Giorgio
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel