Details
-
Enabler
-
Must have
-
True
-
Obs Mgt & Controls
-
-
-
5
-
5
-
0
-
Team_OMCPT
-
Sprint 5
-
-
-
-
testing
Description
We need to continue the work done in SP-4030 along these lines (in this order).
- in
SP-4030we were not able to tackle the issue of refactoring the code of the test harness that handles emulators of tango devices. This needs to be done to increase modularity, modifiability and understandability of the test harness and tests. - Refactor other TMC+X integration tests (TBD); liase with Himalaya, Sahyadri and possibly the new "software integration team" to do so and spread the knowledge
- create a library for the tmc-test-harness so that it can be reused across TMC MID and LOW
- setup a mechanism so that X-ray pages describing scenarios and test plans can be used as living documentation. This should enable casual users (like managers) to understand what tests have been run, and what is the actual behaviour of the tested system. (This needs to add more details to xray pages: composition of the SUT, all scenarios in a single screen, some way to provide the meaning of the gherkin steps)
- put in place a mechanism that can print out (on the stdout in gitlab pipelines) the actual versions of all the components involved in a test (there should be something like this that was implemented by VIOLA/VULCAN)
- a mechanism so that html pages of the test report produced as gitlab artefacts (one thing achieved by
SP-4030) can be accessed as links from Xray test plans/test executions - setup a mechanism to declaratively represent the obststate state machine inside the source of the testware and refer to its parts in individual tests that involve subarrays; this should then be used to automatically produce text-only or graphical reports of the level of transition-coverage by a testset/testplan.
- explore ways in which gherkin steps can be reused (at least within the TMC testware). This should involve inventing clever ways to parameterize steps and define their meaning (like pre- and post-conditions).
NOTE: all this is way beyond the capacity that will be allocated (no more than 1 person x 5 sprint=5FP). We will do what we can.
This is expected to be carried out by g.brajnik E.Lena and v.allan .