Loading...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Must have
Fix Version/s: PI11
Component/s: None
Labels:
- testing

ARTs:

Services
Acceptance criteria:
Hide

there is 1+ testset for the tests of PSI low in Jira/Xray, and each testset contains 1+ test scenarios and scenario outlines

each test scenario has a corresponding automation based on pytest represented in some git repository

each test (or possibly testset) is linked (within Jira) to tickets representing requirements: feature, use case, verification requirement

tests and testsets are labelled with tags representing the components being tested, versions of tests, tactical tags like 'quarantined', 'WIP', or others

tests can be run (by hand or via CI pipeline) and their results can be uploaded to Xray and Xray can display reports of executions, of requirement coverage (see https://docs.getxray.app/display/XRAY/Test+Coverage)[|https://jira.skatelescope.org/secure/AddComment!default.jspa?id=59725]
Show
there is 1+ testset for the tests of PSI low in Jira/Xray, and each testset contains 1+ test scenarios and scenario outlines each test scenario has a corresponding automation based on pytest represented in some git repository each test (or possibly testset) is linked (within Jira) to tickets representing requirements: feature, use case, verification requirement tests and testsets are labelled with tags representing the components being tested, versions of tests, tactical tags like 'quarantined', 'WIP', or others tests can be run (by hand or via CI pipeline) and their results can be uploaded to Xray and Xray can display reports of executions, of requirement coverage (see https://docs.getxray.app/display/XRAY/Test+Coverage )[|https://jira.skatelescope.org/secure/AddComment!default.jspa?id=59725]
Feature Points:
2.5
Initial Size:
2.5
WSJF:
2
Epic Link:
PSI Low Definition and Evolution
Agile Teams:

Team_VULCAN
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:
Hide

Test Sets: XTP-2925, XTP-3155, XTP-3157, XTP-3160, XTP-3162 are created

XTP-2925 tests are automated and are part of the branch LOW-108

Test sets are linked to the Verification Requirement VTS-235, L1-1419, L1-1689 and L1-1693

Tests and Test sets are labelled with tags such as L1, LOW, PSI, Power, System-Test, Verification-Test, TMC etc

Tests are run manually and their results are shown in Xray reports as below:

X-Ray Test plan execution reports: https://jira.skatelescope.org/secure/XrayReport!default.jspa?selectedReportKey=xray-report-testplan&selectedProjectKey=XTP&contains=XTP-2942

Traceability of the tests to the requirements reports: https://jira.skatelescope.org/secure/XrayReport!default.jspa?selectedReportKey=xray-report-traceability-matrix&selectedProjectKey=VTS&execScope=testPlan&testPlan=XTP-2942&environment=PSI_LOW&hideTestRuns=false&flattenRequirements=true

Yet to be done: Tests are to be run from the CI pipeline but is currently blocked due to SKAMPI instability.
Show
Test Sets: XTP-2925, XTP-3155, XTP-3157, XTP-3160, XTP-3162 are created XTP-2925 tests are automated and are part of the branch LOW-108 Test sets are linked to the Verification Requirement VTS-235, L1-1419, L1-1689 and L1-1693 Tests and Test sets are labelled with tags such as L1, LOW, PSI, Power, System-Test, Verification-Test, TMC etc Tests are run manually and their results are shown in Xray reports as below: X-Ray Test plan execution reports: https://jira.skatelescope.org/secure/XrayReport!default.jspa?selectedReportKey=xray-report-testplan&selectedProjectKey=XTP&contains=XTP-2942 Traceability of the tests to the requirements reports: https://jira.skatelescope.org/secure/XrayReport!default.jspa?selectedReportKey=xray-report-traceability-matrix&selectedProjectKey=VTS&execScope=testPlan&testPlan=XTP-2942&environment=PSI_LOW&hideTestRuns=false&flattenRequirements=true Yet to be done: Tests are to be run from the CI pipeline but is currently blocked due to SKAMPI instability.
Resolved PI.Sprint:
12.5

Feature Checklist:

Stories Completed, Outcomes Reviewed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

Demos:
- OMC_ART_SystemDemo_5
Requirement Status:

PI22 - UNCOVERED
Labels_MIRO:
testing
Goals_MIRO:
SPO-1140

Description

Test management for PSI Low

Manage test materials (test scenarios, test sets, requirements) in order to support traceability wrt requirements (features in SP, use cases, ...):

Traceability refers to the mapping between test sets and test scenarios in Jira for all the existing tests/scenarios. Feature/use case also needs to be mapped to Jira tickets.

Use case -> Test sets -> Tests

Karoo has shell scripts to

upload a feature file to XRay, update the Jira ticket if exists, if not creates a new Jira ticket.
download
compare

Use of labels/tags for functionality, components involved, test levels etc

X-Ray documentation: https://docs.getxray.app/display/XRAY/Quick+Guides

Record which commits of source code and test code were done (like adding the commit tag to Xray representations):

Version of the tests

Version of the Software being tested (System Under Test) - Spike to investigate how to incorporate this info

Version of the Hardware being tested (System Under Test) - Spike to investigate how to incorporate this info

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...

Structure

Activity

People

Assignee:: Brajnik, Giorgio

Reporter:: Mohile, Vivek

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 2.5

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	10	22.0
Total	10	22.0

Dates

Created:: 18/May/21 6:16 AM

Updated:: 15/Apr/24 9:48 AM

Resolved:: 11/Nov/21 1:59 PM