Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Spike
Priority: Must have
Fix Version/s: PI23
Component/s: COM Data Management, COM PSS SW, COM PST SW, COM SDP SW
Labels:
None

ARTs:

Data Processing
Benefit hypothesis:

Hide

This will start to address the problem raised in the PI22 DP ART problem-solving workshop: managing data sets used to test processing pipelines. This is a problem faced by PSS, PST and SDP teams in various forms. The most urgent use case, taken from the original problem statement, is access to data sets for testing in CI pipelines.

Show
This will start to address the problem raised in the PI22 DP ART problem-solving workshop: managing data sets used to test processing pipelines. This is a problem faced by PSS, PST and SDP teams in various forms. The most urgent use case, taken from the original problem statement, is access to data sets for testing in CI pipelines.
Acceptance criteria:

Hide

Capture use cases and requirements for data set storage for CI and manual tests from PSS, PST and SDP teams.

Show
Capture use cases and requirements for data set storage for CI and manual tests from PSS, PST and SDP teams.
Expect Dependencies:

Intra Program
Feature Points:
1
Initial Size:
1
WSJF:
0
Agile Teams:

Team_ORCA, Team_PST
Due Sprint:
Sprint 2
Story Point Burn-up:
Overdue:
Outcomes:
Hide

Test Data Storage Requirements table contains contributions from every team.

Detailed information about various data sets used by ORCA: https://confluence.skatelescope.org/display/SE/Gather+information+about+how+we+used+data+in+CI+pipelines
Show
Test Data Storage Requirements table contains contributions from every team. Detailed information about various data sets used by ORCA: https://confluence.skatelescope.org/display/SE/Gather+information+about+how+we+used+data+in+CI+pipelines
Resolved PI.Sprint:
23.5

Feature Checklist:

Stories Completed, Outcomes Reviewed, Satisfies Acceptance Criteria, Accepted by FO

Demos:
- DP_ART_23.3
Labels_MIRO:
DP_ART_23.3

Description

See PI22 DP ART problem solving workshop: https://miro.com/app/board/uXjVKGl1ebw=/?moveToWidget=3458764589277978165&cot=14

Restated problem

Don't know where to store data for CI pipeline runs and manual testing. Teams are storing data in different places wherever they have access.
This is due to the storage requirements not being well defined and consolidated so that they can be addressed in a joined up way and to correctly prioritise the work to implement a solution.

Storage requirements include:

size
location
locality of compute resources for CI runners, development, manual testing
access & permissions
discoverability
network bandwidth (LAN & WAN)
storage IO
admin & maintenance responsibility
versioning
mirror / replication management

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(1 mentioned in)

Structure

Activity

People

Assignee:: Ashdown, Mark

Reporter:: Ashdown, Mark

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 1.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	2	4.0
Total	2	4.0

Dates

Created:: 30/May/24 9:15 AM

Updated:: 19/Aug/24 11:56 AM

Resolved:: 19/Aug/24 11:56 AM

Due Sprint Date:: 09/Jul/24

Use cases for data set storage for CI and manual processing pipeline tests