Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Should have
Fix Version/s: PI21
Component/s: SRCnet Data Management
Labels:
- PI20-PB
- Teal-B
- UKSRC

ARTs:

SRCnet
Benefit hypothesis:

Hide

The low level network needs to be optimised and tested so that the results from higher level tests are robust.

This is a necessary step for any sort of benchmarking to look into options for future development. It will enable us to go forward and start doing other, higher-level, tests with a good understanding of what aspects of the performance are limited by low level considerations. As such, these tests are timely; without them there will be the possibility of erroneous conclusions being drawn from high level tests. The benefit will be to anyone wishing to conduct such high level tests; and at the architectural level to drawing robust conclusions from such tests in making down-select decisions.

Show
The low level network needs to be optimised and tested so that the results from higher level tests are robust. This is a necessary step for any sort of benchmarking to look into options for future development. It will enable us to go forward and start doing other, higher-level, tests with a good understanding of what aspects of the performance are limited by low level considerations. As such, these tests are timely; without them there will be the possibility of erroneous conclusions being drawn from high level tests. The benefit will be to anyone wishing to conduct such high level tests; and at the architectural level to drawing robust conclusions from such tests in making down-select decisions.
Acceptance criteria:

Hide

AC1: SRCnet Demo of testing of data transfer tuning that can be used by SRCnet members for trouble shooting at their site.

-AC2: SRCnet Demo on repeat long-haul AARnet to Europe memory-to-memory performance measurements.

AC3: SRCnet Demo of the effect of file size on transfer performance across the network.

Transferred to Susana for a future PI. AC4: First draft of trouble shooting document that can be used to by SRCnet members investigating, measuring and optimising low-level network performance.

AC5: Support and document data transfer tuning for the Mini-SRCNet Demonstrator (with Spain).

Show
AC1: SRCnet Demo of testing of data transfer tuning that can be used by SRCnet members for trouble shooting at their site. - AC2: SRCnet Demo on repeat long-haul AARnet to Europe memory-to-memory performance measurements. AC3: SRCnet Demo of the effect of file size on transfer performance across the network. Transferred to Susana for a future PI. AC4: First draft of trouble shooting document that can be used to by SRCnet members investigating, measuring and optimising low-level network performance. AC5: Support and document data transfer tuning for the Mini-SRCNet Demonstrator (with Spain).
Feature Points:
0.1
Initial Size:
0.1
WSJF:
0
Epic Link:
Data Moving Challenge Preparatory Steps
Agile Teams:

Team_TEAL
Story Point Burn-up:
Overdue:
Outcomes:

Hide

AC1 - Demonstration of how to test network tuning experiments
This was achieved last year by a demonstration to the programme. The recording can be found at:
https://skatelescope.zoom.us/rec/share/inX3dlhOxNqy7QDQGCJdBfKavEwXLm1i_qv9yXw8uQ_flMrz2dmV21ekxOO5NPPG.VW3FxCjD7gmOaR3P
Passcode: 65gy?xm6
AC5 - Coral team confirmed that testing had completed.

Show
AC1 - Demonstration of how to test network tuning experiments This was achieved last year by a demonstration to the programme. The recording can be found at: https://skatelescope.zoom.us/rec/share/inX3dlhOxNqy7QDQGCJdBfKavEwXLm1i_qv9yXw8uQ_flMrz2dmV21ekxOO5NPPG.VW3FxCjD7gmOaR3P Passcode: 65gy?xm6 AC5 - Coral team confirmed that testing had completed.
Resolved PI.Sprint:
21.6

Feature Checklist:

Outcomes Reviewed

Requirement Status:

PI24 - UNCOVERED
Labels_MIRO:
PI20-PB Teal-B UKSRC

Description

The SRCnet is testing different data transfer technologies (e.g. Rucio) , and using different back end storage technologies (Lustre, CEPH etc) however it is not known how the low level network configuration impacts these tests. This work will contribute to our understanding of how to tune the low level network in the UKSRC and for the mini-SRCnet Demonstrator. This will help us interpret the results of higher level data transfer tests

The UK will work with Spain, Sweden and possibly Switzerland, if capacity allows, to tune nodes and then conduct memory to memory and disk to disk network tests between sites. The results of these tests will then be written up and shared with the wider SRCNet teams to share knowledge and best practise.

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...

Structure

Activity

People

Assignee:: Bolton, Rosie

Reporter:: Chisholm, Louise

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 0.1

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	1	1.0
Total	1	1.0

Dates

Created:: 14/Aug/23 9:41 AM

Updated:: Yesterday 6:43 AM

Resolved:: 01/Mar/24 2:47 PM

Due Sprint Date:: 12/Mar/24

Measuring and optimising low level network performance