Loading...

Change Owns to Parent Ofs

Set start and due date...

Xporter

XML

Word

Printable

Details

Type: Feature
Priority: Must have
Fix Version/s: PI16
Component/s: SRCnet Data Management
Labels:
- SRC-DM

ARTs:

SRCnet
Feature Points:
4
Initial Size:
4
WSJF:
0
Agile Teams:

Team_CORAL
Due Sprint:
Sprint 5
Story Point Burn-up:
Overdue:
Outcomes:
Hide

RSE in datalake as CHSRC_S3:

Protocols: ========== https domains: '{"lan": {"read": 1, "write": 1, "delete": 1}, "wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy_read": 1, "third_party_copy_write": 1}}' extended_attributes: None hostname: rgw.cscs.ch impl: rucio.rse.protocols.gfal.NoRename port: 443 prefix: rucio scheme: https

Currently possible to upload to this storage but there are problems with FTS transferring between this site and others.

Document on integrating S3 into Rucio here: https://docs.google.com/document/d/1ofV5iIgpCKCnANNuqIavN_6FvvMTE6QPtQKK_n1P3SE/edit
Show
RSE in datalake as CHSRC_S3: Protocols: ========== https domains: '{ "lan" : { "read" : 1, "write" : 1, "delete" : 1}, "wan" : { "read" : 1, "write" : 1, "delete" : 1, "third_party_copy_read" : 1, "third_party_copy_write" : 1}}' extended_attributes: None hostname: rgw.cscs.ch impl: rucio.rse.protocols.gfal.NoRename port: 443 prefix: rucio scheme: https Currently possible to upload to this storage but there are problems with FTS transferring between this site and others. Document on integrating S3 into Rucio here: https://docs.google.com/document/d/1ofV5iIgpCKCnANNuqIavN_6FvvMTE6QPtQKK_n1P3SE/edit
Resolved PI.Sprint:
20.2

Feature Checklist:

Stories Completed

Requirement Status:

PI24 - UNCOVERED
Labels_MIRO:
SRC-DM

Description

The idea is to study how to integrate Object based RSEs into the SRCNet Rucio data lake. Until now the SRCNet Rucio data lake has been populated with RSEs based on different technologies and we are defining recipes for the integration of RSEs based on these technologies. In particular the SRCNet Rucio data lake has RSEs based on CephFS and CephBS among others. (Benefit) By including a RSE based on Object Storage we will enrich the data lake testbed with a different storage system and we will identify a recipe to integrate RSEs based on this kind of technology.

In particular, Coral Swiss members have access to an object-based storage infrastructure (swift/s3) and are interested in integrating this storage resource into the Rucio data lake.

AC: At least one SRC Site (RSE) with Object storage is integrated within RUCIO and a recipe on how to integrate RSE based on Object storage is defined.

Attachments

Issue Links

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(9 mentioned in)

Structure

Activity

People

Assignee:: Barnsley, Rob

Reporter:: Barnsley, Rob

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Feature Progress

Story Point Burn-up: (100.00%)

Feature Estimate: 4.0

	Issues	Story Points
To Do	0	0.0
In Progress	0	0.0
Complete	11	27.0
Total	11	27.0

Dates

Created:: 30/Aug/22 2:34 PM

Updated:: 28/Oct/24 6:47 AM

Resolved:: 28/Sep/23 9:05 AM

Due Sprint Date:: 22/Nov/22

Integrate object storage into the Rucio prototype