Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4133

FTS completion

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      For SRCNet0.1 a Rucio instance needs to use the SKA IAM. This can be achieved if we deploy our own FTS instance configured to use SKA IAM, and if we then move RSEs to use SKA IAM. Alternatively, we switch to SKA IAM but continue to use the CERN pilot FTS instance.
      Work has been continuing for some time to deploy our own FTS instance, and this is an important service to build expertise in within the ART.

      Show
      For SRCNet0.1 a Rucio instance needs to use the SKA IAM. This can be achieved if we deploy our own FTS instance configured to use SKA IAM, and if we then move RSEs to use SKA IAM. Alternatively, we switch to SKA IAM but continue to use the CERN pilot FTS instance. Work has been continuing for some time to deploy our own FTS instance, and this is an important service to build expertise in within the ART.
    • Hide

      First - create a backup plan. What would be the minimal FTS solution to achieve readiness for v0.1 testing. 
      Second - a decision is made with Rob B approval, whether to pursue the backup solution or full solution now.

      If the backup plan:

      • we need acceptance criteria / this feature to define what is to be completed in PI23

      If the full solution, these are the original ACs:

      • FTS migrated to new OS (details follow)
      • Token refactor FTS release implemented and tested
      • Plan for SRCNet0.1: use of own FTS or CERN Pilot FTS
      • Proven transfers using SKA IAM tokens between at least two storage elements
      Show
      First - create a backup plan. What would be the minimal FTS solution to achieve readiness for v0.1 testing.  Second - a decision is made with Rob B approval, whether to pursue the backup solution or full solution now. If the backup plan: we need acceptance criteria / this feature to define what is to be completed in PI23 If the full solution, these are the original ACs: FTS migrated to new OS (details follow) Token refactor FTS release implemented and tested Plan for SRCNet0.1: use of own FTS or CERN Pilot FTS Proven transfers using SKA IAM tokens between at least two storage elements
    • 1.5
    • 1.5
    • 0
    • Team_PURPLE
    • Sprint 5
    • Hide

      Completed FTS transfer using SKA-IAM token:
      $ fts-rest-transfer-submit --access-token=$token -s https://fts3-ska.scd.rl.ac.uk:8446/ https://storm.srcdev.skao.int/sa/test https://xrootd01.uksrc.rl.ac.uk:1094/denebdev/testbed/testJob successfully submitted.
      Job id: 2a83d78a-58a6-11ef-8c8f-001dd8b71d81

      $ fts-rest
      -transfer-status --access-token=$token -s https://fts3-ska.scd.rl.ac.uk:8446/ 2a83d78a-58a6-11ef-8c8f-001dd8b71d81Request ID: 2a83d78a-58a6-11ef-8c8f-001dd8b71d81
      Status: FINISHED
      Client DN: 9bf4073f-f46b-45ce-b86b-58cd22636fbc
      Reason:
      Submission time: 2024-08-12T12:26:57
      Priority: 3
      VO Name: harbor

      $ rbarnsley@srcnet-dev:~$ davix-ls --insecure https://xrootd01.uksrc.rl.ac.uk:1094/denebdev/testbed -H "Authorization: Bearer $token"...
      test

      Show
      Completed FTS transfer using SKA-IAM token: $ fts- rest -transfer-submit --access-token=$token -s https: //fts3-ska.scd.rl.ac.uk:8446/ https://storm.srcdev.skao . int /sa/test https://xrootd01.uksrc.rl.ac.uk:1094/denebdev/testbed/test Job successfully submitted. Job id: 2a83d78a-58a6-11ef-8c8f-001dd8b71d81 $ fts- rest -transfer-status --access-token=$token -s https: //fts3-ska.scd.rl.ac.uk:8446/ 2a83d78a-58a6-11ef-8c8f-001dd8b71d81 Request ID: 2a83d78a-58a6-11ef-8c8f-001dd8b71d81 Status: FINISHED Client DN: 9bf4073f-f46b-45ce-b86b-58cd22636fbc Reason: Submission time: 2024-08-12T12:26:57 Priority: 3 VO Name: harbor $ rbarnsley@srcnet-dev:~$ davix-ls --insecure https: //xrootd01.uksrc.rl.ac.uk:1094/denebdev/testbed -H "Authorization: Bearer $token" ... test
    • 23.6
    • Accepted by FO
    • PI24 - UNCOVERED

    • SRC23-PB Team_PURPLE data-ingestion-dissemination-and-replication data-lifecycle

    Description

      Complete deployment of FTS; so that we can have SRC IAM-authenticated token-based data movement between SRC sites

      Attachments

        Issue Links

          Structure

            Activity

              People

                R.Barnsley Barnsley, Rob
                r.bolton Bolton, Rosie
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 1.5

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel