Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4251

Enable use of WLCG DC inject tool for v0.1 data moving campaign scenarios

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      The ability to run a sustained data-challenge campaign will demonstrate the capabilities of SRCNet v0.1.
      Tooling from recent WLCG Data Challenges (DC24) have demonstrated the ability to move data at scale. Reusing this technology will be enable SRCNet to perform similar tests at various scales, as part of the data-moving and lifecycle campaigns of v0.1 

      This feature will provide a mechanism to use the WLGC tooling (DC_inject) within the task-manager framework and demonstrate (at a functional scale), 

      Show
      The ability to run a sustained data-challenge campaign will demonstrate the capabilities of SRCNet v0.1. Tooling from recent WLCG Data Challenges (DC24) have demonstrated the ability to move data at scale. Reusing this technology will be enable SRCNet to perform similar tests at various scales, as part of the data-moving and lifecycle campaigns of v0.1  This feature will provide a mechanism to use the WLGC tooling (DC_inject) within the task-manager framework and demonstrate (at a functional scale), 
    • Hide

      AC1: Provide tooling for use in task-manager to provide functionality from DC_inject tooling 

      AC2: Demonstrate use of the tool with transfers across multiple SRCNet RSEs

      AC3: (Stretch) Get PR request approved and merged into task-manager. 

      Show
      AC1: Provide tooling for use in task-manager to provide functionality from DC_inject tooling  AC2: Demonstrate use of the tool with transfers across multiple SRCNet RSEs AC3: (Stretch) Get PR request approved and merged into task-manager. 
    • 0.5
    • 0.5
    • 0
    • Team_PURPLE
    • Sprint 3
    • Overdue
    • PI24-PB SRC23-PB Team_PURPLE data-lifecycle network-tests tests-compilation

    Description

      Data Challenge campaigns of various scales and functionality are required during SRCNet v0.1. 
      During the WLCG Data Challenge 2024, ATLAS and CMS used tooling (dc_inject) to inject rules into rucio and emulate production style transfers. The ability to reuse this tooling may be beneficial for the needs of the test campaigns planned for SRCNet v0.1. 

      Run some mini data challenges in the run up to a full scale data challenge

      Attachments

        Issue Links

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                J.Walder Walder, James
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (40.00%)

                  Feature Estimate: 0.5

                  IssuesStory Points
                  To Do23.0
                  In Progress   00.0
                  Complete12.0
                  Total35.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel