Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3051

Deploy probes to get Rucio RSE stats and monitor daemons

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Not Assigned
    • None
    • None
    • SRCnet
    • Hide

      For ESCAPE WP2, two probes were developed to get more information about dids and replicas (https://github.com/ESCAPE-WP2/rucio-stats-dids and https://github.com/ESCAPE-WP2/rucio-stats-replicas respectively). These probes use the Rucio API to access information about e.g. RSE usage, formulate events and send them to an external database. This information is useful for RSE health monitoring and accounting.

       

      These probes were initially run as cronjobs, but the rucio-task-manager framework provides a centralised place to keep these probes, already containing the necessary logic to access Rucio instances via the API and send events to databases. Migrating these scripts to run within this framework would make them more maintainable and easier to deploy.

       

      Alternatively, but with external dependencies, it may be possible to migrate these scripts to the Rucio-managed probes repository, which functions in a similar way.

      Show
      For ESCAPE WP2, two probes were developed to get more information about dids and replicas ( https://github.com/ESCAPE-WP2/rucio-stats-dids and https://github.com/ESCAPE-WP2/rucio-stats- replicas respectively). These probes use the Rucio API to access information about e.g. RSE usage, formulate events and send them to an external database. This information is useful for RSE health monitoring and accounting.   These probes were initially run as cronjobs, but the rucio-task-manager framework provides a centralised place to keep these probes, already containing the necessary logic to access Rucio instances via the API and send events to databases. Migrating these scripts to run within this framework would make them more maintainable and easier to deploy.   Alternatively, but with external dependencies, it may be possible to migrate these scripts to the Rucio-managed probes repository, which functions in a similar way.
    • Hide

      AC1: Scripts migrated and running (inside or outside of framework).

      AC2: This information available on the monitoring dashboard

      Show
      AC1: Scripts migrated and running (inside or outside of framework). AC2 : This information available on the monitoring dashboard
    • 1
    • 0
    • PI23 - UNCOVERED

    • SRC-DM

    Description

       

      BH: 

       

       

      Attachments

        Structure

          Activity

            People

              r.bolton Bolton, Rosie
              r.joshi Joshi, Rohini
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (0%)

                Feature Estimate: 1.0

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete00.0
                Total00.0

                Dates

                  Created:
                  Updated:

                  Structure Helper Panel