Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4525

Implement SDP resource management

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Data Processing
    • Hide

      As a Telescope Operator, I want to be notified immediately if we do not have enough space available to receive visibilities.

      Show
      As a Telescope Operator, I want to be notified immediately if we do not have enough space available to receive visibilities.
    • Hide
      1. Amount of available buffer space gets registered as a resource in the configuration database
        1. Might just boil down to checking "df", but...
        2. Should clearly not change dynamically since a processing block writes data within its reservation, so the proper definition would be either
          1. free space MINUS data product sizes of processing blocks PLUS processing block reservations, OR
          2. total available space MINUS processing block reservations MINUS sizes of non-processing-block data products
      2. Allow processing scripts to add requests for buffer space (associated with stages)
        1. Receive processing block would use projected observation length and other parameters from the execution block (polarisations, channels, receptors) to approximate size needed.
      3. Implement simple mechanism for these requests to be granted
        1. Processing controller (or separate service?) would monitor resources + requests and assign
      4. Implement mechanism for resource request to fail that is visible to operators
        1. Ideal solution would be for AssignResources to fail already, but that would require looking ahead
        2. Easier would be to just have real-time processing blocks fail (by some mechanism) if they don't get their resources assigned
      Show
      Amount of available buffer space gets registered as a resource in the configuration database Might just boil down to checking "df", but... Should clearly not change dynamically since a processing block writes data within its reservation, so the proper definition would be either free space MINUS data product sizes of processing blocks PLUS processing block reservations, OR total available space MINUS processing block reservations MINUS sizes of non-processing-block data products Allow processing scripts to add requests for buffer space (associated with stages) Receive processing block would use projected observation length and other parameters from the execution block (polarisations, channels, receptors) to approximate size needed. Implement simple mechanism for these requests to be granted Processing controller (or separate service?) would monitor resources + requests and assign Implement mechanism for resource request to fail that is visible to operators Ideal solution would be for AssignResources to fail already, but that would require looking ahead Easier would be to just have real-time processing blocks fail (by some mechanism) if they don't get their resources assigned
    • 5
    • 5
    • 0
    • PI24 - UNCOVERED

    • AA2 SDP_AA2_services_realtime_pipelines

    Description

      See Feature frame on DP ART board.

      Context

      SDP buffer space is going to be a finite resource, and we need to be able to manage it an automated fashion alongside real-time and batch processing. In the first instance, the main concern is for SDP to (reasonably) guarantee that we are not going to be running out of storage space mid-observation.

      References

      Attachments

        Structure

          Activity

            People

              p.wortmann Wortmann, Peter
              m.ashdown Ashdown, Mark
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (0%)

                Feature Estimate: 5.0

                IssuesStory Points
                To Do00.0
                In Progress   00.0
                Complete00.0
                Total00.0

                Dates

                  Created:
                  Updated:

                  Structure Helper Panel