Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4383

Reduce sequential phases of ICAL pipeline

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Must have
    • PI23
    • COM SDP SW
    • Data Processing
    • Hide

      Captured from description on Miro (see: https://miro.com/app/board/uXjVKZ900uo=/?moveToWidget=3458764589411581527&cot=14 ):

      • We want our ICAL pipelines to be able to keep up with the LOW and MID telescopes at AA2 scale, i.e., these pipelines should take at most twice the duration of the processed observation.
      • Profiles of our runs show that we have largely successfully managed to distribute the expensive operations of ICAL. However, it looks like (now) a lot of time is spent in phases where not much parallel work is happening at all - in some cases it actually looks like we spend hours using just a few (or even just one) core on the master node. The net result is that we are likely only using <5% of the compute available to us.
      Show
      Captured from description on Miro (see: https://miro.com/app/board/uXjVKZ900uo=/?moveToWidget=3458764589411581527&cot=14 ): We want our ICAL pipelines to be able to keep up with the LOW and MID telescopes at AA2 scale, i.e., these pipelines should take at most twice the duration of the processed observation. Profiles of our runs show that we have largely successfully managed to distribute the expensive operations of ICAL. However, it looks like (now) a lot of time is spent in phases where not much parallel work is happening at all - in some cases it actually looks like we spend hours using just a few (or even just one) core on the master node. The net result is that we are likely only using <5% of the compute available to us.
    • Hide

      We want to resolve the most significant bottlenecks. Specifically:

      1. The computational inefficiency of sky model filtering is addressed (SCHAAP).
      2. By removing the MPI writer lock in WSClean idle time caused by unnecessary locking is avoided. (SCHAAP).
      3. Distributed deconvolution is explored (PANDO).
      4. The prototype for I/O optimisation of WSClean is merged (PANDO, SCHAAP).
      Show
      We want to resolve the most significant bottlenecks. Specifically: The computational inefficiency of sky model filtering is addressed ( SCHAAP ). By removing the MPI writer lock in WSClean idle time caused by unnecessary locking is avoided. ( SCHAAP ). Distributed deconvolution is explored (PANDO ). The prototype for I/O optimisation of WSClean is merged ( PANDO , SCHAAP ).
    • 5
    • 5
    • 0
    • Team_PANDO, Team_SCHAAP
    • Sprint 5
    • PI23 - UNCOVERED

    • AA2

    Attachments

      Structure

        Activity

          People

            p.wortmann Wortmann, Peter
            f.graser Graser, Ferdl
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Feature Progress

              Story Point Burn-up: (100.00%)

              Feature Estimate: 5.0

              IssuesStory Points
              To Do00.0
              In Progress   00.0
              Complete12.0
              Total12.0

              Dates

                Created:
                Updated:

                Structure Helper Panel