Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-879

I/O performance baseline

    XporterXMLWordPrintable

Details

    • Data Processing
    • Hide

      We need to begin work address the question of how we might achieve scalability for the case of the most challenging types of distributed I/O intensive workflows that the SDP will need to run. In doing so we also need to gain a better understanding of how these types of distributed workflows can be implemented using a high-level execution engine, and the challenges we might need to solve to make this possible.

      Show
      We need to begin work address the question of how we might achieve scalability for the case of the most challenging types of distributed I/O intensive workflows that the SDP will need to run. In doing so we also need to gain a better understanding of how these types of distributed workflows can be implemented using a high-level execution engine, and the challenges we might need to solve to make this possible.
    • Hide

      A report on I/O performance:

      • Using Peter W's I/O prototype
      • On one or ideally two clusters
      • Identifying the observed bottlenecks in performance
      • And describing the tools and approach used to identify this bottlenecks, with a discussion of how these can be applied mroe generally

       

      Show
      A report on I/O performance: Using Peter W's I/O prototype On one or ideally two clusters Identifying the observed bottlenecks in performance And describing the tools and approach used to identify this bottlenecks, with a discussion of how these can be applied mroe generally  
    • 5
    • 5
    • 1.6
    • Team_PLATFORM
    • Sprint 5
    • Hide

      https://confluence.skatelescope.org/display/SE/Imaging+IO+benchmark+scripting+and+reproducibility

      Show
      https://confluence.skatelescope.org/display/SE/Imaging+IO+benchmark+scripting+and+reproducibility
    • 6.6

    • PI22 - UNCOVERED

    Description

      Run and benchmark I/O benchmark on a test platform (to be identified as part of this work) with different configurations. Profile and optimise platform to establish reliable baseline performance figures.

      Attachments

        Issue Links

          relates to

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-1099 Standardize I/O performance benchmark

          • Not Assigned - Priority is not assigned yet.
          • Done

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-1181 Improve usability of the I/O performance benchmark

          • Not Assigned - Priority is not assigned yet.
          • Done

          Enabler - An Enabler supports the activities needed to extend the Architectural Runway to provide future business functionality. These include exploration, architecture, infrastructure, and compliance. SP-663 I/O performance baseline

          • Won't have (this time) - Items labelled as "Won't have", have been agreed by stakeholders as the least-critical, lowest-payback items, or not appropriate at that time. As a result, "Won't have" items are not planned into the schedule for the next delivery timebox.
          • Discarded

          Structure

            Activity

              People

                b.nikolic Nikolic, Bojan
                p.wortmann Wortmann, Peter
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 5.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel