Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-517

Open source the Data Challenge scoring code

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Not Assigned
    • PI4, PI5
    • None
    • Data Processing
    • Hide

      Making the scoring code available in python will allow data challenge teams to assess their own results, and test that their results catalogues are in the correct format (saving Anna's time). We can then look towards containerising the assessment code as an example to show the data challenge teams how they can create containers. This is part of a longer-term effort to get the various data challenge teams to containerise their algorithms so we can make comparisons of run-time performance on different hardware.

      This is a step towards making future science data challenges more autonomous so that effort within SKAO can go into the development of the challenges themselves and not be taken up so much in help-desk type support of queries about the procedures, formats etc.

      Show
      Making the scoring code available in python will allow data challenge teams to assess their own results, and test that their results catalogues are in the correct format (saving Anna's time). We can then look towards containerising the assessment code as an example to show the data challenge teams how they can create containers. This is part of a longer-term effort to get the various data challenge teams to containerise their algorithms so we can make comparisons of run-time performance on different hardware. This is a step towards making future science data challenges more autonomous so that effort within SKAO can go into the development of the challenges themselves and not be taken up so much in help-desk type support of queries about the procedures, formats etc.
    • Hide

      Runnable python code with example use case written according to SKAO SW development best practices, under version control in SKAO-managed repository

      Show
      Runnable python code with example use case written according to SKAO SW development best practices, under version control in SKAO-managed repository
    • 1
    • 1
    • 0
    • Team_ESCAPEES
    • Sprint 4
    • Show
      https://confluence.skatelescope.org/display/SE/SDC1+Scoring+Code+re-implementation
    • 5.6
    • PI24 - UNCOVERED

    • Team_ESCAPEES

    Description

      For the first science data challenge Anna Bonaldi prepared some code to assess the results based on IDL. With a view to enabling a containerised version of each team's pipelines and benchmarking on a variety of different HW systems, we first need to get this code into python, and under version control.

      Attachments

        Issue Links

          Structure

            Activity

              People

                m.bartolini Bartolini, Marco
                r.bolton Bolton, Rosie
                Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete722.0
                  Total722.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel