Details

    • Epic
    • None
    • None
    • None
    • Data Model Libraries
    • Data Processing
    • 0

    Description

      Development of one or more prototype libraries that demonstrate the interfaces and technologies needed for the SKA Science Data Model and associated data products.

      Where possible, this will be aligned with the development of MSv3, and should specifically address scaling and performance requirements.

      Once developed, this is will be tested and integrated as part of the regular development of the Data Processing MVP (SP-595) and associated Feature Sets (eg. SP-605, SP-606, SP-608, SP-609).

      Epic Hypothesis Statement (https://www.scaledagileframework.com/epic/)

      For Workflow and processing component developers, scientists, and science operators
      who want to work with (access and update) data products and associated metadata
      the SKA Data Access Libraries
      is a Logical data model description and number of prototype implementations
      that allows easy access to all Science Data Model entities relevant to the processing and extraction of metadata and associated bulk data for SKA observations
      Unlike Existing solutions such as MSv2, the ALMA Science Data Model, KatDAL
      our solution================== includes the set of metadata envisaged to be required by SKA1 Low and Mid, scales to SKA1 sized datasets, supports all SKA SDP data sources (eg. Data Queues), and can be easily associated/linked with relevant final and intermediate SKA1 data products (visibilities, images, time-domain products etc)
         
      Outcome hypothesis
      • Updated version of logical data product models onboarded and documented
      • Implementation of data access library that can query science data model metadata
      • Be able to create and access visibility data products compatible with MSv3
      Leading Indicators  
      NFRs Extensible, Scalability

       

      Attachments

        Issue Links

          Structure

            Activity

              People

                n.rees Rees, Nick
                r.brederode Brederode, Ray
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel