Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4189

Enable large files in Telescope Model data

Details

    • Enabler
    • Must have
    • PI22
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      SDP Pipeline users need to be able to upload and retrieve large versioned data sets using the Telescope Model Library.

      Show
      SDP Pipeline users need to be able to upload and retrieve large versioned data sets using the Telescope Model Library.
      • Implement Authentication to the CAR via TelModel Data (Naledi)
      • Create command to upload large files to the CAR (Naledi)
      • Demonstrate a large file download via the TelModel CLI (Naledi)
    • 2
    • 2
    • 0
    • Team_NALEDI
    • Sprint 5
    • PI22 - UNCOVERED

    Description

      At present the Telescope Model (TM) data is stored in SKA GitLab using git LFS. There is a limit on the size of the files that can be stored in this way, so we cannot use the TM to retrieve reasonably large data sets that we expect to use as inputs to processing. An example of such a data set is the embedded element patterns used for Low station calibration in PI21.

      See frame on PI22 board for diagrams and other details

      Attachments

        Structure

          Activity

            People

              p.wortmann Wortmann, Peter
              m.ashdown Ashdown, Mark
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Feature Progress

                Story Point Burn-up: (41.18%)

                Feature Estimate: 2.0

                IssuesStory Points
                To Do12.0
                In Progress   28.0
                Complete47.0
                Total717.0

                Dates

                  Created:
                  Updated:

                  Structure Helper Panel