Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-430

SDP visibility receive workflow (continued)

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Data Processing
    • Hide

      Being able to receive visibility data into the SDP buffer in a well defined and complete data format is a critical component of any early SKA deployment. This feature should continue the work of the early prototype of the visibility receive recieve workflow started in PI#3 and extent it to be able to write visibility data files with sufficient metadata that they can be processed to produce images.

      Show
      Being able to receive visibility data into the SDP buffer in a well defined and complete data format is a critical component of any early SKA deployment. This feature should continue the work of the early prototype of the visibility receive recieve workflow started in PI#3 and extent it to be able to write visibility data files with sufficient metadata that they can be processed to produce images.
    • 3
    • 3
    • 2
    • Team_SIM
    • Sprint 3
    • Hide

      All agreed actions for PI4 in this feature were completed.

      • Addressed a critical issue where, with small numbers of antennas and high data rate streams, not all packets were being read and decoded from the UDP buffer.
      • Visibility receive workflow was updated to evaluate and write uvw coordinates to MSv2 files based on antenna coordinates loaded from a file (in main.c)
      • Alternative formats to MSv2 have been reviewed and documented on confluence (SIM-237) along with performance tests vis receiver writing MSv2 files on the CSD3 RDS Lustre filesystem (SIM-265): https://confluence.skatelescope.org/display/SE/Alternative+Visibility+Storage+Formats
      Show
      All agreed actions for PI4 in this feature were completed. Addressed a critical issue where, with small numbers of antennas and high data rate streams, not all packets were being read and decoded from the UDP buffer. Visibility receive workflow was updated to evaluate and write uvw coordinates to MSv2 files based on antenna coordinates loaded from a file (in main.c) Alternative formats to MSv2 have been reviewed and documented on confluence (SIM-237) along with performance tests vis receiver writing MSv2 files on the CSD3 RDS Lustre filesystem (SIM-265): https://confluence.skatelescope.org/display/SE/Alternative+Visibility+Storage+Formats
    • 4.6
    • PI24 - UNCOVERED

    • DP_epic_1 Team_SIM goal4

    Description

      If continuing with CASA MS files, add additional data and metadata sufficient to produce images.

      Identify and provide configuration and tools necessary to generate simple simulated visibility data sets needed to generate relevant data for the visibility receive workflow.

      Consider the use of alternative and experiment with alternative data formats to CASA MS (eg HDF5).

      Evaluate and assess end-to-end performance considerations of the visibility receive workflow using a chosen relevant storage format and a suitable CSP emulator.

      Attachments

        Issue Links

          Structure

            Activity

              People

                b.mort Mort, Ben
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete713.0
                  Total713.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel