Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2697

SDP (AA2) Low Self-calibration pipeline

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Data Processing
    • Intra Program
    • 4
    • 4
    • 0
    • Team_SCHAAP
    • Sprint 5
    • Hide
      • We have identified a suitable LOFAR data set to enable testing and benchmarking of SKA-LOW workflows on real data. We have reduced these data using DP3 and WSClean to establish suitable pipeline parameters like image size, image resolution, weighting scheme, calibration averaging interval and initial source model. This is reported on https://confluence.skatelescope.org/display/SE/LOFAR+test+dataset .
      • The LOFAR test data set has been added to the list of data sets available for testing by Team YANDA, but not uploaded yet (can be done immediately if needed).
      • The AOFlagger is now fully integrated in RASCIL (AST-989).
      • We have spent a lot of time on SP-2716 aimed at integrating the DPSteps in RASCIL. As Radler was already integrated in RASCIL, we are now in a position to build full workflows including direction-dependent calibration, imaging and deconvolution in RASCIL.
      Show
      We have identified a suitable LOFAR data set to enable testing and benchmarking of SKA-LOW workflows on real data. We have reduced these data using DP3 and WSClean to establish suitable pipeline parameters like image size, image resolution, weighting scheme, calibration averaging interval and initial source model. This is reported on  https://confluence.skatelescope.org/display/SE/LOFAR+test+dataset  . The LOFAR test data set has been added to the list of data sets available for testing  by Team YANDA, but not uploaded yet (can be done immediately if needed). The AOFlagger is now fully integrated in RASCIL (AST-989). We have spent a lot of time on SP-2716 aimed at integrating the DPSteps in RASCIL. As Radler was already integrated in RASCIL, we are now in a position to build full workflows including direction-dependent calibration, imaging and deconvolution in RASCIL.
    • 18.1
    • Stories Completed, Integrated, Outcomes Reviewed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
    • PI24 - UNCOVERED

    • DP-SDP: G3

    Description

      Building on a RASCIL-based imaging and deconvolution pipeline, this will provide an MVP pipeline with required documentation and sample data which can gradually be iterated into the Low self-calibration pipeline.

      Who?

      • Commissioning scientists
      • SKA Science Regional Centers (SRCs)
      • Astronomers 

      What?

      • RASCIL-based workflow in python calling functions to do flagging, calibration and imaging.
      • Tested on LOFAR data or other low-frequency data with qualities similar to Low
      • Defines a sequence of processing steps that defines a minimal workflow producing a limited-quality but meaningful end product.
      • Capability to be iterated into full deconvolution and DD calibration pipeline
      • Can use coarse-grained processing components adapted from existing software

      Why?

      •  Commissioning scientists benefit from a working low self-calibration pipeline to create first imaging results.
      • SRCs can use the SKA-LOW self-calibration pipeline to serve their end users or use it as starting point for fine tuning to produce new workflows serving the needs of their astronomical end users.
      • The SKA-LOW self-calibration pipeline will produce imaging products with sufficient quality to be useful for most astronomers who are not radio interferometry expert.

       

      Attachments

        Issue Links

          Structure

            Activity

              People

                D.Fenech Fenech, Danielle
                D.Fenech Fenech, Danielle
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 4.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete616.0
                  Total616.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel