Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3515

SRC workflow example: catalogue crossmatching

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Should have
    • PI20
    • None
    • SRCnet
    • Hide

      SRCs will provide pre-built scripts for standard workflows that users expect to run. We aim to implement some of these, and test their effectiveness with regards to hardware limitations and data storage schemes. 

      This particular workflow looks at crossmatching different catalogues. This will be a common workflow users will run to compare SKA data with other telescopes. In some cases users will want to crossmatch entire surveys, and data will be distributed in some way. Users will want to either have other survey catalogues readily available at SRC nodes, or will want to download other catalogues so they can perform crossmatching with SKA data.

      Show
      SRCs will provide pre-built scripts for standard workflows that users expect to run. We aim to implement some of these, and test their effectiveness with regards to hardware limitations and data storage schemes.  This particular workflow looks at crossmatching different catalogues. This will be a common workflow users will run to compare SKA data with other telescopes. In some cases users will want to crossmatch entire surveys, and data will be distributed in some way. Users will want to either have other survey catalogues readily available at SRC nodes, or will want to download other catalogues so they can perform crossmatching with SKA data.
    • Hide

      AC1: Implement a basic crossmatching script that can combine multi-wavelength catalogues with some user defined criteria such as matching radius.

      AC2: Get the workflow to pull LOFAR and SDSS/PanStarrs catalogues to cross-match.

      AC3: Document this on the workflow Gitlab repo and record a demo.

       

      Show
      AC1: Implement a basic crossmatching script that can combine multi-wavelength catalogues with some user defined criteria such as matching radius. AC2: Get the workflow to pull LOFAR and SDSS/PanStarrs catalogues to cross-match. AC3: Document this on the workflow Gitlab repo and record a demo.  
    • 1
    • 1
    • 0
    • Team_MAGENTA
    • Sprint 4
    • Show
      Code/docs: https://gitlab.com/ska-telescope/src/src-workloads/-/tree/master/tasks/cross-matching Demo: https://drive.google.com/file/d/19wWKFoTyWQv81NzeSJQcwg6RSg0GQnPn/view?usp=drive_link
    • 21.2
    • Stories Completed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
    • PI23 - UNCOVERED

    • PI20 PI20-PB

    Description

      Input data: two or more catalogues

      Output data: one catalog with columns from all input catalogues

      Software involved: Python astropy, IVOA Simple Cone Search

      Gitlab repo: https://gitlab.com/ska-telescope/src/src-workloads/-/tree/master/tasks/cross-matching

      Demo: https://drive.google.com/file/d/19wWKFoTyWQv81NzeSJQcwg6RSg0GQnPn/view?usp=drive_link

      Attachments

        Issue Links

          Structure

            Activity

              People

                A.Clarke Clarke, Alex
                r.bolton Bolton, Rosie
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete46.0
                  Total46.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel