Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-4168

Combine workload tasks into a Nextflow pipeline

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      Combining individual tasks becomes more representative of a users workflow at an SRC site. It also allows for more intensive workflows to test the capabilities of the hardware at SRC sites. This could use the Nextflow language, like the EMUkat pipeline. It's an opportunity to learn how to develop Nextflow pipelines.

      Show
      Combining individual tasks becomes more representative of a users workflow at an SRC site. It also allows for more intensive workflows to test the capabilities of the hardware at SRC sites. This could use the Nextflow language, like the EMUkat pipeline. It's an opportunity to learn how to develop Nextflow pipelines.
    • Hide

      AC1: Define a workflow that combines mosaicking, convolution, source-finding, catalogue cross-matching, taking tasks from the SRC gitlab example workflows repository.

      AC2: Demonstration of this workflow running with Nextflow

      AC3: Explanation of how to implement a pipeline in Nextflow

      Show
      AC1: Define a workflow that combines mosaicking, convolution, source-finding, catalogue cross-matching, taking tasks from the SRC gitlab example workflows repository. AC2: Demonstration of this workflow running with Nextflow AC3: Explanation of how to implement a pipeline in Nextflow
    • 1
    • 1
    • 0
    • Team_CORAL
    • Sprint 5
    • Show
        Repo: TBC   AC1: Define a workflow that combines mosaicking, convolution, source-finding, catalogue cross-matching, taking tasks from the SRC gitlab example workflows repository. https://confluence.skatelescope.org/display/SRCSC/COR-589%3A+%5BNextflow%5D+Identify+input+datasets+to+test+the+workflow https://confluence.skatelescope.org/pages/viewpage.action?pageId=273584312 AC2: Demonstration of this workflow running with Nextflow Slides: https://docs.google.com/presentation/d/1wrbNXF9YvTTfDHZF3HhrcsIY5QfpnQNdxcZomASwIg0/edit?usp=sharing Recording: https://confluence.skatelescope.org/pages/resumedraft.action?draftId=265846050&draftShareId=1fd1c8a7-123e-42e1-9e11-b8bb442389c8& AC3: Explanation of how to implement a pipeline in Nextflow https://confluence.skatelescope.org/display/SRCSC/COR-606+%5BNextflow%5D+Create+the+nextflow+workflow+connecting+all+the+steps
    • PI23 - UNCOVERED

    • PI22 example-workflows-and-benchmarks tests-compilation

    Description

      This would combine individual tasks in the SRC workloads Gitlab repository into a workflow representative of a more involved science analysis. 

      e.g. mosaicking -> convolution -> source-finding -> catalogue crossmatching

      Attachments

        Issue Links

          Structure

            Activity

              People

                A.Clarke Clarke, Alex
                A.Clarke Clarke, Alex
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (53.85%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   26.0
                  Complete37.0
                  Total513.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel