Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2158

Collected Execution Framework development (DALiuGE & EAGLE)

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Should have
    • PI13
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      Advances the design and implementation of a leading solution for the SDP workflow subsystem with a focus the workflow development and Management as described in Solution Intent, see:

       

      Show
      Advances the design and implementation of a leading solution for the SDP workflow subsystem with a focus the workflow development and Management as described in Solution Intent, see: https://confluence.skatelescope.org/display/SWSI/DALiuGE+SDP+Workflow+Subsystem https://confluence.skatelescope.org/display/SWSI/DALiuGE+Workflow+Development    
    • Hide

          BMo: I'm not going to propose any further changes now but I'd like to discuss this more at PI planning to better understand the scope of and direction of the planned work.

      1. implement helm-chart templating support for SDP AA0.05 visibility receive workflow (relates to SP-2146)
      2. new or updated processing component and storage drop developer RTD pages 
      3. additional containers and Eagle palettes (e.g. Stimela)
      4. add support for multi-core parallelism of python components similar to that of C components
      Show
          BMo: I'm not going to propose any further changes now but I'd like to discuss this more at PI planning to better understand the scope of and direction of the planned work. implement helm-chart templating support for SDP AA0.05 visibility receive workflow (relates to SP-2146 ) new or updated processing component and storage drop developer RTD pages  additional containers and Eagle palettes (e.g. Stimela) add support for multi-core parallelism of python components similar to that of C components
    • 5
    • 5
    • 3
    • 0.6
    • Team_YANDA
    • Sprint 5
    • Hide

      1. added helm-chart templating support:
      YAN-844, YAN-846, YAN-894; limited to single node deployments

      2. new and updated processing component and storage drop developer pages:
      https://daliuge.readthedocs.io/en/latest/development/data_development/data_index.html
      https://github.com/ICRAR/daliuge-component-template

      3. additional containers and Eagle palettes (e.g. Stimela):
      new palette for Stimela components available through EAGLE editor
      test graph: https://github.com/ICRAR/EAGLE_test_repo/stimela

      4. multi-core parallelism of python components similar to that of C components: YAN-847

      Show
      1. added helm-chart templating support: YAN-844, YAN-846, YAN-894; limited to single node deployments 2. new and updated processing component and storage drop developer pages: https://daliuge.readthedocs.io/en/latest/development/data_development/data_index.html https://github.com/ICRAR/daliuge-component-template 3. additional containers and Eagle palettes (e.g. Stimela): new palette for Stimela components available through EAGLE editor test graph: https://github.com/ICRAR/EAGLE_test_repo/stimela 4. multi-core parallelism of python components similar to that of C components: YAN-847
    • 13.6
    • Stories Completed, Integrated, Solution Intent Updated, Outcomes Reviewed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
    • PI23 - UNCOVERED

    • SPO-1581

    Description

      1. helm chart templating; driven by AA0.5 receive release use case SP-2146
      2. define scaling challenges; driver is SP-2083
      3. improve component developer documentation
      4. integration of existing Astronomy components readily available as Docker & Singularity containers
      5. add Python multi-core processing support

      Attachments

        Issue Links

          Structure

            Activity

              People

                b.mort Mort, Ben
                m.dolensky Dolensky, Markus [X] (Inactive)
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 5.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1536.0
                  Total1536.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel