Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-612

JACAL MVP

    XporterXMLWordPrintable

Details

    • Epic
    • None
    • COM SDP SW
    • None
    • JACAL MVP
    • Data Processing
    • 0

    Description

      The Joint Astronomy CALibration and imaging software (JACAL) integrates Yandasoft and the Execution Framework DALiuGE. A shared library offers a calling convention supported by DALiuGE and internally links and reuses ASKAPSoft code. In addition, it includes a growing number of DALiuGE-ified Processing Components such as WSC_lean_ Offringa et al. (2014) and DDFacet derived from Cyril Tasse’s implementation. 

      Processing Components can be packaged as (Docker) containers, which in turn can be deployed via separate (processing component) repositories as demonstrated in the example of  https://github.com/ska-telescope/yanda-docker.

      Repo Maintainer License Code
      JACAL ICRAR + CSIRO Variation of BSD 3-Clause https://gitlab.com/ska-telescope/jacal
      DALiuGE ICRAR LGPL v2.1 https://github.com/ICRAR/daliuge
      EAGLE ICRAR LGPL v3 https://github.com/ICRAR/EAGLE
      Yandasoft CSIRO Variation of BSD 3-Clause https://github.com/ATNF/yandasoft
      SKAO Gitlab projects various BSD 3-Clause https://gitlab.com/ska-telescope

      See also the Yanda MVP document: https://docs.google.com/document/d/1uhfi4Kf3nkLe62xOeNQC1VPDBEpL1vxiRsaBXi71uO0/edit?usp=sharing

      Epic Hypothesis Statement (https://www.scaledagileframework.com/epic/)

      For an (early) commissioning scientist
      who runs data processing workflows
      the JACAL and the associated software from the precon phase and precursors
      is a data processing MVP
      that framework allowing scientists to formulate and run workflows in a flexible manner
      Unlike existing tools and ad-hoc solutions which run existing astronomy software in SLURM or Kubernetes
      our solution========== will cover integration of astronomy software needed for (early) commissioning, provides a flexible user interface for composing it into workflows and executing them in a scalable fashion in the context of the SDP architecture
         
      Outcome hypothesis
      • JACAL provides workflow capabilities for the ingest pipeline and calibration workflow including station beam support,
      • minimizes the hurdle for onboarding and deploying new Processing Components, thereby engaging a wider community of domain and non-domain software providers,
      • minimizes the risk of lacking adequate tools at the start of commissioning.
      Leading Indicators
      • JACAL onboarded as Gitlab project; provide an MVP package for ease of deployment (containerization)
      • the MVP is extensible and tunable in many ways, most importantly by adding capabilities through Processing Components; it can be measured by counting components in Gitlab, logical graphs shared through the workflow editor EAGLE; the Execution Controller could track Processing Block execution etc.
      NFRs extensibility, scalability, maintainability

      Attachments

        Issue Links

          Child Of

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SS-5 Evolutionary Prototype/SKAMPI

          • Could have - Items labelled as "Could have" are desirable but not necessary and could improve the user experience or customer satisfaction for a little development cost. These will typically be included if time and resources permit.
          • Done
          mentioned in

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                n.rees Rees, Nick
                r.brederode Brederode, Ray
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Structure Helper Panel