Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2372

SDP Processing Function library packaging & CI improvements

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Must have
    • PI14
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      The purpose of the processing function library is specifically to make processing functions easily accessible, with a great deal of portability across workflow technology choices. This means that packaging and delivery mechanisms need to be well thought out to maximise the future utility of packaged functions.

      Show
      The purpose of the processing function library is specifically to make processing functions easily accessible, with a great deal of portability across workflow technology choices. This means that packaging and delivery mechanisms need to be well thought out to maximise the future utility of packaged functions.
    • Hide
      Show
      Refactor CI pipelines to use & extend standard Makefile / CI pipeline stages ( https://gitlab.com/ska-telescope/sdi/ska-cicd-makefile / https://gitlab.com/ska-telescope/templates-repository ) CI generates conan builds Python wheels are generated Both are made available on the CAR for releases Stretch: Add / revise code C++ linting & auto-formatting (suggested by PSS) Documentation + examples are provided for installing and using processing function library
    • Inter Program
    • 2
    • 2
    • 8
    • 4
    • Team_HIPPO
    • Sprint 4
    • Hide

      The Python wheels and Conan package were added to the processing function library. The way how Conan package could be used is summarized on https://confluence.skatelescope.org/display/SE/HIP-193%3A+Investigate+Conan+packages. Python wheels are available at https://gitlab.com/ska-telescope/sdp/ska-sdp-func/-/packages. The processing function library is now using the SKA project CI templates for the Python code, it is also running black, pylint, flake8 and pytest (as well as the other stages).

      Show
      The Python wheels and Conan package were added to the processing function library. The way how Conan package could be used is summarized on https://confluence.skatelescope.org/display/SE/HIP-193%3A+Investigate+Conan+packages . Python wheels are available at https://gitlab.com/ska-telescope/sdp/ska-sdp-func/-/packages . The processing function library is now using the SKA project CI templates for the Python code, it is also running black, pylint, flake8 and pytest (as well as the other stages).
    • 15.1
    • Stories Completed, Integrated, Solution Intent Updated, BDD Testing Passes (no errors), Outcomes Reviewed, NFRS met, Satisfies Acceptance Criteria, Accepted by FO

    • PI22 - UNCOVERED

    • SPO-1592

    Description

      Who?

      • For SDP pipeline developers using the Processing Function library

      What?

      • Packaging and packaging infrastructure improvements using CI
      • Adoption of standardised CI stages and project template styles supported by the system team (contributing to improving these as needed)
        • I.e. ideal would be that we support all the C++ equivalents to "make python-build", "make python-format" etc
      • Evaluation of documentation and examples for installing and using the processing function library.

      Why?

      •  It's intended that this library underpins SDP pipeline development and can eventually be a valuable resource to a wider community. We need to get the software engineering and application developer experience aspects as well polished as we can early on to help with this.

       

      Notes

      Processing function library documentation + CI improvements (build Conan + wheels)

      Attachments

        Issue Links

          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                p.wortmann Wortmann, Peter
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1232.5
                  Total1232.5

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel