Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2577

ITF Test Equipment compute platform setup/integration

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Feature
    • Must have
    • PI15
    • None
    • None
    • Services
    • Hide

      To run and control Test Equipment and SUTs we need to establish the basic software deployment platform. This should be aligned with the common SKAO software development platform and requires the creation of a kubernetes  platform connected to  SKAO gitlab.

      Show
      To run and control Test Equipment and SUTs we need to establish the basic software deployment platform. This should be aligned with the common SKAO software development platform and requires the creation of a kubernetes  platform connected to  SKAO gitlab.
      • documentation so the processes can be repeated by e.g. the MID ITF team
      • documentation on how to migrate to full k8s system
      • demonstratable solution to execute tests against the ITF from gitlab CI
    • Intra Program
    • 2
    • 2
    • 0
    • Team_VULCAN
    • Sprint 5
    • Hide

      The Kubernetes platform and hosted services have been deployed on temporary hardware in the ITF. Description and documentation is available at https://confluence.skatelescope.org/display/SE/%5BSP-2577%5D+Prototype+compute+platform+in+the+LOW+sITF, and the Ansible scripts used to deploy the repository are found at https://gitlab.com/ska-telescope/sdi/ska-cicd-deploy-low-itf.

      One way the cluster diverges from our intentions is in the persistent storage solution. We're currently using host volume storage rather than CephFS - the Ceph/Rook configuration used by ST was in flux during this PI, so although we deployed a Ceph cluster, we deferred the Rook configuration.

      Tests can be executed in the ITF using the Gitlab runner tagged `k8srunner-low-itf`. This can be seen in the .gitlab-ci.yml file in ska-low-itf, the repository we've created to house ITF tests. The CI pipelines history in that repository shows examples of individual test runs.

      One of the acceptance criteria for this ticket was to document how to migrate to a full k8s system. This criterion was based on the assumption that we'd be running something other than standard Kubernetes in the ITF - minikube, microk8s, k3s or the like. However, we received hardware sooner than expected, so early in PI15 we decided that deploying Kubernetes was feasible and did that instead.

      Show
      The Kubernetes platform and hosted services have been deployed on temporary hardware in the ITF. Description and documentation is available at https://confluence.skatelescope.org/display/SE/%5BSP-2577%5D+Prototype+compute+platform+in+the+LOW+sITF , and the Ansible scripts used to deploy the repository are found at  https://gitlab.com/ska-telescope/sdi/ska-cicd-deploy-low-itf . One way the cluster diverges from our intentions is in the persistent storage solution. We're currently using host volume storage rather than CephFS - the Ceph/Rook configuration used by ST was in flux during this PI, so although we deployed a Ceph cluster, we deferred the Rook configuration. Tests can be executed in the ITF using the Gitlab runner tagged `k8srunner-low-itf`. This can be seen in the .gitlab-ci.yml file in ska-low-itf , the repository we've created to house ITF tests. The CI pipelines history in that repository shows examples of individual test runs. One of the acceptance criteria for this ticket was to document how to migrate to a full k8s system. This criterion was based on the assumption that we'd be running something other than standard Kubernetes in the ITF - minikube, microk8s, k3s or the like. However, we received hardware sooner than expected, so early in PI15 we decided that deploying Kubernetes was feasible and did that instead.
    • 15.6
    • Integrated, Outcomes Reviewed, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO
    • PI22 - UNCOVERED

    Description

      The ITF (low) is still building up its infrastructure. To be able to execute and trace automated tests against this evolving platform we need to align this with SKAO processes. This needs.

      • a remotely accessible minikube instance to host the (temporary) software environment
      • a persistent storage solution  (within k8s)
      • taranta and jupyter hub
      • a connection to the SKAO gitlab CI and CAR
      • a migration plan to proper computing infrastructure

       

      FO P.Harding ?

      Attachments

        Issue Links

          Structure

            Activity

              People

                Felipe.Gonzalez Gonzalez, Felipe
                Vani.Naram Naram, Vani
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 2.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete912.0
                  Total912.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel