Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-1127

Migrate away from Docker Compose exclusively to k8s

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Not Assigned
    • PI8
    • None
    • None
    • Services
    • Hide

      All maintainers of outstanding repositories (see description) have migrated their development, test and CI/CD workflow processes to  Kubernetes, and obsoleted the use of docker-compose.

      Developer Portal containerisation standards updated to refer to K8s instead of Docker.

      Show
      All maintainers of outstanding repositories (see description) have migrated their development, test and CI/CD workflow processes to  Kubernetes, and obsoleted the use of docker-compose. Developer Portal containerisation standards updated to refer to K8s instead of Docker.
    • 8
    • 8
    • 2
    • Team_BUTTONS, Team_CIPA, Team_CREAM, Team_KAROO, Team_MCCS, Team_NCRA, Team_PERENTIE, Team_SYSTEM
    • Sprint 4
    • Hide

      NCRA Outcomes:
      Removed docker-compose folder.
      Removed up, down, test, interactive, piplock jobs from the Makefile.
      Updated README file.
      MR! 104 is merged into master.
      Work on review comment by Matteo Di Carlo: https://gitlab.com/ska-telescope/tmc-prototype/-/merge_requests/104#note_409110317: Removing docker run is going on in tox-exploration branch.
      Removed docker from unit-test and lint Makefile jobs.
      Implemented tox based on Py37 as a testing environment.
      Removed integration tests and conftest file from all the tmc devices. (since these tests were not running in any stage).

      Link to git branch: https://gitlab.com/ska-telescope/tmc-prototype/-/merge_requests/107
      -------------------------------------------------------------------------------------
      CREAM Outcomes
      see the following 2 documents:
      CSP.LMC https://drive.google.com/file/d/1OwI5jWY6Co79Rcw4FxWUuEdXwbS1cBhb/view?usp=sharing
      WebJive https://docs.google.com/document/d/1n5SXs8zbKMWapxyKDu2fyJsVorO6Uv4oTPi9tIGXGKI/edit#

      -------------------------------------------------------------------------------------
      Karoo Outcomes
      lmc-base-classes is migrated to, Kubernetes by removing the use of docker-compose in the CI pipeline and reworking the one test that required a running device, supporting SKA Software orchestration strategy and goals by migrating this repo and enabling successful migration of skampi, and other dependent repos.

      Buttons Outcomes:
      Docker-compose references have been removed in cdm-shared-library, observation-execution-tool and ska-project-data-model-library projects (referred to as CDM, OET and PDM respectively in the comments of AT2-544)

      Show
      NCRA Outcomes: Removed docker-compose folder. Removed up, down, test, interactive, piplock jobs from the Makefile. Updated README file. MR! 104 is merged into master. Work on review comment by Matteo Di Carlo: https://gitlab.com/ska-telescope/tmc-prototype/-/merge_requests/104#note_409110317: Removing docker run is going on in tox-exploration branch. Removed docker from unit-test and lint Makefile jobs. Implemented tox based on Py37 as a testing environment. Removed integration tests and conftest file from all the tmc devices. (since these tests were not running in any stage). Link to git branch: https://gitlab.com/ska-telescope/tmc-prototype/-/merge_requests/107 ------------------------------------------------------------------------------------- CREAM Outcomes see the following 2 documents: CSP.LMC https://drive.google.com/file/d/1OwI5jWY6Co79Rcw4FxWUuEdXwbS1cBhb/view?usp=sharing WebJive https://docs.google.com/document/d/1n5SXs8zbKMWapxyKDu2fyJsVorO6Uv4oTPi9tIGXGKI/edit# ------------------------------------------------------------------------------------- Karoo Outcomes lmc-base-classes is migrated to, Kubernetes by removing the use of docker-compose in the CI pipeline and reworking the one test that required a running device, supporting SKA Software orchestration strategy and goals by migrating this repo and enabling successful migration of skampi, and other dependent repos. Buttons Outcomes: Docker-compose references have been removed in cdm-shared-library, observation-execution-tool and ska-project-data-model-library projects (referred to as CDM, OET and PDM respectively in the comments of AT2-544)
    • 9.5
    • Stories Completed, Integrated, Solution Intent Updated, BDD Testing Passes (no errors), Outcomes Reviewed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

    Description

      Background: historically, SKA has used Docker exclusively with docker-compose, as a mechanism for small scale Container Orchestration primarily for the purposes of delivering small scale integrated testing of Tango based software suites.  This approach has been replaced with the use of Kubernetes as the Orchestration platform of choice, which requires migration of existing docker-compose resource files to Kubernetes Helm Charts, as well as integration of the development, test and CI/CD workflow with a Kubernetes environment.

       

      Current Situation: Whilst a number of teams have embraced the Kubernetes centric approach, there are a number of projects/repositories that are still based on the docker-compose workflow.

       

      Desired State: All teams/maintainers of outstanding repositories should migrate their development, test and CI/CD workflow processes to  Kubernetes, and obsolete the use of docker-compose.

      Identified repositories that mention docker-compose:

      cdm-shared-library (Buttons)

      csp-lmc (CREAM)

      csp-lmc-prototype (CREAM)(INACTIVE)

      csp-lmc-subelement (CREAM)

      dish-master (NCRA?)

      lfaa-lmc-prototype (MCCS)

      lmc-base-classes (Karoo )

      low-cbf-gemini (Perentie)

      low-cbf-integration (Perentie)

      low-cbf-mcs (Perentie)

      low-cbf-pss-interface (Perentie)

      mid-cbf-mcs (CIPA)

      observation-execution-tool (Buttons)

      pst-lmc (PST)

      rascil (Tim Cornwell SIM??)

      rdma-data-transport (Andrew Ensor NZAPP)

      sep_pipeline_imaging (Adam Campbell NZAPP)

      ska-docker (ST)

      ska-engineering-ui-compose-utils (CREAM/BUTTONS) (INACTIVE)?

      ska-low-mccs (MCCS)

      skampi (ST)

      ska-project-data-model-library (Buttons)

      tango-example (ST)

      tangogql (CREAM)

      tangosnmp (Perentie)

      tmc-prototype (NCRA?)

      webjive (CREAM)

      webjive-auth (CREAM)

      web-maxiv-tangogql (CREAM)
       

      Attachments

        Issue Links

          Structure

            Activity

              People

                a.bridger Bridger, Alan
                r.brederode Brederode, Ray
                Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 8.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1728.0
                  Total1728.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel