Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2618

Kibana and Grafana dashboards for monitoring SDP

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Data Processing
    • Hide

      See Why?

      Show
      See Why?
    • Hide

      See What?

      Show
      See What?
    • 1
    • 1
    • 0

    • Use Case USE-22 Operate and Monitor Telescope

    • Sub-system Version REL-815 SDP 0.18.0

    • Team_NALEDI
    • Sprint 3
    • Hide

      The team investigated how to use and implement elastic search keywords to the Kibana logs, a basic search for relevant namespaces was implemented in future this could be improved upon. For the Grafana dashboards showing the namespace a new dashboard was implemented which helps users answer questions such as "Is there enough disk space remaining". The user is now presented with an informative block taking them to the desired dashboard. A custom Jupyter notebook was implemented to help facilitate users trying to understand how to use this aspect of the SDP system.

      Show
      The team investigated how to use and implement elastic search keywords to the Kibana logs, a basic search for relevant namespaces was implemented in future this could be improved upon. For the Grafana dashboards showing the namespace a new dashboard was implemented which helps users answer questions such as "Is there enough disk space remaining". The user is now presented with an informative block taking them to the desired dashboard. A custom Jupyter notebook was implemented to help facilitate users trying to understand how to use this aspect of the SDP system. Added links to Generated Links and added them to the Dashboard: https://gitlab.com/ska-telescope/sdp/ska-sdp-qa-data-api/-/merge_requests/91 https://gitlab.com/ska-telescope/sdp/ska-sdp-qa-display/-/merge_requests/124 Some text to help users understand the purpose of this data has been added: https://gitlab.com/ska-telescope/sdp/ska-sdp-qa-display/-/merge_requests/131 Created custom Grafana dashboard: https://gitlab.com/ska-telescope/sdi/ska-ser-ansible-collections/-/merge_requests/232 Created custom Jupyter notebook: https://gitlab.com/ska-telescope/ska-jupyter-scripting/-/merge_requests/40
    • 20.5
    • Stories Completed, Integrated, Outcomes Reviewed, NFRS met, Demonstrated, Satisfies Acceptance Criteria, Accepted by FO

    • PI24 - UNCOVERED

    • Demo_20.1
    • Com-G1

    Description

      UIs will be needed for testing of SKA software, which includes the SDP sub-system. The belief is that users of the system will want the ability to quickly view SDP-related logs and metrics as part of understanding the behaviour of the system. The SDP is not a typical sub-system because its activity is split across two namespaces, for the control system and processing, respectively. This will be easier if customised dashboards are provided than giving access to the unconfigured services.

      Who?

      • Developers
      • AIV engineers

      What?

      • Kibana and Grafana dashboards for displaying SDP-specific logs and metrics (e.g. pod/container CPU and memory usage).
      • SDP integration documentation describes how the find the dashboards and configure them for the particular cluster and namespaces.

      Why?

      • Enables users and testers of the SDP sub-system to quickly discover logs and metrics, and avoid awkward fumbling about with Kibana and Grafana.

      Attachments

        Issue Links

          clones

          Feature - A Feature is a service that fulfills a stakeholder need. Each feature includes a benefit hypothesis and acceptance criteria, and is sized or split as necessary to be delivered by a single Agile Release Train (ART) in a Program Increment (PI). SP-2551 SKAMPI & SDP operator dashboard

          • Must have - Items labelled as "Must have" are critical to the current delivery timebox in order for it to be a success.
          • Done
          Is delivered by

          Sub-system Version - A version of a sub-system, used in the Release Management and Configuration Management process REL-815 SDP 0.18.0

          • Released
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                m.ashdown Ashdown, Mark
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete1028.0
                  Total1028.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel