Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3433

Move Kafka dependency into SDP Helm chart

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Should have
    • PI20
    • COM SDP SW
    • None
    • True
    • Data Processing
    • Hide

      See Why?

      Show
      See Why?
    • Hide

      See What?

      Show
      See What?
    • Intra Program
    • 1
    • 1
    • 0
    • Team_NALEDI
    • Sprint 4
    • Hide

      As Kafka is becoming more and more integral to the SDP, it needed to become apart of the SDP deploy.

      Kafka dependency was moved into the SDP Help Chart
      https://gitlab.com/ska-telescope/sdp/ska-sdp-integration/-/merge_requests/207
      Further sensible resource limits were set:
      https://gitlab.com/ska-telescope/sdp/ska-sdp-integration/-/merge_requests/221

      Show
      As Kafka is becoming more and more integral to the SDP, it needed to become apart of the SDP deploy. Kafka dependency was moved into the SDP Help Chart https://gitlab.com/ska-telescope/sdp/ska-sdp-integration/-/merge_requests/207 Further sensible resource limits were set: https://gitlab.com/ska-telescope/sdp/ska-sdp-integration/-/merge_requests/221
    • 20.4
    • Stories Completed, Integrated, BDD Testing Passes (no errors), Outcomes Reviewed, Satisfies Acceptance Criteria, Accepted by FO
    • PI24 - UNCOVERED

    Description

      The SDP Helm chart currently deploys Kafka indirectly as a dependency of the SDP QA sub-chart. This is sub-optimal for a number of reasons:

      • If we need Kafka, we have to deploy the QA components too, even if they are not needed (e.g. pointing calibration integration tests);
      • Components deployed directly by the SDP chart, such as the queue connector Tango devices, have to guess the name of the broker service.

      To solve these problems we should move the Kafka dependency into the SDP chart, and pass the location of the broker in a consistent way to the components and sub-charts that need it.

      Who?

      • SDP developers.

      What?

      • Move Kafka dependency into the SDP Helm chart.
      • Pass location of broker consistently to components and sub-charts.

      Why?

      • Ensure minimal deployments are possible.
      • Ensures Kafka configuration is consistent throughout the SDP.
      • Reduces scope for problems in the future.

      Attachments

        Issue Links

          Structure

            Activity

              People

                m.ashdown Ashdown, Mark
                m.ashdown Ashdown, Mark
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 1.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete29.0
                  Total29.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel