Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-3529

Demonstrate a distributed SQL database

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • SRCnet
    • Hide

      There will be several critical stateful services that will be dependent on databases. To ensure high availability of these critical services, the database implementations they rely on will have to provide high availability. This feature doesn't aim to definitely solve this problem, but to explore one such solution by actually deploying a distributed DB and understanding how applications can migrate to using it from a more traditional DB deployment.

      The initial use case for this would be the data discovery DB (eg, Rucio IVOA DB)

      Show
      There will be several critical stateful services that will be dependent on databases. To ensure high availability of these critical services, the database implementations they rely on will have to provide high availability. This feature doesn't aim to definitely solve this problem, but to explore one such solution by actually deploying a distributed DB and understanding how applications can migrate to using it from a more traditional DB deployment. The initial use case for this would be the data discovery DB (eg, Rucio IVOA DB)
    • Hide

      AC: SQL client that is able to add/query data from a distributed SQL DB deployment. (whether distributed refers to within a site, controlled multi-site, or truly multi-site).

      Show
      AC: SQL client that is able to add/query data from a distributed SQL DB deployment. (whether distributed refers to within a site, controlled multi-site, or truly multi-site).
    • Overdue

    • PI23 - UNCOVERED

    • PI19-PB PI20-PB SRC-CompPlat SRC-Operations

    Description

      Distributed databases with Citus/YugabyteDB/other. Use case: pub-sub read-only replication of the Rucio metadata DB for failover protection. Will be applicable across mission-critical services, would be extended to the Rucio main server DB also. A less-theoretical, more-doing version of https://jira.skatelescope.org/browse/SP-3068.

      Postgres is the preferred option for data discovery DB (initially over mysql or nosql)

      There is some work about to beging/ongoing with IRIS funding exploring distributed DBs with Galera that we can take some direction from, however, that is with mysql in mind. 

      Attachments

        Issue Links

          mentioned in

          Page Loading...

          Page Loading...

          Structure

            Activity

              People

                r.bolton Bolton, Rosie
                r.joshi Joshi, Rohini
                Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (0%)

                  Feature Estimate: 0.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete00.0
                  Total00.0

                  Dates

                    Created:
                    Updated:

                    Structure Helper Panel