Uploaded image for project: 'SAFe Program'
  1. SAFe Program
  2. SP-2581

SDP->SRC delivery with Rucio (continued)

Change Owns to Parent OfsSet start and due date...
    XporterXMLWordPrintable

Details

    • Enabler
    • Could have
    • PI15
    • COM SDP SW
    • None
    • Data Processing
    • Hide

      Provides a way to manage and access SKA observatory data products within a network of remote sites, leveraging on and in collaboration with work being carried out for the development of SRCs.

      While not strictly needed for early AAs, if feasible, we believe it could be very valuable to provide a solution for commissioning scientists to have access to early SKA commissioning data at data centres provided by proto-SRCs and Rucio is currently the leading technology for doing this.

      Show
      Provides a way to manage and access SKA observatory data products within a network of remote sites, leveraging on and in collaboration with work being carried out for the development of SRCs. While not strictly needed for early AAs, if feasible, we believe it could be very valuable to provide a solution for commissioning scientists to have access to early SKA commissioning data at data centres provided by proto-SRCs and Rucio is currently the leading technology for doing this.
    • Hide
      • Investigation and if time develop a prototype/proof of concept for how data could be picked up from the SDP system for distribution with Rucio (ideally collaborating with the approach taken in SP-1661: SDP Data Management)
      • Stretch: Investigate and prototype how data in Rucio might be accessed from a notebook environment following work previously done by the ESCAPEES team.
      Show
      Investigation and if time develop a prototype/proof of concept for how data could be picked up from the SDP system for distribution with Rucio (ideally collaborating with the approach taken in SP-1661 : SDP Data Management) Stretch: Investigate and prototype how data in Rucio might be accessed from a notebook environment following work previously done by the ESCAPEES team.
    • Intra Program
    • 3
    • 3
    • 0
    • Team_NALEDI
    • Sprint 5
    • Hide

      Rucio local development instance created (details available in NAL-131).
      Learnings were made, but due to resource issues much of the planned work was defunked.
      A follow on Feature looked at S3 environments.

      Show
      Rucio local development instance created (details available in NAL-131). Learnings were made, but due to resource issues much of the planned work was defunked. A follow on Feature looked at S3 environments.
    • 18.1
    • Stories Completed, Outcomes Reviewed, Accepted by FO
    • PI22 - UNCOVERED

    Description

      Who?

      • SDP developer (for now), eventually commissioning scientist

      What? (outcomes)

      • Prototype interface for how data is picked up into Rucio for distribution to remote sites (link to SP-1661)
      • Stretch: Investigate and prototype UX for accessing data from UI

      Why?

      (also also benefit hypothesis field)

      • Maintain collaboration with SRC ART, Cyan team and progress work towards Rucio and multi-site data management being a possible solution for AA0.5

      References

      • ...

       

      Attachments

        Issue Links

          Structure

            Activity

              People

                D.Fenech Fenech, Danielle
                b.mort Mort, Ben
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Feature Progress

                  Story Point Burn-up: (100.00%)

                  Feature Estimate: 3.0

                  IssuesStory Points
                  To Do00.0
                  In Progress   00.0
                  Complete27.0
                  Total27.0

                  Dates

                    Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel