Details
-
Feature
-
Not Assigned
-
None
-
SRCnet
-
-
-
1
-
1
-
0
-
-
-
-
SRCNet0.x example-workflows-and-benchmarks tests-compilation
Description
Demonstrating tasks that interact with the Rucio database will be important. Currently there aren't any tasks that create intermediate data products, so this would have to be only uploading final data products back to Rucio.
The convolution task would be an obvious choice. The benefit of this is that we could upload images back to Rucio at different resolutions after convolution which would be very useful.
An option is to upload catalogues from source finding or mosaics from mosaicking. However, there is current no use for catalogues or mosaics in our task, so that limits further processing needs.
Uploading data back to Rucio will require authentication, meaning this is not an automated step. It would also be beneficial to do this once we have auth-less upload options, particularly in prep for longer automated workflows where data is moved back and forth.
Attachments
Issue Links
- relates to
-
SP-4256 Develop rucio-task-manager to ingest data using the ska-src-ingestion tool as part of tests
- Done