Actions
Bug #17390
closed
Set storage classes for intermediates and final outputs
Start date:
08/12/2021
Due date:
% Done:
100%
Estimated time:
(Total: 0.00 h)
Story points:
-
Release:
Release relationship:
Auto
Description
--storage-classes STORAGE_CLASSES
Specify comma separated list of storage classes to be
used when saving workflow output to Keep.
base casecase¶
arvados-cwl-runner --name "CWL diagnostics hasher" --create-workflow hasher-workflow.cwl hasher-workflow-job.yml --storage-classes STORAGE_CLASSES
Existing behavior is final output collection goes to the storage class.
Currently all intermediates go to 'default'.
Expected behaviour:
- Need to be able to set the storage class of output of a container request
- Should be able to choose a storage class and have it used for intermediate results through the workflow
- Need to be able to specify the storage class for a given workflow step ???
In CWL:
StorageClassHint: storageClasses: [foo, bar]
Turns this into "output_storage_classes" on the container request.
Command line parameter applies to everything.
Want to support a case where all the intermediates go to fast storage and only the final outputs go into long term storage.
Updated by 
Updated by 
Updated by
Actions