Bug #8910
closed
[SDK] arv-put should save manifest text on API error
0%
Description
If arv-put gets an API error when creating the collection record, the entire upload is for nothing because the once the manifest_text is lost it is necessary to re-upload the whole thing. Arv-put should save the manifest text somewhere to offer some way of recovering from error.
This should probably leverage the existing "resume" functionality.
Updated by
Updated by Brett Smith almost 9 years ago
Peter Amstutz wrote:
This should probably leverage the existing "resume" functionality.
Another approach would be for arv-put to start using the Collection class, start a new collection on upload, and periodically save it until the upload is finished.
This is a bigger change, but moving to the Collection class makes it easier to make a lot of other changes we want in arv-put: refreshing permission tokens as it goes along, smarter block splits, adding files to existing collections, etc.
Updated by Brett Smith almost 9 years ago
- Target version set to Arvados Future Sprints
Updated by Tom Morris about 8 years ago
- Assigned To set to Lucas Di Pentima
Lucas - have the recent arv-put changes resolved this?
Updated by Lucas Di Pentima about 8 years ago
Tom Morris wrote:
Lucas - have the recent arv-put changes resolved this?
Now arv-put periodically (every 20 secs, IIRC) saves the manifest on its cache, so I would say: yes.
Updated by Lucas Di Pentima about 8 years ago
- Status changed from New to Resolved
Updated by Tom Clegg almost 8 years ago
- Target version deleted (
Arvados Future Sprints)