Bug #8910
closed
[SDK] arv-put should save manifest text on API error
Description
If arv-put gets an API error when creating the collection record, the entire upload is for nothing because the once the manifest_text is lost it is necessary to re-upload the whole thing. Arv-put should save the manifest text somewhere to offer some way of recovering from error.
This should probably leverage the existing "resume" functionality.
Updated by Peter Amstutz
Updated by Brett Smith almost 10 years ago
Peter Amstutz wrote:
This should probably leverage the existing "resume" functionality.
Another approach would be for arv-put to start using the Collection class, start a new collection on upload, and periodically save it until the upload is finished.
This is a bigger change, but moving to the Collection class makes it easier to make a lot of other changes we want in arv-put: refreshing permission tokens as it goes along, smarter block splits, adding files to existing collections, etc.
Updated by Brett Smith almost 10 years ago
- Target version set to Arvados Future Sprints
Updated by Tom Morris about 9 years ago
- Assigned To set to Lucas Di Pentima
Lucas - have the recent arv-put changes resolved this?
Updated by Lucas Di Pentima about 9 years ago
Tom Morris wrote:
Lucas - have the recent arv-put changes resolved this?
Now arv-put periodically (every 20 secs, IIRC) saves the manifest on its cache, so I would say: yes.
Updated by Lucas Di Pentima about 9 years ago
- Status changed from New to Resolved
Updated by Tom Clegg about 9 years ago
- Target version deleted (
Arvados Future Sprints)