Feature #12345: [CWL] Use arv-put collection caching for file uploads - Arvados

Actions

Copy link

Feature #12345

open

[CWL] Use arv-put collection caching for file uploads

Added by Peter Amstutz over 7 years ago. Updated almost 2 years ago.

Status:

New

Priority:

Normal

Assigned To:

Category:

Target version:

Start date:

Due date:

% Done:

Estimated time:

Story points:

Release:

Postponed

Release relationship:

Auto

Description

arvados-cwl-runner uses arvados.commands.run.uploadfiles() to handle file uploads. However, this uploads all files every time. Arv-put has a local metadata cache for resuming uploads that may be usable here to avoid re-uploading local files that have already been uploaded and are unchanged.

Related issues 1 (0 open — 1 closed)