Feature #11605: arv-put detects symlinks to common files and directories to avoid duplicated uploads - Arvados

Actions

Copy link

Feature #11605

open

arv-put detects symlinks to common files and directories to avoid duplicated uploads

Added by Lucas Di Pentima about 7 years ago. Updated almost 3 years ago.

Status:

New

Priority:

Normal

Assigned To:

Category:

Target version:

Start date:

05/02/2017

Due date:

% Done:

Estimated time:

Story points:

Description

When uploading a set of files, if some subdirectories or files are referenced more than once by using symbolic links, the current behavior is to upload them every time like if they're different files.

As described by Peter (https://dev.arvados.org/issues/11579#note-5), arv-put should notice this and instead of re-upload the same set of files, it should just copy the data from within the collection, saving bandwidth and time.