Bug #19292: feature of keep-block-check to do deep verification that all blocks in a collection are intact - Arvados

Backlogs error: Couldn't find RbRelease with 'id'=69 (ActiveRecord::RecordNotFound)

Actions

Bug #19292

open

Status:

New

Priority:

Low

Assigned To:

Category:

SDKs

Target version:

Start date:

Due date:

% Done:

Estimated time:

Description

In the case of potential hardware corruption, we would like to be able to thoroughly check that a collection is intact.

the keep-block-check tool currently takes a list of blocks and uses HEAD requests to see if the blocks exist.

extend this with a mode to do deep validation of a collection:

get the manifest text and check for valid syntax/grammar
compute the portable data hash and compare against the collection record
go through each block and fetch from keep, compute the hash of the block against the expected hash. report any blocks that are missing or return an error.

Actions

Subject changed from Tool to do a deep verification that all blocks in a collection are intact to feature of keep-block-check to do deep verification that all blocks in a collection are intact
Description updated (diff)
Priority changed from Normal to Low
Target version changed from 2022-08-03 Sprint to 2022-08-17 sprint