Project

General

Profile

Actions

Feature #16518

open

[keep] Allow clients to set a header to disable md5sum calculations in keepstore

Added by Ward Vandewege over 4 years ago. Updated almost 2 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

The md5sum calculation in Keepstore is expensive. In most cases, the client does it too, so it doesn't make sense for Keepstore to calculate the md5sum for the data being read from its backend. Allow the client to set a header to disable it on demand.

Should this also apply to PUTs ?

What should the default setting be? Should it be configurable with a config parameter?


Related issues 3 (2 open1 closed)

Related to Arvados - Feature #16519: [keepstore] optimize md5sum calculationsNew

Actions
Related to Arvados - Feature #16513: Get reference Keep performance numbers for Keep-on-S3ResolvedWard Vandewege06/15/2020

Actions
Related to Arvados Epics - Story #18342: Stream Keep data to minimize latency and memory usageNew03/01/202307/31/2023

Actions
Actions

Also available in: Atom PDF