Project

General

Profile

Actions
Copy link

Story #16446

open

Manifest format improvements

Added by Peter Amstutz almost 4 years ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
03/01/2023
Due date:
07/31/2023 (about 10 months late)
% Done:

0%

Estimated time:
Story points:
-
Release:
Epics
Release relationship:
Auto

Description

Need to be able to scale manifests to arbitrarily large amounts of data. Currently the 128 MB default request size limit becomes an issue.

Some possible approaches

  • Ability to "mount" another manifest at a directory to support really huge collections
  • API ability to get/put single stream (files in a directory) at a time

Related issues

Related to Arvados - Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hashNew

Actions
Actions
Copy link
 #1

Updated by Peter Amstutz almost 4 years ago

  • Due date set to 11/01/2021
  • Start date set to 08/01/2021
Actions
Copy link
 #2

Updated by Peter Amstutz over 3 years ago

  • Due date changed from 11/01/2021 to 03/31/2022
  • Start date changed from 08/01/2021 to 01/01/2022
Actions
Copy link
 #3

Updated by Peter Amstutz over 2 years ago

  • Due date changed from 03/31/2022 to 06/30/2023
  • Start date changed from 01/01/2022 to 01/01/2023
Actions
Copy link
 #4

Updated by Peter Amstutz about 2 years ago

  • Subject changed from Manifest format v2 to Manifest format improvements
Actions
Copy link
 #5

Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)
Actions
Copy link
 #6

Updated by Peter Amstutz about 2 years ago

  • Due date changed from 06/30/2023 to 12/31/2022
  • Start date changed from 01/01/2023 to 07/01/2022
Actions
Copy link
 #7

Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)
  • Due date changed from 12/31/2022 to 06/30/2023
  • Start date changed from 07/01/2022 to 01/01/2023
Actions
Copy link
 #8

Updated by Peter Amstutz about 2 years ago

  • Due date changed from 06/30/2023 to 12/31/2022
  • Start date changed from 01/01/2023 to 06/01/2022
Actions
Copy link
 #9

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 06/01/2022 to 07/01/2022
Actions
Copy link
 #10

Updated by Peter Amstutz almost 2 years ago

  • Related to Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hash added
Actions
Copy link
 #11

Updated by Peter Amstutz almost 2 years ago

  • Due date changed from 12/31/2022 to 03/31/2023
  • Start date changed from 07/01/2022 to 10/01/2022
Actions
Copy link
 #12

Updated by Peter Amstutz over 1 year ago

  • Due date changed from 03/31/2023 to 07/31/2023
  • Start date changed from 10/01/2022 to 03/01/2023
Actions
Copy link

Also available in: Atom PDF