Project

General

Profile

Actions
Copy link

Feature #4528

closed

[Crunch] Dynamic task allocation based on job size determined at runtime

Added by Bryan Cosca about 10 years ago. Updated about 5 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Start date:
11/14/2014
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

This doesn't work with tasks because I run out of memory often and need to parallelize between nodes instead of cores. ie. Haplotype caller and qr1hi-8i9sb-v57c4f1crumgppf

Related issues 1 (0 open — 1 closed)

Related to Arvados - Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jobs" and "reusable tasks" ideasClosed08/27/2014

Actions
Actions
Copy link
 #1

Updated by Brett Smith about 10 years ago

  • Subject changed from Crunch/Run-command is able to allocate n-nodes based on how many samples you want to parallelize to [Crunch] Dynamic task allocation based on job size determined at runtime
  • Category set to Crunch
Actions
Copy link
 #2

Updated by Peter Amstutz about 5 years ago

  • Status changed from New to Closed
Actions
Copy link

Also available in: Atom PDF