Bug #10186
closed
[Crunch2] Support dispatching to multiple SLURM partitions
Added by Tom Morris over 8 years ago.
Updated over 8 years ago.
Estimated time:
(Total: 0.00 h)
Release relationship:
Auto
- Target version set to 2016-10-12 sprint
- Story points set to 1.0
Define new run time constraint called "Partition".
Add support to arvados dispatch slurm map to sbatch argument.
- Assigned To set to Peter Amstutz
- Status changed from New to In Progress
The title for this ticket talks about "multiple partitions" but the code only refers to partition in singular.
Reading sbatch
documentation, it seems that passing a comma separated string can be used to dispatch to multiple partitions, but at least for me it's not clear because of the constraints and variable naming.
If the objective is really to dispatch to multiple partitions, can the runtime constraint be defined as an array of strings that get translated to the appropriate comma separated string?
Lucas Di Pentima wrote:
The title for this ticket talks about "multiple partitions" but the code only refers to partition in singular.
Reading squeue
documentation, it seems that passing a comma separated string can be used to dispatch to multiple partitions, but at least for me it's not clear because of the constraints and variable naming.
If the objective is really to dispatch to multiple partitions, can the runtime constraint be defined as an array of strings that get translated to the appropriate comma separated string?
The intent was "select a partition among multiple partitions" instead of being restricted to either the default partition or a single explicitly configured partition in SbatchArguments. However, you're right, the more general version of this feature should allow listing multiple partitions.
I realize that this branch is also missing a documentation update. Will work on it.
- Status changed from In Progress to Resolved
Applied in changeset arvados|commit:9f35a3cf10e5d261d83556d5b33f242966101f02.
Also available in: Atom
PDF