Project

General

Profile

Actions

Feature #18960

open

Config option to make crunch-run use Go FUSE driver when all mounts are read-only

Added by Peter Amstutz about 2 years ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
FUSE
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

If the new config option (Containers.UseBuiltinMountWhenReadOnly, default false) is true and there will be no writes to the fuse mount (e.g., singularity image cache, output or other writable collection mounts specified by the container), crunch-run should start a Go fuse process instead of arv-mount.

The fuse driver should be started in a separate process via "/proc/self/exe mount ..." or similar, so it works (and uses the same code version as crunch-run itself) without any extra compute worker image preparation. Document any new runtime dependencies (hopefully none -- arv-mount already requires libfuse).

Any missing features, performance regressions, or user-observable differences (e.g., crunchstat) relative to the arv-mount setup should be noted as follow-up issues, but should not be considered blockers. The goal here is to make it possible to enable the Go option, starting with dev clusters, and test/measure for such differences and prioritize them accordingly.


Related issues

Related to Arvados Epics - Story #17849: FUSE driver v2New03/01/202307/31/2023

Actions
Actions #1

Updated by Peter Amstutz about 2 years ago

Actions #2

Updated by Peter Amstutz about 2 years ago

  • Subject changed from option for crunch-run to start using go FUSE mount for read-only mounts to crunch-run can use Go FUSE driver for read-only mounts
  • Description updated (diff)
Actions #3

Updated by Peter Amstutz about 2 years ago

  • Target version changed from 2022-05-11 sprint to 2022-05-25 sprint
Actions #4

Updated by Peter Amstutz about 2 years ago

  • Target version deleted (2022-05-25 sprint)
Actions #5

Updated by Tom Clegg over 1 year ago

  • Subject changed from crunch-run can use Go FUSE driver for read-only mounts to Config option to make crunch-run use Go FUSE driver when all mounts are read-only
  • Description updated (diff)
Actions #6

Updated by Lucas Di Pentima over 1 year ago

  • Release set to 60
Actions

Also available in: Atom PDF