Project

General

Profile

Actions
Copy link

Bug #9842

closed

[CWL] Ensure that arvados-cwl-runner and arvados/jobs are synchronized

Added by Peter Amstutz over 9 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
-

Description

arvados-cwl-runner (client code) and crunch_scripts/cwl-runner (crunch v1) assume that the arvados/jobs:latest Docker image is synchronized with roughly the same code version. When the versions are not compatible, users get confusing errors and it generates support requests. We should propagate version pins or version ranges on job and container submissions to ensure that compatible versions of crunch_scripts/cwl-runner and arvados/jobs are used.

Actions
Copy link
 #1

Updated by Peter Amstutz over 9 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Tom Clegg over 9 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #4

Updated by Nico César over 9 years ago

test commit:5c45372ab04539fde7b2ff7543e07a6539f46e95

in jenkins we have /usr/local/bin/run-deploy.sh as a SYMLINK to /usr/local/arvados-dev/jenkins/run-deploy.sh .. can we something different than $(dirname "$0") ..? It's an interesting case. without modification I can a) add another symlink to install-arvados-jobs-image and problem solved, but I was wondering if this is solvable in some other way...

Actions
Copy link
 #5

Updated by Nico César over 9 years ago

I added the link and it seems to work:

2016-10-25 20:30:22 Loading ARVADOS_API_HOST and ARVADOS_API_TOKEN
2016-10-25 20:30:22 Installing arvados/jobs docker image
2016-10-25 20:30:22 Found git commit for arvados/jobs Docker image: f6288c66e7ae5a2c736e1c9897acedf6d35b0a10
DEBUG:__main__:found project 4xphq-j7d0g-vhxbh1ca7s2wnli
DEBUG:__main__:found permission link 4xphq-o0j2j-4ov17iiwnhxa9cp
DEBUG:__main__:found image tag f6288c66e7ae5a2c736e1c9897acedf6d35b0a10 collection 4xphq-4zz18-apcw1rnozh4yh15 created Tue Oct 25 02:38:32 2016
DEBUG:__main__:tagging arvados/jobs:f6288c66e7ae5a2c736e1c9897acedf6d35b0a10 as arvados/jobs:latest
DEBUG:__main__:arv-keepdocker arvados/jobs:latest
4xphq-4zz18-apcw1rnozh4yh15

besides the philosophical discussion about dirname $0 ... this is ready to merge.! LGTM

I also notice:

2016-10-25 20:30:25 Gathering list of shell and Keep nodes
/usr/local/bin/run-deploy.sh: line 229: arv: command not found
/usr/local/bin/run-deploy.sh: line 230: arv: command not found
2016-10-25 20:30:25 Updating in parallel:  workbench.4xphq manage.4xphq switchyard.4xphq

but that's another ticket #10352

Actions
Copy link
 #6

Updated by Peter Amstutz about 8 years ago

  • Status changed from In Progress to Resolved

Have been doing this for a while.

Actions
Copy link

Also available in: Atom PDF