Bug #12215
closedarvados-docker-cleaner broken on ubuntu precise (12.04)
Description
arvados-docker-cleaner does not start on trusty (ubuntu 12.04).
this appears to be because one of its dependencies has a dependency that does not work with python 3.2 (which is the newest version of python3 on trusty).
docker-py seems to require idna, and the version we have is incompatible with the system python and results in a stack trace like this:
python3 -m arvados_docker.cleaner --quota 250G
Traceback (most recent call last):
File "/usr/lib/python3.2/runpy.py", line 160, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python3.2/runpy.py", line 73, in _run_code
exec(code, run_globals)
File "/usr/lib/python3.2/dist-packages/arvados_docker/cleaner.py", line 17, in <module>
import docker
File "/usr/lib/python3.2/dist-packages/docker/__init__.py", line 20, in <module>
from .client import Client, AutoVersionClient # flake8: noqa
File "/usr/lib/python3.2/dist-packages/docker/client.py", line 19, in <module>
import requests
File "/usr/lib/python3.2/dist-packages/requests/__init__.py", line 52, in <module>
from .packages.urllib3.contrib import pyopenssl
File "/usr/lib/python3.2/dist-packages/requests/packages/__init__.py", line 39, in <module>
from . import idna
File "/usr/lib/python3.2/dist-packages/requests/packages/idna/__init__.py", line 1, in <module>
from .core import *
File "/usr/lib/python3.2/dist-packages/requests/packages/idna/core.py", line 10
_unicode_dots_re = re.compile(u'[\u002e\u3002\uff0e\uff61]')
^
SyntaxError: invalid syntax
Updated by Joshua Randall over 8 years ago
My guess at a fix would be to pin the version of python3-docker-py built on trusty so that it uses an older version of idna (maybe that means installing idna separately and pinning that?)
Updated by Joshua Randall over 8 years ago
Actually it looks like python 3.4 is available on trusty but it isn't required by docker-py (which apparently should require python3 > 3.2).
Updated by Joshua Randall over 8 years ago
haha, right - I meant to say precise (12.04) on which the newest python is indeed 3.2 - ARGH!
Updated by Joshua Randall over 8 years ago
- Subject changed from arvados-docker-cleaner broken on trusty to arvados-docker-cleaner broken on ubuntu precise (12.04)
Updated by Joshua Randall over 8 years ago
I've installed python 3.6 from source on all humgen-0x-0x nodes and arvados-docker-cleaner is now running out of a virtualenv, so our ~18TB of docker crap is now slowly being cleaned up and this is no longer an emergency for us