Started by upstream project "developer-run-tests" build number 4976
originally caused by:
 Started by user Brett Smith
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on test-i0u38r (tests) in workspace /tmp/workspace/run-tests-remainder
The recommended git tool is: NONE
using credential c9bcf704-d840-44fe-928e-2eecd48c3006
Cloning the remote Git repository
Avoid fetching tags
Honoring refspec on initial clone
Cloning repository git://git.arvados.org/arvados.git
 > git init /tmp/workspace/run-tests-remainder # timeout=10
Using reference repository: /home/jenkins/reference.git
Fetching upstream changes from git://git.arvados.org/arvados.git
 > git --version # timeout=10
 > git --version # 'git version 2.39.5'
using GIT_SSH to set credentials 
Verifying host key using manually-configured host key entries
 > git fetch --no-tags --force --progress -- git://git.arvados.org/arvados.git refs/tags/*:refs/tags/* refs/heads/main:remotes/origin/main refs/heads/23374-trixie-tests:remotes/origin/ci-build # timeout=10
 > git config remote.origin.url git://git.arvados.org/arvados.git # timeout=10
 > git config --add remote.origin.fetch refs/tags/*:refs/tags/* # timeout=10
 > git config --add remote.origin.fetch refs/heads/main:remotes/origin/main # timeout=10
 > git config --add remote.origin.fetch refs/heads/23374-trixie-tests:remotes/origin/ci-build # timeout=10
Avoid second fetch
 > git rev-parse refs/remotes/origin/ci-build^{commit} # timeout=10
Checking out Revision 46f06ad397a5e1c978d69b552d3294619401604e (refs/remotes/origin/ci-build)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 46f06ad397a5e1c978d69b552d3294619401604e # timeout=10
Commit message: "23374: Update keep-web tests for new cadaver rename command"
 > git rev-list --no-walk 96f388a7087bd3b10d9b5f76bef075ad73d9ea39 # timeout=10
First time build. Skipping changelog.
[run-tests-remainder] $ /usr/bin/env bash /tmp/jenkins6428909186796350361.sh
R SDK not needed, it will not be installed.
Checking dependencies:
locale: en_US.UTF-8
ruby: ruby 3.1.7p261 (2025-03-26 revision 0a3704f218) [x86_64-linux]
go: go version go1.24.10 linux/amd64
gcc: gcc (Debian 12.2.0-14+deb12u1) 12.2.0
fuse.h: /usr/include/fuse/fuse.h
virtualenv: venv module found
/usr/bin/netstat
nginx: nginx version: nginx/1.22.1
npm: 10.8.2
cadaver: cadaver 0.24
jq: jq-1.6
libcurl curl.h: /usr/include/x86_64-linux-gnu/curl/curl.h
libpq libpq-fe.h: /usr/include/postgresql/libpq-fe.h
libpam pam_appl.h: /usr/include/security/pam_appl.h
postgresql: psql (PostgreSQL) 15.14 (Debian 15.14-0+deb12u1)
xvfb: /usr/bin/Xvfb
singularity: singularity-ce version 3.10.4
docker client: Docker version 28.5.2, build ecc6942
docker server: 28.5.2
procs with /dev/fuse open:
grep fuse /proc/self/mountinfo:
40 22 0:32 / /sys/fs/fuse/connections rw,nosuid,nodev,noexec,relatime shared:19 - fusectl fusectl rw
WORKSPACE=/tmp/workspace/run-tests-remainder
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Will install dependencies to /home/jenkins/.local/share/gem/ruby/3.1.0
Will install bundler and arvados gems to /home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0
Gem search path is GEM_PATH=/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0:/home/jenkins/.local/share/gem/ruby/3.1.0:/opt/ruby-3.1.7/lib/ruby/gems/3.1.0
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Requirement already satisfied: build in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 7)) (1.3.0)
Requirement already satisfied: pip>=20.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 10)) (23.0.1)
Requirement already satisfied: setuptools~=80.9 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 15)) (80.9.0)
Requirement already satisfied: wheel in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 17)) (0.45.1)
Requirement already satisfied: PyYAML in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 12)) (6.0.3)
Requirement already satisfied: yq~=3.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 15)) (3.4.3)
Requirement already satisfied: parameterized in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 20)) (0.9.0)
Requirement already satisfied: pytest in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (8.4.2)
Requirement already satisfied: cwltest<3.0,>=2.5.20241122133319 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (2.6.20250818005349)
Requirement already satisfied: pdoc~=16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 30)) (16.0.0)
Requirement already satisfied: s3cmd in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from -r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 33)) (2.4.0)
Requirement already satisfied: packaging>=19.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from build->-r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 7)) (25.0)
Requirement already satisfied: tomli>=1.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from build->-r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 7)) (2.3.0)
Requirement already satisfied: pyproject_hooks in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from build->-r /tmp/workspace/run-tests-remainder/build/requirements.build.txt (line 7)) (1.2.0)
Requirement already satisfied: xmltodict>=0.11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from yq~=3.4->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 15)) (1.0.2)
Requirement already satisfied: tomlkit>=0.11.6 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from yq~=3.4->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 15)) (0.13.3)
Requirement already satisfied: argcomplete>=1.8.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from yq~=3.4->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 15)) (3.6.3)
Requirement already satisfied: iniconfig>=1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pytest->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (2.3.0)
Requirement already satisfied: exceptiongroup>=1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pytest->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (1.3.1)
Requirement already satisfied: pluggy<2,>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pytest->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (1.6.0)
Requirement already satisfied: pygments>=2.7.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pytest->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (2.19.2)
Requirement already satisfied: junit-xml>=1.8 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (1.9)
Requirement already satisfied: defusedxml in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (0.7.1)
Requirement already satisfied: schema-salad<9,>=5.0.20200220195218 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (8.5.20240503091721)
Requirement already satisfied: MarkupSafe>=1.1.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pdoc~=16.0->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 30)) (3.0.3)
Requirement already satisfied: Jinja2>=2.11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pdoc~=16.0->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 30)) (3.1.6)
Requirement already satisfied: markdown2>=2.5.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pdoc~=16.0->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 30)) (2.5.4)
Requirement already satisfied: python-dateutil in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from s3cmd->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 33)) (2.9.0.post0)
Requirement already satisfied: python-magic in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from s3cmd->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 33)) (0.4.27)
Requirement already satisfied: typing-extensions>=4.6.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from exceptiongroup>=1->pytest->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 23)) (4.15.0)
Requirement already satisfied: six in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from junit-xml>=1.8->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (1.17.0)
Requirement already satisfied: rdflib<8.0.0,>=4.2.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (7.0.0)
Requirement already satisfied: mistune<3.1,>=3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (3.0.2)
Requirement already satisfied: mypy-extensions in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (1.1.0)
Requirement already satisfied: ruamel.yaml<0.19,>=0.17.6 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (0.18.16)
Requirement already satisfied: CacheControl[filecache]<0.15,>=0.11.7 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (0.14.4)
Requirement already satisfied: requests>=1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (2.32.5)
Requirement already satisfied: msgpack<2.0.0,>=0.5.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from CacheControl[filecache]<0.15,>=0.11.7->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (1.1.2)
Requirement already satisfied: filelock>=3.8.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from CacheControl[filecache]<0.15,>=0.11.7->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (3.20.0)
Requirement already satisfied: isodate<0.7.0,>=0.6.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from rdflib<8.0.0,>=4.2.2->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (0.6.1)
Requirement already satisfied: pyparsing<4,>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from rdflib<8.0.0,>=4.2.2->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (3.2.5)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=1.0->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (3.4.4)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=1.0->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (2025.11.12)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=1.0->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (3.11)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=1.0->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (2.5.0)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from ruamel.yaml<0.19,>=0.17.6->schema-salad<9,>=5.0.20200220195218->cwltest<3.0,>=2.5.20241122133319->-r /tmp/workspace/run-tests-remainder/build/requirements.tests.txt (line 27)) (0.2.15)
======= install sdk/python
Processing ./sdk/python
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: pyparsing<4,>=3.0.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from httplib2>=0.9.2->arvados-python-client==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: requests<3.0.0,>=2.18.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: six>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (3.4.4)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (3.11)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2025.11.12)
Building wheels for collected packages: arvados-python-client
  Building wheel for arvados-python-client (pyproject.toml): started
  Building wheel for arvados-python-client (pyproject.toml): finished with status 'done'
  Created wheel for arvados-python-client: filename=arvados_python_client-3.3.0.dev20251121214649-py3-none-any.whl size=173591 sha256=7b5ef438a94363f2a0509659c8fff40e5738e5a3e8939a8f442c0ea94d43550f
  Stored in directory: /tmp/pip-ephem-wheel-cache-uvv5sma7/wheels/0a/9d/c1/465c6876961d3d82358a7aa7b843ec033a351684243edd68fe
Successfully built arvados-python-client
Installing collected packages: arvados-python-client
  Attempting uninstall: arvados-python-client
    Found existing installation: arvados-python-client 3.3.0.dev20251121214649
    Uninstalling arvados-python-client-3.3.0.dev20251121214649:
      Successfully uninstalled arvados-python-client-3.3.0.dev20251121214649
Successfully installed arvados-python-client-3.3.0.dev20251121214649
======= install sdk/python -- 4s
PATH is /home/jenkins/tmp/VENV3DIR/bin:/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/bin:/home/jenkins/.local/share/gem/ruby/3.1.0/bin:/home/jenkins/tmp/GOPATH/bin:/usr/local/bin:/usr/bin:/bin:/usr/games
======= install env
======= install env -- 0s
======= install doc
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Bundle complete! 4 Gemfile dependencies, 14 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Bundle complete! 4 Gemfile dependencies, 14 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Updating files in vendor/cache
  * rake-13.1.0.gem
  * RedCloth-4.3.3.gem
  * coderay-1.1.3.gem
  * colorize-1.1.0.gem
  * commonjs-0.2.7.gem
  * rexml-3.2.6.gem
  * kramdown-2.4.0.gem
  * kramdown-parser-gfm-1.1.0.gem
  * kramdown-syntax-coderay-1.0.1.gem
  * less-2.6.0.gem
  * liquid-4.0.4.gem
  * makerakeworkwell-1.0.4.gem
  * zenweb-3.11.0.gem
======= install doc -- 1s
======= install sdk/ruby-google-api-client
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Resolving dependencies...
Bundle complete! 8 Gemfile dependencies, 57 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Bundle complete! 8 Gemfile dependencies, 57 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Updating files in vendor/cache
  * rake-12.3.3.gem
  * base64-0.3.0.gem
  * benchmark-0.5.0.gem
  * bigdecimal-3.3.1.gem
  * concurrent-ruby-1.3.5.gem
  * connection_pool-2.5.5.gem
  * drb-2.2.3.gem
  * i18n-1.14.7.gem
  * logger-1.7.0.gem
  * minitest-5.26.2.gem
  * mutex_m-0.3.0.gem
  * securerandom-0.3.2.gem
  * tzinfo-2.0.6.gem
  * activesupport-7.1.6.gem
  * public_suffix-6.0.2.gem
  * addressable-2.8.8.gem
  * extlib-0.9.16.gem
  * multi_json-1.18.0.gem
  * autoparse-0.3.3.gem
  * uri-1.1.1.gem
  * net-http-0.8.0.gem
  * faraday-net_http-3.4.2.gem
  * json-2.16.0.gem
  * faraday-2.13.4.gem
  * zlib-3.2.2.gem
  * faraday-gzip-3.0.4.gem
  * multipart-post-2.4.1.gem
  * faraday-multipart-1.1.1.gem
  * google-cloud-env-2.2.2.gem
  * google-logging-utils-0.2.0.gem
  * jwt-2.10.2.gem
  * os-1.1.4.gem
  * signet-0.19.0.gem
  * googleauth-1.15.1.gem
  * childprocess-5.1.0.gem
  * launchy-3.0.1.gem
  * retriable-1.4.1.gem
  * docile-1.4.1.gem
  * simplecov-html-0.10.2.gem
  * simplecov-0.16.1.gem
  * mize-0.6.1.gem
  * sync-0.5.0.gem
  * tins-1.47.0.gem
  * term-ansicolor-1.11.3.gem
  * thor-1.4.0.gem
  * coveralls-0.8.23.gem
  * diff-lcs-1.6.2.gem
  * rexml-3.4.4.gem
  * kramdown-2.5.1.gem
  * rspec-support-3.13.6.gem
  * rspec-core-3.13.6.gem
  * rspec-expectations-3.13.5.gem
  * rspec-mocks-3.13.7.gem
  * rspec-3.13.2.gem
  * yard-0.9.37.gem
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
WARNING:  description and summary are identical
WARNING:  See https://guides.rubygems.org/specification-reference/ for help
  Successfully built RubyGem
  Name: arvados-google-api-client
  Version: 0.8.7.16
  File: arvados-google-api-client-0.8.7.16.gem
Successfully installed arvados-google-api-client-0.8.7.16
1 gem installed
======= install sdk/ruby-google-api-client -- 3s
======= install sdk/ruby
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Resolving dependencies...
Bundle complete! 4 Gemfile dependencies, 43 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
Bundle complete! 4 Gemfile dependencies, 43 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
Updating files in vendor/cache
  * rake-13.3.1.gem
  * base64-0.3.0.gem
  * benchmark-0.5.0.gem
  * bigdecimal-3.3.1.gem
  * concurrent-ruby-1.3.5.gem
  * connection_pool-2.5.5.gem
  * drb-2.2.3.gem
  * i18n-1.14.7.gem
  * logger-1.7.0.gem
  * minitest-5.26.2.gem
  * mutex_m-0.3.0.gem
  * securerandom-0.3.2.gem
  * tzinfo-2.0.6.gem
  * activesupport-7.1.6.gem
  * public_suffix-6.0.2.gem
  * addressable-2.8.8.gem
  * andand-1.3.3.gem
  * extlib-0.9.16.gem
  * multi_json-1.18.0.gem
  * autoparse-0.3.3.gem
  * uri-1.1.1.gem
  * net-http-0.8.0.gem
  * faraday-net_http-3.4.2.gem
  * json-2.16.0.gem
  * faraday-2.13.4.gem
  * zlib-3.2.2.gem
  * faraday-gzip-3.0.4.gem
  * multipart-post-2.4.1.gem
  * faraday-multipart-1.1.1.gem
  * google-cloud-env-2.2.2.gem
  * google-logging-utils-0.2.0.gem
  * jwt-1.5.6.gem
  * os-1.1.4.gem
  * signet-0.19.0.gem
  * googleauth-1.15.1.gem
  * childprocess-5.1.0.gem
  * launchy-3.0.1.gem
  * retriable-1.4.1.gem
  * arvados-google-api-client-0.8.7.16.gem
  * ruby2_keywords-0.0.5.gem
  * mocha-2.8.2.gem
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
  Successfully built RubyGem
  Name: arvados
  Version: 3.2.0.dev20250908213630
  File: arvados-3.2.0.dev20250908213630.gem
Building native extensions. This could take a while...
Successfully installed json-2.18.0
Successfully installed arvados-3.2.0.dev20250908213630
2 gems installed
======= install sdk/ruby -- 12s
======= install contrib/R-sdk
======= install contrib/R-sdk -- 0s
======= install sdk/cli
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Resolving dependencies...
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Bundle complete! 3 Gemfile dependencies, 46 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Bundle complete! 3 Gemfile dependencies, 46 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
Updating files in vendor/cache
  * rake-13.3.1.gem
  * base64-0.3.0.gem
  * benchmark-0.5.0.gem
  * bigdecimal-3.3.1.gem
  * concurrent-ruby-1.3.5.gem
  * connection_pool-2.5.5.gem
  * drb-2.2.3.gem
  * i18n-1.14.7.gem
  * logger-1.7.0.gem
  * minitest-5.26.2.gem
  * mutex_m-0.3.0.gem
  * securerandom-0.3.2.gem
  * tzinfo-2.0.6.gem
  * activesupport-7.1.6.gem
  * public_suffix-6.0.2.gem
  * addressable-2.8.8.gem
  * andand-1.3.3.gem
  * extlib-0.9.16.gem
  * multi_json-1.18.0.gem
  * autoparse-0.3.3.gem
  * uri-1.1.1.gem
  * net-http-0.8.0.gem
  * faraday-net_http-3.4.2.gem
  * json-2.18.0.gem
  * faraday-2.13.4.gem
  * zlib-3.2.2.gem
  * faraday-gzip-3.0.4.gem
  * multipart-post-2.4.1.gem
  * faraday-multipart-1.1.1.gem
  * google-cloud-env-2.2.2.gem
  * google-logging-utils-0.2.0.gem
  * jwt-1.5.6.gem
  * os-1.1.4.gem
  * signet-0.19.0.gem
  * googleauth-1.15.1.gem
  * childprocess-5.1.0.gem
  * launchy-3.0.1.gem
  * retriable-1.4.1.gem
  * arvados-google-api-client-0.8.7.16.gem
  * arvados-3.2.0.gem
  * curb-1.2.2.gem
  * ostruct-0.6.3.gem
  * oj-3.16.12.gem
  * optimist-3.2.1.gem
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
  Successfully built RubyGem
  Name: arvados-cli
  Version: 3.2.0.dev20250908213630
  File: arvados-cli-3.2.0.dev20250908213630.gem
Successfully installed arvados-cli-3.2.0.dev20250908213630
1 gem installed
======= install sdk/cli -- 4s
======= install services/login-sync
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Resolving dependencies...
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Bundle complete! 4 Gemfile dependencies, 44 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
Bundle complete! 4 Gemfile dependencies, 44 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
Updating files in vendor/cache
  * rake-13.3.1.gem
  * base64-0.3.0.gem
  * benchmark-0.5.0.gem
  * bigdecimal-3.3.1.gem
  * concurrent-ruby-1.3.5.gem
  * connection_pool-2.5.5.gem
  * drb-2.2.3.gem
  * i18n-1.14.7.gem
  * logger-1.7.0.gem
  * minitest-5.26.2.gem
  * mutex_m-0.3.0.gem
  * securerandom-0.3.2.gem
  * tzinfo-2.0.6.gem
  * activesupport-7.1.6.gem
  * public_suffix-6.0.2.gem
  * addressable-2.8.8.gem
  * andand-1.3.3.gem
  * extlib-0.9.16.gem
  * multi_json-1.18.0.gem
  * autoparse-0.3.3.gem
  * uri-1.1.1.gem
  * net-http-0.8.0.gem
  * faraday-net_http-3.4.2.gem
  * json-2.18.0.gem
  * faraday-2.13.4.gem
  * zlib-3.2.2.gem
  * faraday-gzip-3.0.4.gem
  * multipart-post-2.4.1.gem
  * faraday-multipart-1.1.1.gem
  * google-cloud-env-2.2.2.gem
  * google-logging-utils-0.2.0.gem
  * jwt-1.5.6.gem
  * os-1.1.4.gem
  * signet-0.19.0.gem
  * googleauth-1.15.1.gem
  * childprocess-5.1.0.gem
  * launchy-3.0.1.gem
  * retriable-1.4.1.gem
  * arvados-google-api-client-0.8.7.16.gem
  * arvados-3.2.0.gem
  * ruby2_keywords-0.0.5.gem
  * mocha-2.8.2.gem
WARN: Unresolved or ambiguous specs during Gem::Specification.reset:
      stringio (>= 0)
      Available/installed versions of this gem:
      - 3.1.7
      - 3.0.1.2
WARN: Clearing out unresolved specs. Try 'gem cleanup <gem>'
Please report a bug if this causes problems.
  Successfully built RubyGem
  Name: arvados-login-sync
  Version: 3.2.0.dev20250908213630
  File: arvados-login-sync-3.2.0.dev20250908213630.gem
Successfully installed arvados-login-sync-3.2.0.dev20250908213630
1 gem installed
======= install services/login-sync -- 4s
======= install sdk/python
Processing /tmp/workspace/run-tests-remainder/sdk/python
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: pyparsing<4,>=3.0.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from httplib2>=0.9.2->arvados-python-client==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: requests<3.0.0,>=2.18.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: six>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.43.0,>=1.42.0->boto3->arvados-python-client==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (3.11)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (3.4.4)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client==3.3.0.dev20251121214649) (2025.11.12)
Building wheels for collected packages: arvados-python-client
  Building wheel for arvados-python-client (pyproject.toml): started
  Building wheel for arvados-python-client (pyproject.toml): finished with status 'done'
  Created wheel for arvados-python-client: filename=arvados_python_client-3.3.0.dev20251121214649-py3-none-any.whl size=327292 sha256=8c0981eaa4be4532b7be98fd363c9851754f10afdf7eacd8db7cb453dc4a7478
  Stored in directory: /tmp/pip-ephem-wheel-cache-1adzkx8s/wheels/0a/9d/c1/465c6876961d3d82358a7aa7b843ec033a351684243edd68fe
Successfully built arvados-python-client
Installing collected packages: arvados-python-client
  Attempting uninstall: arvados-python-client
    Found existing installation: arvados-python-client 3.3.0.dev20251121214649
    Uninstalling arvados-python-client-3.3.0.dev20251121214649:
      Successfully uninstalled arvados-python-client-3.3.0.dev20251121214649
Successfully installed arvados-python-client-3.3.0.dev20251121214649
======= install sdk/python -- 4s
======= install tools/crunchstat-summary
Processing /tmp/workspace/run-tests-remainder/tools/crunchstat-summary
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: arvados-python-client~=3.3.0.dev0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from crunchstat_summary==3.3.0.dev20251121214649) (3.3.0.dev20251121214649)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: pyparsing<4,>=3.0.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from httplib2>=0.9.2->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: requests<3.0.0,>=2.18.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: six>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (3.11)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (2025.11.12)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->crunchstat_summary==3.3.0.dev20251121214649) (3.4.4)
Building wheels for collected packages: crunchstat_summary
  Building wheel for crunchstat_summary (pyproject.toml): started
  Building wheel for crunchstat_summary (pyproject.toml): finished with status 'done'
  Created wheel for crunchstat_summary: filename=crunchstat_summary-3.3.0.dev20251121214649-py3-none-any.whl size=47221 sha256=0f6ecf7de0404ceb77e21ea96c39a9665cdafb36f4a0c7e00b8b595867a23965
  Stored in directory: /home/jenkins/.cache/pip/wheels/89/84/37/20cc05779f49bef6268887523391485ae130b2fab47d13b38c
Successfully built crunchstat_summary
Installing collected packages: crunchstat_summary
  Attempting uninstall: crunchstat_summary
    Found existing installation: crunchstat_summary 3.3.0.dev20251121214649
    Uninstalling crunchstat_summary-3.3.0.dev20251121214649:
      Successfully uninstalled crunchstat_summary-3.3.0.dev20251121214649
Successfully installed crunchstat_summary-3.3.0.dev20251121214649
======= install tools/crunchstat-summary -- 4s
======= install sdk/cwl
Processing /tmp/workspace/run-tests-remainder/sdk/cwl
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: crunchstat_summary~=3.3.0.dev0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cwl-runner==3.3.0.dev20251121214649) (3.3.0.dev20251121214649)
Requirement already satisfied: schema-salad==8.5.20240503091721 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cwl-runner==3.3.0.dev20251121214649) (8.5.20240503091721)
Requirement already satisfied: arvados-python-client~=3.3.0.dev0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cwl-runner==3.3.0.dev20251121214649) (3.3.0.dev20251121214649)
Requirement already satisfied: cwltool==3.1.20240508115724 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cwl-runner==3.3.0.dev20251121214649) (3.1.20240508115724)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cwl-runner==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: setuptools in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (80.9.0)
Requirement already satisfied: pydot>=1.4.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (4.0.1)
Requirement already satisfied: argcomplete in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.6.3)
Requirement already satisfied: cwl-utils>=0.32 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (0.35)
Requirement already satisfied: mypy-extensions in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (1.1.0)
Requirement already satisfied: prov==1.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (1.5.1)
Requirement already satisfied: rdflib<7.1.0,>=4.2.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (7.0.0)
Requirement already satisfied: ruamel.yaml<0.19,>=0.16 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (0.18.16)
Requirement already satisfied: spython>=0.3.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (0.3.14)
Requirement already satisfied: shellescape<3.9,>=3.4.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.8.1)
Requirement already satisfied: pyparsing!=3.0.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: requests>=2.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: psutil>=5.6.6 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (7.1.3)
Requirement already satisfied: coloredlogs in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: mistune<3.1,>=3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad==8.5.20240503091721->arvados-cwl-runner==3.3.0.dev20251121214649) (3.0.2)
Requirement already satisfied: CacheControl[filecache]<0.15,>=0.11.7 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from schema-salad==8.5.20240503091721->arvados-cwl-runner==3.3.0.dev20251121214649) (0.14.4)
Requirement already satisfied: lxml in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from prov==1.5.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (6.0.2)
Requirement already satisfied: six>=1.9.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from prov==1.5.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: python-dateutil in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from prov==1.5.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: networkx in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from prov==1.5.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.4.2)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: msgpack<2.0.0,>=0.5.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from CacheControl[filecache]<0.15,>=0.11.7->schema-salad==8.5.20240503091721->arvados-cwl-runner==3.3.0.dev20251121214649) (1.1.2)
Requirement already satisfied: filelock>=3.8.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from CacheControl[filecache]<0.15,>=0.11.7->schema-salad==8.5.20240503091721->arvados-cwl-runner==3.3.0.dev20251121214649) (3.20.0)
Requirement already satisfied: cwl-upgrader>=1.2.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwl-utils>=0.32->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (1.2.12)
Requirement already satisfied: packaging in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from cwl-utils>=0.32->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (25.0)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: isodate<0.7.0,>=0.6.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from rdflib<7.1.0,>=4.2.2->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.6.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (2025.11.12)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.6.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.4.4)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.6.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (3.11)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.6.1->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from ruamel.yaml<0.19,>=0.16->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (0.2.15)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: humanfriendly>=9.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from coloredlogs->cwltool==3.1.20240508115724->arvados-cwl-runner==3.3.0.dev20251121214649) (10.0)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client~=3.3.0.dev0->arvados-cwl-runner==3.3.0.dev20251121214649) (0.6.1)
Building wheels for collected packages: arvados-cwl-runner
  Building wheel for arvados-cwl-runner (pyproject.toml): started
  Building wheel for arvados-cwl-runner (pyproject.toml): finished with status 'done'
  Created wheel for arvados-cwl-runner: filename=arvados_cwl_runner-3.3.0.dev20251121214649-py3-none-any.whl size=91370 sha256=066d892b74203986984d03c29dc6dd720b1f8f38fb3b4e59c589d7b203ff7b59
  Stored in directory: /tmp/pip-ephem-wheel-cache-jfvpvyzk/wheels/4d/48/1e/dc508ee1e9c7c5dcfb6088b0bfb9c28ed703ad2804f6ba8bee
Successfully built arvados-cwl-runner
Installing collected packages: arvados-cwl-runner
  Attempting uninstall: arvados-cwl-runner
    Found existing installation: arvados-cwl-runner 3.3.0.dev20251121214649
    Uninstalling arvados-cwl-runner-3.3.0.dev20251121214649:
      Successfully uninstalled arvados-cwl-runner-3.3.0.dev20251121214649
Successfully installed arvados-cwl-runner-3.3.0.dev20251121214649
======= install sdk/cwl -- 4s
======= install services/dockercleaner
Processing /tmp/workspace/run-tests-remainder/services/dockercleaner
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: docker>=6.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-docker-cleaner==3.3.0.dev20251118205831) (7.1.0)
Requirement already satisfied: requests>=2.26.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from docker>=6.1.0->arvados-docker-cleaner==3.3.0.dev20251118205831) (2.32.5)
Requirement already satisfied: urllib3>=1.26.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from docker>=6.1.0->arvados-docker-cleaner==3.3.0.dev20251118205831) (2.5.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.26.0->docker>=6.1.0->arvados-docker-cleaner==3.3.0.dev20251118205831) (3.4.4)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.26.0->docker>=6.1.0->arvados-docker-cleaner==3.3.0.dev20251118205831) (2025.11.12)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests>=2.26.0->docker>=6.1.0->arvados-docker-cleaner==3.3.0.dev20251118205831) (3.11)
Building wheels for collected packages: arvados-docker-cleaner
  Building wheel for arvados-docker-cleaner (pyproject.toml): started
  Building wheel for arvados-docker-cleaner (pyproject.toml): finished with status 'done'
  Created wheel for arvados-docker-cleaner: filename=arvados_docker_cleaner-3.3.0.dev20251118205831-py3-none-any.whl size=31619 sha256=6ad25d2c79b147243e2ec8829f70559d86af576d0ce57a1784306b07bc57dc2e
  Stored in directory: /tmp/pip-ephem-wheel-cache-2amjxqir/wheels/f8/9f/d6/c817325392b56a74ad3bb08d9bd62acfe64a50baeb17db7e76
Successfully built arvados-docker-cleaner
Installing collected packages: arvados-docker-cleaner
  Attempting uninstall: arvados-docker-cleaner
    Found existing installation: arvados-docker-cleaner 3.3.0.dev20251118205831
    Uninstalling arvados-docker-cleaner-3.3.0.dev20251118205831:
      Successfully uninstalled arvados-docker-cleaner-3.3.0.dev20251118205831
Successfully installed arvados-docker-cleaner-3.3.0.dev20251118205831
======= install services/dockercleaner -- 3s
======= install services/fuse
Processing /tmp/workspace/run-tests-remainder/services/fuse
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: prometheus_client in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (0.23.1)
Requirement already satisfied: python-daemon in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (3.1.2)
Requirement already satisfied: arvados-llfuse>=1.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (1.5.2)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: setuptools in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (80.9.0)
Requirement already satisfied: arvados-python-client~=3.3.0.dev0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados_fuse==3.3.0.dev20251121214649) (3.3.0.dev20251121214649)
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: lockfile>=0.10 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-daemon->arvados_fuse==3.3.0.dev20251121214649) (0.12.2)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: pyparsing<4,>=3.0.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from httplib2>=0.9.2->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: requests<3.0.0,>=2.18.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: six>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (3.4.4)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (2025.11.12)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados_fuse==3.3.0.dev20251121214649) (3.11)
Building wheels for collected packages: arvados_fuse
  Building wheel for arvados_fuse (pyproject.toml): started
  Building wheel for arvados_fuse (pyproject.toml): finished with status 'done'
  Created wheel for arvados_fuse: filename=arvados_fuse-3.3.0.dev20251121214649-py3-none-any.whl size=63249 sha256=8f69eaeb3da74fcb4e5d38cdd19ac891f0d9514736559c027603a9337e9ec4e9
  Stored in directory: /tmp/pip-ephem-wheel-cache-b7i3sacm/wheels/96/f2/a4/4a09aab4e09eafeebe5bd53aa03af7e8924f5d975e64719aa9
Successfully built arvados_fuse
Installing collected packages: arvados_fuse
  Attempting uninstall: arvados_fuse
    Found existing installation: arvados_fuse 3.3.0.dev20251121214649
    Uninstalling arvados_fuse-3.3.0.dev20251121214649:
      Successfully uninstalled arvados_fuse-3.3.0.dev20251121214649
Successfully installed arvados_fuse-3.3.0.dev20251121214649
======= install services/fuse -- 3s
======= install tools/cluster-activity
Processing /tmp/workspace/run-tests-remainder/tools/cluster-activity
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: arvados-python-client~=3.3.0.dev0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-cluster-activity==3.3.0.dev20251121214649) (3.3.0.dev20251121214649)
Requirement already satisfied: httplib2>=0.9.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (0.31.0)
Requirement already satisfied: google-auth in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.43.0)
Requirement already satisfied: boto3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: websockets>=11.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (15.0.1)
Requirement already satisfied: google-api-python-client>=2.1.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.187.0)
Requirement already satisfied: ciso8601>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.3.3)
Requirement already satisfied: pycurl>=7.19.5.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (7.45.7)
Requirement already satisfied: uritemplate<5,>=3.0.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (4.2.0)
Requirement already satisfied: google-auth-httplib2<1.0.0,>=0.2.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (0.2.1)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.28.1)
Requirement already satisfied: cachetools<7.0,>=2.0.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (6.2.2)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (0.4.2)
Requirement already satisfied: rsa<5,>=3.1.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-auth->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (4.9.1)
Requirement already satisfied: pyparsing<4,>=3.0.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from httplib2>=0.9.2->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (3.2.5)
Requirement already satisfied: s3transfer<0.17.0,>=0.16.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (0.16.0)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.0.1)
Requirement already satisfied: botocore<1.43.0,>=1.42.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.42.1)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.5.0)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.9.0.post0)
Requirement already satisfied: googleapis-common-protos<2.0.0,>=1.56.2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.72.0)
Requirement already satisfied: requests<3.0.0,>=2.18.0 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2.32.5)
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<7.0.0,>=3.19.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (6.33.1)
Requirement already satisfied: proto-plus<2.0.0,>=1.22.3 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.26.1)
Requirement already satisfied: pyasn1<0.7.0,>=0.6.1 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (0.6.1)
Requirement already satisfied: six>=1.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.43.0,>=1.42.0->boto3->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (1.17.0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (2025.11.12)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (3.4.4)
Requirement already satisfied: idna<4,>=2.5 in /home/jenkins/tmp/VENV3DIR/lib/python3.10/site-packages (from requests<3.0.0,>=2.18.0->google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0,>=1.31.5->google-api-python-client>=2.1.0->arvados-python-client~=3.3.0.dev0->arvados-cluster-activity==3.3.0.dev20251121214649) (3.11)
Building wheels for collected packages: arvados-cluster-activity
  Building wheel for arvados-cluster-activity (pyproject.toml): started
  Building wheel for arvados-cluster-activity (pyproject.toml): finished with status 'done'
  Created wheel for arvados-cluster-activity: filename=arvados_cluster_activity-3.3.0.dev20251121214649-py3-none-any.whl size=51645 sha256=154abe952162f89dd53582b8666a2148ad9e2ad63c929de8493a9d03e0f24f62
  Stored in directory: /home/jenkins/.cache/pip/wheels/17/79/71/2f28e72175277ca88e4b52ad4396b5b4c43080e15ff9fe843a
Successfully built arvados-cluster-activity
Installing collected packages: arvados-cluster-activity
  Attempting uninstall: arvados-cluster-activity
    Found existing installation: arvados-cluster-activity 3.3.0.dev20251121214649
    Uninstalling arvados-cluster-activity-3.3.0.dev20251121214649:
      Successfully uninstalled arvados-cluster-activity-3.3.0.dev20251121214649
Successfully installed arvados-cluster-activity-3.3.0.dev20251121214649
======= install tools/cluster-activity -- 3s
======= install cmd/arvados-client
======= install cmd/arvados-client -- 4s
======= install cmd/arvados-server
======= install cmd/arvados-server -- 44s
======= install lib/boot
======= install lib/boot -- 0s
======= install lib/cli
======= install lib/cli -- 0s
======= install lib/cloud
======= install lib/cloud -- 0s
======= install lib/cloud/azure
======= install lib/cloud/azure -- 0s
======= install lib/cloud/cloudtest
======= install lib/cloud/cloudtest -- 0s
======= install lib/cloud/ec2
======= install lib/cloud/ec2 -- 0s
======= install lib/cloud/loopback
======= install lib/cloud/loopback -- 0s
======= install lib/cmd
======= install lib/cmd -- 0s
======= install lib/cmdtest
======= install lib/cmdtest -- 0s
======= install lib/config
======= install lib/config -- 0s
======= install lib/controller
======= install lib/controller -- 1s
======= install lib/controller/api
======= install lib/controller/api -- 0s
======= install lib/controller/dblock
======= install lib/controller/dblock -- 0s
======= install lib/controller/federation
======= install lib/controller/federation -- 0s
======= install lib/controller/localdb
======= install lib/controller/localdb -- 0s
======= install lib/controller/railsproxy
======= install lib/controller/railsproxy -- 0s
======= install lib/controller/router
======= install lib/controller/router -- 0s
======= install lib/controller/rpc
======= install lib/controller/rpc -- 0s
======= install lib/crunchrun
======= install lib/crunchrun -- 0s
======= install lib/crunchstat
======= install lib/crunchstat -- 0s
======= install lib/ctrlctx
======= install lib/ctrlctx -- 0s
======= install lib/deduplicationreport
======= install lib/deduplicationreport -- 0s
======= install lib/diagnostics
======= install lib/diagnostics -- 0s
======= install lib/dispatchcloud
======= install lib/dispatchcloud -- 1s
======= install lib/dispatchcloud/container
======= install lib/dispatchcloud/container -- 0s
======= install lib/dispatchcloud/scheduler
======= install lib/dispatchcloud/scheduler -- 0s
======= install lib/dispatchcloud/sshexecutor
======= install lib/dispatchcloud/sshexecutor -- 0s
======= install lib/dispatchcloud/test
======= install lib/dispatchcloud/test -- 0s
======= install lib/dispatchcloud/worker
======= install lib/dispatchcloud/worker -- 0s
======= install lib/lsf
======= install lib/lsf -- 0s
======= install lib/mount
======= install lib/mount -- 0s
======= install lib/pam
======= install lib/pam -- 1s
======= install lib/recovercollection
======= install lib/recovercollection -- 0s
======= install lib/selfsigned
======= install lib/selfsigned -- 0s
======= install lib/service
======= install lib/service -- 0s
======= install lib/webdavfs
======= install lib/webdavfs -- 0s
======= install sdk/go/arvados
======= install sdk/go/arvados -- 0s
======= install sdk/go/arvadosclient
======= install sdk/go/arvadosclient -- 0s
======= install sdk/go/arvadostest
======= install sdk/go/arvadostest -- 0s
======= install sdk/go/asyncbuf
======= install sdk/go/asyncbuf -- 0s
======= install sdk/go/auth
======= install sdk/go/auth -- 0s
======= install sdk/go/blockdigest
======= install sdk/go/blockdigest -- 0s
======= install sdk/go/config
======= install sdk/go/config -- 0s
======= install sdk/go/ctxlog
======= install sdk/go/ctxlog -- 0s
======= install sdk/go/dispatch
======= install sdk/go/dispatch -- 0s
======= install sdk/go/health
======= install sdk/go/health -- 1s
======= install sdk/go/httpserver
======= install sdk/go/httpserver -- 0s
======= install sdk/go/keepclient
======= install sdk/go/keepclient -- 0s
======= install sdk/go/stats
======= install sdk/go/stats -- 0s
======= install services/crunch-dispatch-local
======= install services/crunch-dispatch-local -- 1s
======= install services/crunch-dispatch-slurm
======= install services/crunch-dispatch-slurm -- 0s
======= install services/keep-balance
======= install services/keep-balance -- 0s
======= install services/keepproxy
======= install services/keepproxy -- 0s
======= install services/keepstore
======= install services/keepstore -- 0s
======= install services/keep-web
======= install services/keep-web -- 0s
======= install services/ws
======= install services/ws -- 0s
======= install tools/keep-block-check
======= install tools/keep-block-check -- 0s
======= install tools/keep-exercise
======= install tools/keep-exercise -- 1s
======= install tools/keep-rsync
======= install tools/keep-rsync -- 1s
======= install tools/sync-groups
======= install tools/sync-groups -- 1s
======= install tools/sync-users
======= install tools/sync-users -- 1s
======= install services/api
(Running bundle install --local. 'could not find package' messages are OK.)
[DEPRECATED] The `--no-deployment` flag is deprecated because it relies on being remembered across bundler invocations, which bundler will no longer do in future versions. Instead please use `bundle config set deployment false`, and stop using this flag
Bundle complete! 35 Gemfile dependencies, 127 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
Bundle complete! 35 Gemfile dependencies, 127 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
1 installed gem you directly depend on is looking for funding.
  Run `bundle fund` for details
Updating files in vendor/cache
  * rake-13.3.0.gem
  * base64-0.3.0.gem
  * benchmark-0.4.1.gem
  * bigdecimal-3.2.3.gem
  * concurrent-ruby-1.3.5.gem
  * connection_pool-2.5.4.gem
  * drb-2.2.3.gem
  * i18n-1.14.7.gem
  * logger-1.7.0.gem
  * minitest-5.25.5.gem
  * mutex_m-0.3.0.gem
  * securerandom-0.3.2.gem
  * tzinfo-2.0.6.gem
  * activesupport-7.1.5.2.gem
  * builder-3.3.0.gem
  * erubi-1.13.1.gem
  * racc-1.8.1.gem
  * nokogiri-1.17.2-x86_64-linux.gem
  * rails-dom-testing-2.3.0.gem
  * crass-1.0.6.gem
  * loofah-2.24.1.gem
  * rails-html-sanitizer-1.6.2.gem
  * actionview-7.1.5.2.gem
  * rack-3.2.3.gem
  * rack-session-2.1.1.gem
  * rack-test-2.2.0.gem
  * actionpack-7.1.5.2.gem
  * nio4r-2.7.4.gem
  * websocket-extensions-0.1.5.gem
  * websocket-driver-0.8.0.gem
  * zeitwerk-2.6.18.gem
  * actioncable-7.1.5.2.gem
  * globalid-1.2.1.gem
  * activejob-7.1.5.2.gem
  * activemodel-7.1.5.2.gem
  * timeout-0.4.3.gem
  * activerecord-7.1.5.2.gem
  * marcel-1.0.4.gem
  * activestorage-7.1.5.2.gem
  * mini_mime-1.1.5.gem
  * date-3.4.1.gem
  * net-protocol-0.2.2.gem
  * net-imap-0.4.22.gem
  * net-pop-0.1.2.gem
  * net-smtp-0.5.1.gem
  * mail-2.8.1.gem
  * actionmailbox-7.1.5.2.gem
  * actionmailer-7.1.5.2.gem
  * actiontext-7.1.5.2.gem
  * acts_as_api-1.0.1.gem
  * public_suffix-6.0.2.gem
  * addressable-2.8.7.gem
  * andand-1.3.3.gem
  * extlib-0.9.16.gem
  * multi_json-1.17.0.gem
  * autoparse-0.3.3.gem
  * uri-1.0.3.gem
  * net-http-0.6.0.gem
  * faraday-net_http-3.4.1.gem
  * json-2.13.2.gem
  * faraday-2.13.4.gem
  * zlib-3.2.1.gem
  * faraday-gzip-3.0.4.gem
  * multipart-post-2.4.1.gem
  * faraday-multipart-1.1.1.gem
  * google-cloud-env-2.2.2.gem
  * google-logging-utils-0.2.0.gem
  * jwt-1.5.6.gem
  * os-1.1.4.gem
  * signet-0.19.0.gem
  * googleauth-1.15.0.gem
  * childprocess-5.1.0.gem
  * launchy-3.0.1.gem
  * retriable-1.4.1.gem
  * arvados-google-api-client-0.8.7.16.gem
  * arvados-3.2.0.gem
  * byebug-11.1.3.gem
  * cgi-0.5.0.gem
  * docile-1.4.1.gem
  * erb-4.0.4.gem
  * factory_bot-6.5.5.gem
  * prettyprint-0.2.0.gem
  * pp-0.6.2.gem
  * stringio-3.1.7.gem
  * psych-5.2.6.gem
  * rdoc-6.14.2.gem
  * io-console-0.8.1.gem
  * reline-0.6.2.gem
  * irb-1.15.2.gem
  * rackup-2.2.1.gem
  * thor-1.4.0.gem
  * railties-7.1.5.2.gem
  * factory_bot_rails-6.5.0.gem
  * ffi-1.17.2.gem
  * hash_validator-2.0.1.gem
  * httpclient-2.9.0.gem
  * jquery-rails-4.6.0.gem
  * rb-fsevent-0.11.2.gem
  * rb-inotify-0.11.1.gem
  * listen-3.9.0.gem
  * request_store-1.7.0.gem
  * lograge-0.14.0.gem
  * logstash-event-1.2.02.gem
  * mini_portile2-2.8.9.gem
  * ruby2_keywords-0.0.5.gem
  * mocha-2.7.1.gem
  * ostruct-0.6.3.gem
  * oj-3.16.11.gem
  * optimist-3.2.1.gem
  * passenger-6.0.27.gem
  * pg-1.6.2.gem
  * power_assert-2.0.5.gem
  * rails-7.1.5.2.gem
  * rails-controller-testing-1.0.5.gem
  * rails-observers-0.1.5.gem
  * rails-perftest-0.0.7.gem
  * responders-3.1.1.gem
  * ruby-prof-1.7.2.gem
  * simplecov-html-0.13.2.gem
  * simplecov_json_formatter-0.1.4.gem
  * simplecov-0.22.0.gem
  * simplecov-rcov-0.3.7.gem
  * sprockets-4.2.2.gem
  * sprockets-rails-3.5.2.gem
  * test-unit-3.7.0.gem
  * webrick-1.9.1.gem
....+.....+.+........+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*................+.....+.+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+..................+.....+.........+......+.......+...+........+......+...+.+.....+.........+.+......+...+...+........+.+...........+...............+.......+........+.............+..+....+...+.....+..................+.......+...........+......+......+.......+..+...+..........+...........+.........+...+....+.....+.+..+............+.+.........+...........+...+....+..+....+..+...................+...+....................+.+..+.......+..+.........+.+....................+.+........+....+..+.+...+.....+..........+......+..........................+....+........+...............+......+.+...+...+........+.+...+...........+....+......+......+.....+...+.+.........+...+..+.+.....+.+.....+.........+.+.......................+......+.+...+......+..+..........+..+.+...........+.............+......+..+...+.+.....+................+...+..+....+.....+......+..................+....+..+...+...............+...+....+.........+.........+..+.........+.+...........+...+.......+..+.........................+......+..+....+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
......+........+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+..................+...............+...+..+.......+..+...+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..........+.....+....+..+.+...+..+....+...+........+...+.......+..+......+.......+.........+.........+..+...+.........+.............+........+....+......+......+.....+...+.+.........+...+........+.........+......+......................+..+................+.........+...+...+..+.............+..+..........+........+......+....+............+.....+...+.+......+..+..........+......+..+...+.........+.+...........+..................+......+.+......+...+.....+......+.........+.+...+..+.+............+........+.........+.+...+......+...+........+....+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-----
Certificate request self-signature ok
subject=C = US, ST = State, L = City, CN = localhost
+ cd /tmp/workspace/run-tests-remainder/services/api
+ export RAILS_ENV=test
+ RAILS_ENV=test
+ bin/rails db:environment:set
Defaulting to memory cache, because /tmp/workspace/run-tests-remainder/services/api/tmp/cache does not exist
+ bin/rake db:drop
Defaulting to memory cache, because /tmp/workspace/run-tests-remainder/services/api/tmp/cache does not exist
Dropped database 'arvados_test'
+ bin/rake db:setup
Defaulting to memory cache, because /tmp/workspace/run-tests-remainder/services/api/tmp/cache does not exist
Created database 'arvados_test'
+ bin/rake db:fixtures:load
Defaulting to memory cache, because /tmp/workspace/run-tests-remainder/services/api/tmp/cache does not exist
======= install services/api -- 15s
======= install services/workbench2
yarn install
➤ YN0000: ┌ Resolution step
➤ YN0002: │ @coreui/coreui@npm:4.3.2 [f1240] doesn't provide postcss (pb5968), requested by postcss-combine-duplicated-selectors
➤ YN0060: │ arvados-workbench-2@workspace:. provides @coreui/coreui (p399b5) with version 4.3.2, which doesn't satisfy what @coreui/react requests
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (p7649e), requested by @coreui/coreui
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (p89fa5), requested by bootstrap
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (pf8400), requested by popper-max-size-modifier
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide history (pd5686), requested by connected-react-router
➤ YN0060: │ arvados-workbench-2@workspace:. provides node-sass (pb7041) with version 9.0.0, which doesn't satisfy what sass-loader requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p27aeb) with version 17.0.2, which doesn't satisfy what @fortawesome/react-fontawesome requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pee4fb) with version 17.0.2, which doesn't satisfy what react-dnd and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pf5923) with version 17.0.2, which doesn't satisfy what react-dom requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p278ae) with version 17.0.2, which doesn't satisfy what react-highlight-words requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p3a545) with version 17.0.2, which doesn't satisfy what react-idle-timer requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p179ab) with version 17.0.2, which doesn't satisfy what react-redux requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pe562a) with version 17.0.2, which doesn't satisfy what react-splitter-layout requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p4a88d) with version 17.0.2, which doesn't satisfy what react-virtualized-auto-sizer requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pfde37) with version 17.0.2, which doesn't satisfy what react-window requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p14a77) with version 17.0.2, which doesn't satisfy what redux-devtools requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (p83810) with version 16.14.0, which doesn't satisfy what @coreui/react requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (pe71f1) with version 16.14.0, which doesn't satisfy what @mui/material and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (pf8b2f) with version 16.14.0, which doesn't satisfy what @mui/x-date-pickers and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-redux (pdee57) with version 6.0.1, which doesn't satisfy what redux-devtools requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides redux (p1ed3a) with version 4.0.3, which doesn't satisfy what redux-devtools and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides typescript (p920f2) with version 4.3.4, which doesn't satisfy what tslint-etc and some of its descendants request
➤ YN0002: │ eslint-config-react-app@npm:7.0.1 [f1240] doesn't provide @babel/plugin-syntax-flow (p900d0), requested by eslint-plugin-flowtype
➤ YN0002: │ eslint-config-react-app@npm:7.0.1 [f1240] doesn't provide @babel/plugin-transform-react-jsx (p8598a), requested by eslint-plugin-flowtype
➤ YN0002: │ react-dev-utils@npm:12.0.1 doesn't provide typescript (p9c21e), requested by fork-ts-checker-webpack-plugin
➤ YN0002: │ react-dev-utils@npm:12.0.1 doesn't provide webpack (p882e9), requested by fork-ts-checker-webpack-plugin
➤ YN0000: │ Some peer dependencies are incorrectly met; run yarn explain peer-requirements <hash> for details, where <hash> is the six-letter p-prefixed code
➤ YN0000: └ Completed in 0s 226ms
➤ YN0000: ┌ Fetch step
➤ YN0013: │  - one package was already cached, 1787 had to be fetched
➤ YN0000: └ Completed in 0s 636ms
➤ YN0000: ┌ Link step
➤ YN0007: │ cypress@npm:13.6.6 must be built because it never has been before or the last one failed
➤ YN0007: │ node-sass@npm:9.0.0 must be built because it never has been before or the last one failed
➤ YN0007: │ core-js@npm:3.37.1 must be built because it never has been before or the last one failed
➤ YN0007: │ core-js@npm:2.6.12 must be built because it never has been before or the last one failed
➤ YN0007: │ @fortawesome/fontawesome-common-types@npm:0.2.35 must be built because it never has been before or the last one failed
➤ YN0007: │ core-js-pure@npm:3.37.1 must be built because it never has been before or the last one failed
➤ YN0007: │ core-js@npm:3.15.1 must be built because it never has been before or the last one failed
➤ YN0000: │ @fortawesome/fontawesome-common-types@npm:0.2.35 STDOUT Font Awesome Free 0.2.35 by @fontawesome - https://fontawesome.com
➤ YN0000: │ @fortawesome/fontawesome-common-types@npm:0.2.35 STDOUT License - https://fontawesome.com/license/free (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License)
➤ YN0000: │ @fortawesome/fontawesome-common-types@npm:0.2.35 STDOUT 
➤ YN0000: │ cypress@npm:13.6.6 STDOUT 
➤ YN0000: │ cypress@npm:13.6.6 STDOUT Cypress 13.6.6 is installed in /home/jenkins/.cache/Cypress/13.6.6
➤ YN0000: │ cypress@npm:13.6.6 STDOUT 
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Downloading binary from https://github.com/sass/node-sass/releases/download/v9.0.0/linux-x64-115_binding.node
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Download complete
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Binary saved to /tmp/workspace/run-tests-remainder/services/workbench2/node_modules/node-sass/vendor/linux-x64-115/binding.node
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Binary found at /tmp/workspace/run-tests-remainder/services/workbench2/node_modules/node-sass/vendor/linux-x64-115/binding.node
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Testing binary
➤ YN0000: │ node-sass@npm:9.0.0 STDOUT Binary is fine
➤ YN0000: └ Completed in 21s 546ms
➤ YN0000: Done with warnings in 22s 676ms
======= install services/workbench2 -- 23s
======= test gofmt
======= test gofmt -- 16s
======= test arvados_version.py
======= test arvados_version.py -- 0s
Starting API, controller, keepproxy, keep-web, ws, and nginx ssl proxy...
waiting for port 48163...
api pid 15484 ok
https://127.0.0.1:48163/discovery/v1/apis/arvados/v1/rest ok
2025/12/12 21:30:39 [notice] 15627#15627: using the "epoll" event method
2025/12/12 21:30:39 [notice] 15627#15627: nginx/1.22.1
2025/12/12 21:30:39 [notice] 15627#15627: OS: Linux 6.1.0-41-cloud-amd64
2025/12/12 21:30:39 [notice] 15627#15627: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2025/12/12 21:30:39 [notice] 15627#15627: start worker processes
2025/12/12 21:30:39 [notice] 15627#15627: start worker process 15630
nginx pid 15627 ok
controller pid 15634 ok
{"health":"OK"}
{"health":"OK"}
https://0.0.0.0:49697/discovery/v1/apis/arvados/v1/rest ok
Using API 0.0.0.0:49697 token 4axaw8zxe0qm22wa6urpp5nskcne8z88cvbupv653y1njyi05h
keepproxy pid 15658 ok
keep-web pid 15671 ok
{"health":"OK"}
{"health":"OK"}
ws pid 15689 ok
ARVADOS_TEST_PROXY_SERVICES=1
ARVADOS_API_TOKEN=4axaw8zxe0qm22wa6urpp5nskcne8z88cvbupv653y1njyi05h
ARVADOS_CONFIG=/tmp/workspace/run-tests-remainder/tmp/arvados.yml
ARVADOS_API_HOST=0.0.0.0:49697
ARVADOS_TEST_API_INSTALLED=1446
ARVADOS_TEST_API_HOST=127.0.0.1:48163
ARVADOS_USE_KEEP_ACCESSIBLE_API=true
ARVADOS_API_HOST_INSECURE=true
======= test sdk/ruby-google-api-client
*** note `test sdk/ruby-google-api-client` does not actually run any tests, see https://dev.arvados.org/issues/20993 ***
======= test sdk/ruby-google-api-client -- 0s
======= test sdk/ruby
/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/gems/andand-1.3.3/lib/andand.rb:23: warning: parentheses after method name is interpreted as an argument list, not a decomposed argument
/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/gems/andand-1.3.3/lib/andand.rb:58: warning: parentheses after method name is interpreted as an argument list, not a decomposed argument
/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/gems/andand-1.3.3/lib/andand.rb:83: warning: parentheses after method name is interpreted as an argument list, not a decomposed argument
/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/gems/andand-1.3.3/lib/andand.rb:107: warning: mismatched indentations at 'else' with 'if' at 102
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:10: warning: method redefined; discarding old discovery_document
/home/jenkins/tmp/GEMHOME/.local/share/gem/ruby/3.1.0/gems/arvados-google-api-client-0.8.7.16/lib/google/api_client.rb:370: warning: previous definition of discovery_document was here
/tmp/workspace/run-tests-remainder/sdk/ruby/test/test_collection.rb:324: warning: assigned but unused variable - dst_text
/tmp/workspace/run-tests-remainder/sdk/ruby/test/test_collection.rb:337: warning: assigned but unused variable - blocks
/tmp/workspace/run-tests-remainder/sdk/ruby/test/test_collection.rb:346: warning: assigned but unused variable - blocks
Run options: -v --seed 44267

# Running:

CollectionTest#test_copy_root_contents_into_stream = 0.00 s = .
CollectionTest#test_copy_root_into_empty_collection = 0.00 s = .
CollectionTest#test_copy_stream_contents_across_collections = 0.00 s = .
CollectionTest#test_no_implicit_normalization = 0.00 s = .
CollectionTest#test_remove_last_file = 0.00 s = .
CollectionTest#test_implicit_copy_stream_into_other_stream = 0.00 s = .
CollectionTest#test_non_posix_path_handling = 0.00 s = .
CollectionTest#test_copy_stream_over_file_raises_ENOTDIR = 0.00 s = .
CollectionTest#test_rename_file_over_in_other_stream = 0.00 s = .
CollectionTest#test_copy_stream_into_substream = 0.00 s = .
CollectionTest#test_implicit_rename_file_over_in_other_stream = 0.00 s = .
CollectionTest#test_exist = 0.00 s = .
CollectionTest#test_implicit_copy_file_over_in_other_stream = 0.00 s = .
CollectionTest#test_rename_stream_into_other_stream_with_new_name = 0.00 s = .
CollectionTest#test_copy_with_repeated_blocks = 0.00 s = .
CollectionTest#test_copy_file_into_new_stream_with_explicit_filename = 0.00 s = .
CollectionTest#test_copy_file_from_other_collection_to_root = 0.00 s = .
CollectionTest#test_each_file_path = 0.00 s = .
CollectionTest#test_collection_unmodified_after_instantiation = 0.00 s = .
CollectionTest#test_rename_stream_over_nonempty_stream_raises_ENOTEMPTY = 0.00 s = .
CollectionTest#test_normalization_handles_duplicate_locator = 0.00 s = .
CollectionTest#test_path_under_file_not_exist = 0.00 s = .
CollectionTest#test_each_file_path_without_block = 0.00 s = .
CollectionTest#test_remove_root_raises_EISDIR = 0.00 s = .
CollectionTest#test_file_directory_conflict_construction_error = 0.00 s = .
CollectionTest#test_concatenation_with_partial_locator_overlap = 0.00 s = .
CollectionTest#test_rename_stream_over_file_raises_ENOTDIR = 0.00 s = .
CollectionTest#test_copy_stream_contents = 0.00 s = .
CollectionTest#test_normalization_file_skips_bytes = 0.00 s = .
CollectionTest#test_copy_chaining = 0.00 s = .
CollectionTest#test_each_file_path_empty_collection = 0.00 s = .
CollectionTest#test_implicit_rename_file_into_other_stream = 0.00 s = .
CollectionTest#test_adding_to_root_after_rename = 0.00 s = .
CollectionTest#test_recursive_remove_root = 0.00 s = .
CollectionTest#test_copy_root_contents_across_collections = 0.00 s = .
CollectionTest#test_collection_unmodified_after_mark = 0.00 s = .
CollectionTest#test_simple_stream_copy = 0.00 s = .
CollectionTest#test_copy_file_under_file_raises_ENOTDIR = 0.00 s = .
CollectionTest#test_escaping_through_normalization = 0.00 s = .
CollectionTest#test_range_edge_cases = 0.00 s = .
CollectionTest#test_adding_to_root_after_copy = 0.00 s = .
CollectionTest#test_rename_root = 0.00 s = .
CollectionTest#test_simple_remove = 0.00 s = .
CollectionTest#test_collection_modified_after_copy = 0.00 s = .
CollectionTest#test_copy_stream_into_other_stream = 0.00 s = .
CollectionTest#test_normalization_file_fits_end_block = 0.00 s = .
CollectionTest#test_file_inside_stream_exist = 0.00 s = .
CollectionTest#test_remove_nonexistent_file_raises_ENOENT = 0.00 s = .
CollectionTest#test_normalization_file_fits_beginning_block = 0.00 s = .
CollectionTest#test_collection_modified_after_remove = 0.00 s = .
CollectionTest#test_copy_with_repeated_split_blocks = 0.00 s = .
CollectionTest#test_each_file_path_after_collection_emptied = 0.00 s = .
CollectionTest#test_copy_stream_contents_into_root = 0.00 s = .
CollectionTest#test_remove_stream_raises_EISDIR = 0.00 s = .
CollectionTest#test_remove_empty_string_raises_ArgumentError = 0.00 s = .
CollectionTest#test_simple_file_rename = 0.00 s = .
CollectionTest#test_normalization_file_duplicates_bytes = 0.00 s = .
CollectionTest#test_concatenation_with_middle_locator_overlap = 0.00 s = .
CollectionTest#test_copy_stream_from_other_collection_to_root = 0.00 s = .
CollectionTest#test_path_inside_stream_not_exist = 0.00 s = .
CollectionTest#test_simple_file_copy = 0.00 s = .
CollectionTest#test_empty_construction = 0.00 s = .
CollectionTest#test_each_file_path_deduplicates_manifest_listings = 0.00 s = .
CollectionTest#test_rm_r_nonexistent_file_raises_ENOENT = 0.00 s = .
CollectionTest#test_normalization_file_inserts_bytes = 0.00 s = .
CollectionTest#test_stream_exist = 0.00 s = .
CollectionTest#test_rm_r_from_nonexistent_stream_raises_ENOENT = 0.00 s = .
CollectionTest#test_copy_stream_over_empty_stream = 0.00 s = .
CollectionTest#test_file_not_exist = 0.00 s = .
CollectionTest#test_remove_all_files_in_root_stream = 0.00 s = .
CollectionTest#test_copy_file_from_other_collection = 0.00 s = .
CollectionTest#test_collection_modified_after_rename = 0.00 s = .
CollectionTest#test_concatenation_with_end_locator_overlap = 0.00 s = .
CollectionTest#test_remove_all_files_in_substream = 0.00 s = .
CollectionTest#test_rm_r_empty_string_raises_ArgumentError = 0.00 s = .
CollectionTest#test_rename_stream_over_empty_stream = 0.00 s = .
CollectionTest#test_copy_empty_source_path_raises_ArgumentError = 0.00 s = .
CollectionTest#test_rename_file_into_other_stream = 0.00 s = .
CollectionTest#test_deep_substreams_not_exist = 0.00 s = .
CollectionTest#test_copy_root = 0.00 s = .
CollectionTest#test_implicit_copy_file_into_other_stream = 0.00 s = .
CollectionTest#test_copy_file_over_in_other_stream = 0.00 s = .
CollectionTest#test_rename_stream_into_other_stream = 0.00 s = .
CollectionTest#test_rename_file_into_other_stream_with_new_name = 0.00 s = .
CollectionTest#test_copy_file_into_other_stream_with_new_name = 0.00 s = .
CollectionTest#test_normalization_file_spans_middle = 0.00 s = .
CollectionTest#test_rename_chaining = 0.00 s = .
CollectionTest#test_new_collection_unmodified = 0.00 s = .
CollectionTest#test_normalization_file_spans_two_whole_blocks = 0.00 s = .
CollectionTest#test_copy_file_into_other_stream = 0.00 s = .
CollectionTest#test_concatenation_with_locator_overlap = 0.00 s = .
CollectionTest#test_copy_stream_from_other_collection = 0.00 s = .
CollectionTest#test_implicit_rename_stream_into_other_stream = 0.00 s = .
CollectionTest#test_remove_from_nonexistent_stream_raises_ENOENT = 0.00 s = .
CollectionTest#test_recursive_remove = 0.00 s = .
CollectionTest#test_normalize = 0.00 s = .
CollectionTest#test_non_manifest_construction_error = 0.00 s = .
CollectionTest#test_copy_stream_into_other_stream_with_new_name = 0.00 s = .
CollectionTest#test_copy_stream_over_nonempty_stream_merges_and_overwrites = 0.00 s = .
CollectionTest#test_copy_empty_destination_path_raises_ArgumentError = 0.00 s = .
CollectionTest#test_rename_stream_into_substream = 0.00 s = .
CollectionTest#test_simple_stream_rename = 0.00 s = .
CollectionTest#test_successful_construction = 0.00 s = .
CollectionTest#test_copy_file_into_new_stream_with_implicit_filename = 0.00 s = .
CollectionTest#test_chaining_removes = 0.00 s = .
CollectionTest#test_normalization_file_spans_three_whole_blocks = 0.00 s = .
CollectionTest#test_recursive_remove_on_files = 0.00 s = .
TestBigRequest#test_create_manifest = 0.00 s = S
TestBigRequest#test_create_big_manifest = 0.00 s = S
RequestIdTest#test_raise_exception_with_request_id = /tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 2648
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 4801
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 6837
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 13104
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 21999
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 30739
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 32982
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 36124
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 38251
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 40942
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 43319
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 45516
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 50779
/tmp/workspace/run-tests-remainder/sdk/ruby/lib/arvados/google_api_client.rb:57: warning: detected duplicate key "uuid" in JSON object. This will raise an error in json 3.0 unless enabled via `allow_duplicate_key: true` at line 1 column 52278
0.10 s = .
ManifestTest#test_validate manifest ".//foo d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt/.\n" = 0.00 s = .
ManifestTest#test_validate manifest ". \n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+Ad41d8cd98f00b204e9800998ecf8427e00000000+Foo" = 0.00 s = .
ManifestTest#test_validate manifest ". 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_multilevel_collection_with_dirs_in_filenames = 0.00 s = .
ManifestTest#test_validate manifest "abc d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:a/../bc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "abc/./foo d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt d41d8cd98f00b204e9800998ecf8427e+0\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\\057Data d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest " \n. d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\057foo/bar\n" = 0.00 s = .
ManifestTest#test_empty_each_line = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+K+" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0+Ad41d8cd98f00b204e9800998ecf8427e00000000@ffffffff 0:0:empty.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:/foo.txt\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"+0" = 0.00 s = .
ManifestTest#test_parse_method_on_nil = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\057bar\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/bar./baz.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest nil = 0.00 s = .
ManifestTest#test_validate manifest "./\\\\444 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\\056\\057 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\t\n" = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 0\\0720\\072foo\n" = 0.00 s = .
ManifestTest#test_empty_files = 0.00 s = .
ManifestTest#test_multilevel_files = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\888\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+K+0" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0" = DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:289. This will fail in Minitest 6.
0.00 s = .
ManifestTest#test_validate manifest "./foo//bar d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "./Data\\040Folder d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_collection_with_dirs_in_filenames = 0.00 s = .
ManifestTest#test_parse_method_on_" d41d8cd98f00b204e9800998ecf8427e+0" = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\056\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\td41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+Ad41d8cd98f00b204e9800998ecf8427e00000000+Foo" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/.bar/baz.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "./abc/.. d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+Fizz+Buzz" = DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:287. This will fail in Minitest 6.
DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:288. This will fail in Minitest 6.
0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0 " = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n/dir1 d41d8cd98f00b204e9800998ecf842 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 \\040:\\040:foo.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"+0" = 0.00 s = .
ManifestTest#test_validate manifest "." = 0.00 s = .
ManifestTest#test_validate manifest "./foo\\ d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_empty_each_file_spec = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+Ad41d8cd98f00b204e9800998ecf8427e00000000+Foo" = DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:287. This will fail in Minitest 6.
DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:288. This will fail in Minitest 6.
0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n./dir1 a41d8cd98f00b204e9800998ecf8427e+0 abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt \n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:.../.foo./.../bar\n" = 0.00 s = .
ManifestTest#test_simple_each_line_array = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/.../bar\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/...\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\072\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0  0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n \n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\057/bar\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:../abc.txt\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e0" = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\056\\056\\057foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo//bar.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+Fizz+Buzz" = 0.00 s = .
ManifestTest#test_validate manifest " . d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_backslash_escape_parsing = 0.00 s = .
ManifestTest#test_multilevel_each_line = 0.00 s = .
ManifestTest#test_validate manifest "./abc/. d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e" = DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:287. This will fail in Minitest 6.
DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:288. This will fail in Minitest 6.
DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:289. This will fail in Minitest 6.
0.00 s = .
ManifestTest#test_parse_all_fixtures = 0.01 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+K++" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+K++" = 0.00 s = .
ManifestTest#test_validate manifest ". 00000000000000000000000000000000+0 0:0:d41d8cd98f00b204e9800998ecf8427e+0+Ad41d8cd98f00b204e9800998ecf8427e00000000@ffffffff\n" = 0.00 s = .
ManifestTest#test_empty_line_within_manifest = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e0+0" = 0.00 s = .
ManifestTest#test_validate manifest "./abc/../foo d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+Z" = DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:287. This will fail in Minitest 6.
DEPRECATED: Use assert_nil if expecting nil from /tmp/workspace/run-tests-remainder/sdk/ruby/test/test_keep_manifest.rb:288. This will fail in Minitest 6.
0.00 s = .
ManifestTest#test_validate manifest " " = 0.00 s = .
ManifestTest#test_validate manifest "\t. d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "\n. d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_empty_dir_files_count = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0 " = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+Ad41d8cd98f00b204e9800998ecf8427e00000000+Foo" = 0.00 s = .
ManifestTest#test_validate manifest "./foo/ d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/\n" = 0.00 s = .
ManifestTest#test_validate manifest "" = 0.00 s = .
ManifestTest#test_has_file = 0.00 s = .
ManifestTest#test_files_spanning_multiple_blocks = 0.00 s = .
ManifestTest#test_validate manifest "./foo\\444 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_files_size_multiblock = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 0:0:.\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0\t 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:./abc.txt\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e++" = 0.00 s = .
ManifestTest#test_validate manifest "./ d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\\n" = 0.00 s = .
ManifestTest#test_exact_file_count_multiblock = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:...\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt/..\n" = 0.00 s = .
ManifestTest#test_validate manifest "./foo\vbar d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\n" = 0.00 s = .
ManifestTest#test_validate manifest ". 00000000000000000000000000000000+0 0:0:0\n" = 0.00 s = .
ManifestTest#test_validate manifest ". 8cf8463b34caa8ac871a52d5dd7ad1ef+1 0:1:.\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_" d41d8cd98f00b204e9800998ecf8427e+0" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+Z" = 0.00 s = .
ManifestTest#test_minimum_file_count_simple = 0.00 s = .
ManifestTest#test_raise_on_bogus_fixture = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0++K" = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\056\\056\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+K++Z" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n " = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+K+" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "./foo\tbar d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427+0" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\444\n" = 0.00 s = .
ManifestTest#test_empty_has_file? = 0.00 s = .
ManifestTest#test_has_file_with_spaces = 0.00 s = .
ManifestTest#test_files_with_colons_in_names = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n./dir1 a41d8cd98f00b204e9800998ecf8427e+0 0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:.foo\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+Fizz+Buzz" = 0.00 s = .
ManifestTest#test_validate manifest "d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:.foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "\v. d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo.txt\n" = 0.00 s = .
ManifestTest#test_minimum_file_count_multiblock = 0.00 s = .
ManifestTest#test_empty_files_size = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0++K" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e0" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427" = 0.00 s = .
ManifestTest#test_validate manifest "\\056\\057Data d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest "./foo\\888 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e a41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "./abc/./foo d41d8cd98f00b204e9800998ecf8427e 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:0:0\n" = 0.00 s = .
ManifestTest#test_exact_file_count_simple = 0.00 s = .
ManifestTest#test_validate manifest ".\\057Data d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\444\n" = 0.00 s = .
ManifestTest#test_files_with_escape_sequence_in_filename = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+Z" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\134057foo/bar\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e++" = 0.00 s = .
ManifestTest#test_validate manifest ". 0:0:foo.txt d41d8cd98f00b204e9800998ecf8427e+0\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:..\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\\r\n" = 0.00 s = .
ManifestTest#test_validate manifest "./\tfoo d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n./dir1 a41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt xyz.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\\057\\056 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:abc.txt\n./dir1 d41d8cd98f00b204e9800998ecf842 0:0:abc.txt\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+K++Z" = 0.00 s = .
ManifestTest#test_validate manifest "./foo\\r d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_nil = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427+0" = 0.00 s = .
ManifestTest#test_validate manifest "./\\444 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_validate manifest ".\\057/Data d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+Z" = 0.00 s = .
ManifestTest#test_validate manifest "./\\134444 d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+Fizz+Buzz" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+0+0" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:\\040\n" = 0.00 s = .
ManifestTest#test_validate manifest "./\\011foo d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427e+0+0" = 0.00 s = .
ManifestTest#test_empty_files_count = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 000000000000000000000000000000:0777:foo.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ".  \n" = 0.00 s = .
ManifestTest#test_simple_each_line_block = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e0+0" = 0.00 s = .
ManifestTest#test_validate manifest "./empty_dir d41d8cd98f00b204e9800998ecf8427e+0 \\060:\\060:foo\n" = 0.00 s = .
ManifestTest#test_files_size_with_skipped_overlapping_data = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e 0:0:a/./bc.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest ". d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo/bar.txt\n" = 0.00 s = .
ManifestTest#test_validate manifest "./\\011/.. d41d8cd98f00b204e9800998ecf8427e+0 0:0:foo\n" = 0.00 s = .
ManifestTest#test_LOCATOR_REGEXP_on_"d41d8cd98f00b204e9800998ecf8427" = 0.00 s = .
ManifestTest#test_parse_method_on_"d41d8cd98f00b204e9800998ecf8427e+K+0" = 0.00 s = .
ManifestTest#test_simple_files = 0.00 s = .

Finished in 0.140707s, 2096.5519 runs/s, 15400.7730 assertions/s.

  1) Skipped:
TestBigRequest#test_create_manifest [test/test_big_request.rb:20]:
Test needs an API server to run against

  2) Skipped:
TestBigRequest#test_create_big_manifest [test/test_big_request.rb:20]:
Test needs an API server to run against

295 runs, 2167 assertions, 0 failures, 0 errors, 2 skips
======= test sdk/ruby -- 2s
======= test sdk/cli
Run options: -v --seed 60779

# Running:

TestArvWs#test_arv_ws_get_help = 0.22 s = .
TestArvWs#test_arv_ws_such_option = 0.22 s = .
TestArvGet#test_help_exists = 0.80 s = .
TestArvGet#test_get_valid_object_with_both_valid_and_invalid_fields = 2.40 s = .
TestArvGet#test_get_valid_object_with_no_valid_fields = 2.40 s = .
TestArvGet#test_get_invalid_object = 0.78 s = .
TestArvGet#test_get_valid_object_yaml_format_specified = 2.41 s = .
TestArvGet#test_get_valid_object_json_format_specified = 2.44 s = .
TestArvGet#test_get_valid_object_no_format_specified = 2.42 s = .
TestArvGet#test_get_valid_object_with_valid_fields = 2.42 s = .
TestArvKeepGet#test_create_partial_directory_tree = 2025-12-12 21:31:01 arvados.arv_put[16152] INFO: No cache usage requested for this run.
2025-12-12 21:31:01 arvados.arv_put[16152] INFO: Collection saved as 'Saved at 2025-12-12 21:31:01 UTC by jenkins@test-i0u38r'
2025-12-12 21:31:02 arvados.arv_put[16157] INFO: No cache usage requested for this run.
2025-12-12 21:31:02 arvados.arv_put[16161] INFO: No cache usage requested for this run.
2025-12-12 21:31:02 arvados.arv_put[16161] INFO: Collection saved as 'Saved at 2025-12-12 21:31:02 UTC by jenkins@test-i0u38r'
1.06 s = .
TestArvKeepGet#test_nonexistent_block = 0.23 s = .
TestArvKeepGet#test_help = 0.23 s = .
TestArvKeepGet#test_file_to_dev_stdout = 0.25 s = .
TestArvKeepGet#test_file_to_file_skip_existing = 0.24 s = .
TestArvKeepGet#test_file_to_stdout = 0.25 s = .
TestArvKeepGet#test_file_to_file_force_overwrite = 0.25 s = .
TestArvKeepGet#test_file_to_file_no_overwrite_file = 0.24 s = .
TestArvKeepGet#test_create_directory_tree = 0.24 s = .
TestArvKeepGet#test_dir_to_empty_string = 0.22 s = .
TestArvKeepGet#test_sha1_nowrite = 0.25 s = .
TestArvKeepGet#test_nonexistent_manifest = 0.23 s = .
TestArvKeepGet#test_dir_to_file = 0.22 s = .
TestArvKeepGet#test_file_to_file_no_overwrite_file_in_dir = 0.24 s = .
TestArvKeepGet#test_file_to_file = 0.24 s = .
TestArvKeepGet#test_file_to_dir = 0.25 s = .
TestArvKeepGet#test_md5sum_nowrite = 0.25 s = .
TestArvKeepGet#test_no_args = 0.23 s = .
TestArvKeepGet#test_block_to_file = 0.24 s = .
TestArvKeepGet#test_get_version = 0.22 s = .
TestArvKeepGet#test_manifest_root_to_dir = 0.25 s = .
TestArvKeepGet#test_manifest_root_to_dir_noslash = 0.25 s = .
TestArvKeepGet#test_display_md5sum = 0.25 s = .
TestArvTag#test_no_args = 0.00 s = S
TestArvTag#test_single_tag_single_obj = 0.00 s = S
TestArvTag#test_single_tag_multi_objects = 0.00 s = S
TestCollectionCreate#test_collection_replace_files = 2.51 s = .
TestCollectionCreate#test_small_collection = 0.83 s = .
TestCollectionCreate#test_read_resource_object_from_file = 0.83 s = .
TestArvKeepPut#test_filename_arg_with_directory = 0.23 s = .
TestArvKeepPut#test_read_from_implicit_stdin = 2025-12-12 21:31:12 arvados.arv_put[16284] INFO: No cache usage requested for this run.
2025-12-12 21:31:12 arvados.arv_put[16284] INFO: Collection saved as 'Saved at 2025-12-12 21:31:12 UTC by jenkins@test-i0u38r'
0.27 s = .
TestArvKeepPut#test_filename_arg_with_multiple_files = 0.23 s = .
TestArvKeepPut#test_raw_empty_file = 2025-12-12 21:31:12 arvados.arv_put[16287] INFO: Creating new cache file at /home/jenkins/.cache/arvados/arv-put/a56c9e5269fe3d2d0a08258d38c7a6b6
0.25 s = .
TestArvKeepPut#test_filename_arg_with_empty_file = 2025-12-12 21:31:13 arvados.arv_put[16289] INFO: Creating new cache file at /home/jenkins/.cache/arvados/arv-put/34d7917ed8b533af52f6e445652363b6
2025-12-12 21:31:13 arvados.arv_put[16289] INFO: Collection saved as 'Saved at 2025-12-12 21:31:13 UTC by jenkins@test-i0u38r'
0.27 s = .
TestArvKeepPut#test_read_from_dev_stdin_implicit_manifest = 2025-12-12 21:31:13 arvados.arv_put[16292] INFO: No cache usage requested for this run.
2025-12-12 21:31:13 arvados.arv_put[16292] INFO: Collection saved as 'Saved at 2025-12-12 21:31:13 UTC by jenkins@test-i0u38r (6dvrj22hcgpqzky)'
0.27 s = .
TestArvKeepPut#test_raw_file = 2025-12-12 21:31:13 arvados.arv_put[16294] INFO: No cache usage requested for this run.
0.25 s = .
TestArvKeepPut#test_progress = 0.27 s = .
TestArvKeepPut#test_read_from_stdin_implicit_manifest = 2025-12-12 21:31:14 arvados.arv_put[16303] INFO: No cache usage requested for this run.
2025-12-12 21:31:14 arvados.arv_put[16303] INFO: Collection saved as 'Saved at 2025-12-12 21:31:14 UTC by jenkins@test-i0u38r'
0.26 s = .
TestArvKeepPut#test_read_from_dev_stdin = 2025-12-12 21:31:14 arvados.arv_put[16306] INFO: No cache usage requested for this run.
2025-12-12 21:31:14 arvados.arv_put[16306] INFO: Collection saved as 'Saved at 2025-12-12 21:31:14 UTC by jenkins@test-i0u38r (xuuirfex8rjh9x7)'
0.27 s = .
TestArvKeepPut#test_as_stream = 2025-12-12 21:31:14 arvados.arv_put[16308] INFO: No cache usage requested for this run.
0.25 s = .
TestArvKeepPut#test_read_from_implicit_stdin_implicit_manifest = 2025-12-12 21:31:15 arvados.arv_put[16313] INFO: No cache usage requested for this run.
2025-12-12 21:31:15 arvados.arv_put[16313] INFO: Collection saved as 'Saved at 2025-12-12 21:31:15 UTC by jenkins@test-i0u38r'
0.27 s = .
TestArvKeepPut#test_progress_and_batch_progress = 0.23 s = .
TestArvKeepPut#test_batch_progress = 0.27 s = .
TestArvKeepPut#test_raw_stdin = 2025-12-12 21:31:15 arvados.arv_put[16323] INFO: No cache usage requested for this run.
0.25 s = .
TestArvKeepPut#test_read_from_stdin = 2025-12-12 21:31:16 arvados.arv_put[16326] INFO: No cache usage requested for this run.
2025-12-12 21:31:16 arvados.arv_put[16326] INFO: Collection saved as 'Saved at 2025-12-12 21:31:16 UTC by jenkins@test-i0u38r'
0.27 s = .
TestArvKeepPut#test_help = 0.23 s = .

Finished in 31.333407s, 1.7872 runs/s, 7.9787 assertions/s.

  1) Skipped:
TestArvTag#test_no_args [test/test_arv-tag.rb:16]:
Waiting until #4534 is implemented

  2) Skipped:
TestArvTag#test_single_tag_single_obj [test/test_arv-tag.rb:28]:
TBD

  3) Skipped:
TestArvTag#test_single_tag_multi_objects [test/test_arv-tag.rb:64]:
TBD

56 runs, 250 assertions, 0 failures, 0 errors, 3 skips
======= test sdk/cli -- 33s
======= test services/login-sync
/tmp/workspace/run-tests-remainder/services/login-sync/test/test_add_user.rb:13: warning: assigned but unused variable - valid_groups
Run options: -v --seed 40691

# Running:

TestAddUser#test_useradd_success = *** Expect crash after getpwnam() fails:
Creating account adminroot
Created account but then getpwnam() failed for adminroot: can't find user for adminroot
Error: can't find user for adminroot
/tmp/workspace/run-tests-remainder/services/login-sync/bin/arvados-login-sync:179:in `getpwnam'
/tmp/workspace/run-tests-remainder/services/login-sync/bin/arvados-login-sync:179:in `block in <main>'
/tmp/workspace/run-tests-remainder/services/login-sync/bin/arvados-login-sync:157:in `each'
/tmp/workspace/run-tests-remainder/services/login-sync/bin/arvados-login-sync:157:in `<main>'
0.87 s = .
TestAddUser#test_useradd_error = Creating account adminroot
Account creation failed for adminroot:
Creating account active
Account creation failed for active:
0.86 s = .

Finished in 1.733707s, 1.1536 runs/s, 4.0376 assertions/s.

2 runs, 7 assertions, 0 failures, 0 errors, 0 skips
======= test services/login-sync -- 3s
======= test tools/crunchstat-summary
============================= test session starts ==============================
platform linux -- Python 3.10.19, pytest-8.4.2, pluggy-1.6.0
rootdir: /tmp/workspace/run-tests-remainder/tools/crunchstat-summary
configfile: pytest.ini
testpaths: tests
plugins: cwltest-2.6.20250818005349
collected 5 items

tests/test_examples.py .....                                             [100%]

============================== 5 passed in 0.20s ===============================
======= test tools/crunchstat-summary -- 0s
keep0.pid is 16448
keep1.pid is 16464
starting crunch-dispatch-local ...
dispatch pid is 16480
======= test sdk/cwl
============================= test session starts ==============================
platform linux -- Python 3.10.19, pytest-8.4.2, pluggy-1.6.0
rootdir: /tmp/workspace/run-tests-remainder/sdk/cwl
configfile: pytest.ini
testpaths: tests
plugins: cwltest-2.6.20250818005349
collected 141 items / 10 deselected / 131 selected

tests/test_container.py ................................................ [ 36%]
.....                                                                    [ 40%]
tests/test_fsaccess.py ...                                               [ 42%]
tests/test_make_output.py ...                                            [ 45%]
tests/test_pathmapper.py ......                                          [ 49%]
tests/test_submit.py ................................................... [ 88%]
.....                                                                    [ 92%]
tests/test_tq.py ..                                                      [ 93%]
tests/test_urljoin.py ..                                                 [ 95%]
tests/test_util.py ......                                                [100%]

================ 131 passed, 10 deselected in 75.65s (0:01:15) =================
======= test sdk/cwl -- 76s
Sent SIGTERM to 16448 (/tmp/workspace/run-tests-remainder/tmp/keep0.pid)
Sent SIGTERM to 16464 (/tmp/workspace/run-tests-remainder/tmp/keep1.pid)
Sent SIGTERM to 16480 (/tmp/workspace/run-tests-remainder/tmp/dispatch.pid)
======= test services/dockercleaner
============================= test session starts ==============================
platform linux -- Python 3.10.19, pytest-8.4.2, pluggy-1.6.0
rootdir: /tmp/workspace/run-tests-remainder/services/dockercleaner
configfile: pytest.ini
testpaths: tests
plugins: cwltest-2.6.20250818005349
collected 56 items

tests/test_cleaner.py .................................................. [ 89%]
......                                                                   [100%]

============================== 56 passed in 0.18s ==============================
======= test services/dockercleaner -- 0s
======= test tools/cluster-activity
============================= test session starts ==============================
platform linux -- Python 3.10.19, pytest-8.4.2, pluggy-1.6.0
rootdir: /tmp/workspace/run-tests-remainder/tools/cluster-activity
configfile: pytest.ini
testpaths: tests
plugins: cwltest-2.6.20250818005349
collected 1 item

tests/test_report.py .                                                   [100%]

============================== 1 passed in 0.15s ===============================
======= test tools/cluster-activity -- 0s
======= test cmd/arvados-client
ok  	git.arvados.org/arvados.git/cmd/arvados-client	14.975s	coverage: 0.0% of statements
======= test cmd/arvados-client -- 19s
======= test cmd/arvados-server
	git.arvados.org/arvados.git/cmd/arvados-server		coverage: 0.0% of statements
======= test cmd/arvados-server -- 5s
======= test lib/boot
ok  	git.arvados.org/arvados.git/lib/boot	0.063s	coverage: 2.1% of statements
======= test lib/boot -- 1s
======= test lib/cli
ok  	git.arvados.org/arvados.git/lib/cli	0.022s	coverage: 39.5% of statements
======= test lib/cli -- 1s
======= test lib/cloud
ok  	git.arvados.org/arvados.git/lib/cloud	0.005s	coverage: 80.0% of statements
======= test lib/cloud -- 0s
======= test lib/cloud/azure
ok  	git.arvados.org/arvados.git/lib/cloud/azure	0.008s	coverage: 30.6% of statements
======= test lib/cloud/azure -- 1s
======= test lib/cloud/cloudtest
ok  	git.arvados.org/arvados.git/lib/cloud/cloudtest	0.186s	coverage: 46.5% of statements
======= test lib/cloud/cloudtest -- 2s
======= test lib/cloud/ec2
ok  	git.arvados.org/arvados.git/lib/cloud/ec2	0.249s	coverage: 88.3% of statements
======= test lib/cloud/ec2 -- 2s
======= test lib/cloud/loopback
ok  	git.arvados.org/arvados.git/lib/cloud/loopback	0.164s	coverage: 69.0% of statements
======= test lib/cloud/loopback -- 1s
======= test lib/cmd
ok  	git.arvados.org/arvados.git/lib/cmd	0.004s	coverage: 50.7% of statements
======= test lib/cmd -- 1s
======= test lib/cmdtest
	git.arvados.org/arvados.git/lib/cmdtest		coverage: 0.0% of statements
======= test lib/cmdtest -- 0s
======= test lib/config
ok  	git.arvados.org/arvados.git/lib/config	2.571s	coverage: 80.5% of statements
======= test lib/config -- 3s
======= test lib/controller
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1l74jji40eq6v1k3tp38 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/users/current reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1l74jji40eq6v1k3tp38 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/users/current reqQuery= respBytes=793 respStatus=OK respStatusCode=200 timeToStatus=0.058451 timeTotal=0.058455 timeWriteBody=0.000004 tokenUUIDs="[v1 token ending in Fag1Q]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1cwdhiwsug99gzguqb0t remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/users/current reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1cwdhiwsug99gzguqb0t remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/users/current reqQuery= respBytes=793 respStatus=OK respStatusCode=200 timeToStatus=0.008766 timeTotal=0.008769 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in Fag1Q]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-cajhjca2jgqc1d0w8ino remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-cajhjca2jgqc1d0w8ino remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"Not logged in (req-cajhjca2jgqc1d0w8ino)\"],\"error_token\":\"1765575204+cdc5b7ae\"}" respBytes=91 respStatus=Unauthorized respStatusCode=401 timeToStatus=0.017576 timeTotal=0.017603 timeWriteBody=0.000027
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1cusv5t4degu5skdn8nw remoteAddr="192.0.2.1:1234" reqBytes=24 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zzzzz"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1cusv5t4degu5skdn8nw remoteAddr="192.0.2.1:1234" reqBytes=24 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zzzzz" respBody="{\"errors\":[\"invalid API token\"]}\n" respBytes=33 respStatus=Forbidden respStatusCode=403 timeToStatus=0.001389 timeTotal=0.001396 timeWriteBody=0.000007 tokenUUIDs="[v1 token ending in cdefg]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-13unp2hv52cy7hakjz63 remoteAddr="192.0.2.1:1234" reqBytes=230 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zzzzz"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-13unp2hv52cy7hakjz63 remoteAddr="192.0.2.1:1234" reqBytes=230 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zzzzz" respBytes=1303 respStatus=OK respStatusCode=200 timeToStatus=0.026604 timeTotal=0.026607 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1i2gzvo2awzkciklxcc1 remoteAddr="192.0.2.1:1234" reqBytes=237 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zmock"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1i2gzvo2awzkciklxcc1 remoteAddr="192.0.2.1:1234" reqBytes=237 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zmock" respBytes=960 respStatus=OK respStatusCode=200 timeToStatus=0.048500 timeTotal=0.048503 timeWriteBody=0.000004 tokenUUIDs="[zzzzz-gj3su-077z32aux8dg2s1]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-y513sh7um6ke15vixpmk remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/api_client_authorizations/current reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-y513sh7um6ke15vixpmk remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/api_client_authorizations/current reqQuery= respBytes=434 respStatus=OK respStatusCode=200 timeToStatus=0.008102 timeTotal=0.008104 timeWriteBody=0.000002 tokenUUIDs="[zzzzz-gj3su-kjw61o4drpw5ndm]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-q1be0u6w6l5h7jafx32a remoteAddr="192.0.2.1:1234" reqBytes=266 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zmock"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-q1be0u6w6l5h7jafx32a remoteAddr="192.0.2.1:1234" reqBytes=266 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zmock" respBytes=960 respStatus=OK respStatusCode=200 timeToStatus=0.003099 timeTotal=0.003102 timeWriteBody=0.000002 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1pfoz4ub891cy1g13u1u remoteAddr="192.0.2.1:1234" reqBytes=227 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zz404"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1pfoz4ub891cy1g13u1u remoteAddr="192.0.2.1:1234" reqBytes=227 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/container_requests reqQuery="cluster_id=zz404" respBody="{\"errors\":[\"//railsapi.internal/arvados/v1/container_requests: 404 Not Found\"]}\n" respBytes=80 respStatus="Not Found" respStatusCode=404 timeToStatus=0.001462 timeTotal=0.001467 timeWriteBody=0.000005 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1h21vtixys5v212bcczz remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1h21vtixys5v212bcczz remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery= respBody="{\"errors\":[\"not found\"]}\n" respBytes=25 respStatus="Not Found" respStatusCode=404 timeToStatus=0.014152 timeTotal=0.014157 timeWriteBody=0.000004 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1mf44f2ev96w416at8f3 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery=
time="2025-12-12T21:33:24Z" level=warning msg="bad portable data hash \"cc16c026f32a20f1f6cb6d997cc1fe4e+94\" received from remote \"zzzzz\" (expected \"99999999999999999999999999999999+99\")" RequestID=req-1mf44f2ev96w416at8f3 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1mf44f2ev96w416at8f3 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery= respBody="{\"errors\":[\"errors: [bad portable data hash \\\"cc16c026f32a20f1f6cb6d997cc1fe4e+94\\\" received from remote \\\"zzzzz\\\" (expected \\\"99999999999999999999999999999999+99\\\")]\"]}\n" respBytes=170 respStatus="Bad Gateway" respStatusCode=502 timeToStatus=0.001854 timeTotal=0.001858 timeWriteBody=0.000004 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1ri541esau4yf1r9fpp5 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1ri541esau4yf1r9fpp5 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery= respBytes=968 respStatus=OK respStatusCode=200 timeToStatus=0.012086 timeTotal=0.012107 timeWriteBody=0.000021 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1s2snsn7sgyoby5wbq8k remoteAddr="192.0.2.1:1234" reqBytes=11 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1s2snsn7sgyoby5wbq8k remoteAddr="192.0.2.1:1234" reqBytes=11 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery= respBytes=968 respStatus=OK respStatusCode=200 timeToStatus=0.009220 timeTotal=0.009223 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-si84sfb67h2311l4mh8s remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-si84sfb67h2311l4mh8s remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery= respBytes=801 respStatus=OK respStatusCode=200 timeToStatus=0.010481 timeTotal=0.010483 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-7nlhm9y0xfkvdkreh08r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-7nlhm9y0xfkvdkreh08r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-uukreo9rbgwsujr reqQuery= respBytes=974 respStatus=OK respStatusCode=200 timeToStatus=0.013642 timeTotal=0.013644 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-pcxyat4ftggi1svfqm8j remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery=
time="2025-12-12T21:33:24Z" level=warning msg="bad portable data hash \"d41d8cd98f00b204e9800998ecf8427e+0\" received from remote \"zmock\" (expected \"b519d9cb706a29fc7ea24dbea2f05851+93\")" RequestID=req-pcxyat4ftggi1svfqm8j remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-pcxyat4ftggi1svfqm8j remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery= respBytes=807 respStatus=OK respStatusCode=200 timeToStatus=0.017104 timeTotal=0.017107 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-t7rgxdnj7jkc14sfrnut remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-fakefakefakefak reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-t7rgxdnj7jkc14sfrnut remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zzzzz-4zz18-fakefakefakefak reqQuery= respBody="{\"errors\":[\"request failed: http://[::]:37485/arvados/v1/collections/zzzzz-4zz18-fakefakefakefak: 404 Not Found: //railsapi.internal/arvados/v1/collections/zzzzz-4zz18-fakefakefakefak: 404 Not Found: Path not found (req-t7rgxdnj7jkc14sfrnut)\"]}\n" respBytes=245 respStatus="Not Found" respStatusCode=404 timeToStatus=0.012209 timeTotal=0.012214 timeWriteBody=0.000005 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1fy4qckxcfbk4z6r2tpt remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers/zzzzz-dz642-queuedcontainer reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1fy4qckxcfbk4z6r2tpt remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers/zzzzz-dz642-queuedcontainer reqQuery= respBytes=1219 respStatus=OK respStatusCode=200 timeToStatus=0.023970 timeTotal=0.023992 timeWriteBody=0.000022
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1urtebmbyfkrm1rw670g remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1urtebmbyfkrm1rw670g remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery= respBytes=1339 respStatus=OK respStatusCode=200 timeToStatus=0.017796 timeTotal=0.017799 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-2f3y9eoti7qycctc64td remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-2f3y9eoti7qycctc64td remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBytes=396 respStatus=OK respStatusCode=200 timeToStatus=0.023998 timeTotal=0.024036 timeWriteBody=0.000038
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-mvppgb2efz8y1tek86oe remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zz404-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-mvppgb2efz8y1tek86oe remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zz404-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"no proxy available for cluster zz404\"]}\n" respBytes=52 respStatus="Not Found" respStatusCode=404 timeToStatus=0.001002 timeTotal=0.001006 timeWriteBody=0.000004
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-c2rxuaom24v711oi6nno remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22uuid%22%2C+%22command%22%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-c2rxuaom24v711oi6nno remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22uuid%22%2C+%22command%22%5D" respBody="{\"errors\":[\"error fetching from zhome (404 Not Found): EOF\"]}\n" respBytes=62 respStatus="Bad Gateway" respStatusCode=502 timeToStatus=0.023825 timeTotal=0.023831 timeWriteBody=0.000006
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1m0zpctdnjzr11q3a2la remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&limit=1"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1m0zpctdnjzr11q3a2la remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&limit=1" respBody="{\"errors\":[\"Federated multi-object may not provide 'limit', 'offset' or 'order'.\"]}\n" respBytes=84 respStatus="Bad Request" respStatusCode=400 timeToStatus=0.000978 timeTotal=0.000981 timeWriteBody=0.000004
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-6a8t0j2rtgfv9c10aq1q remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&offset=1"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-6a8t0j2rtgfv9c10aq1q remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&offset=1" respBody="{\"errors\":[\"Federated multi-object may not provide 'limit', 'offset' or 'order'.\"]}\n" respBytes=84 respStatus="Bad Request" respStatusCode=400 timeToStatus=0.004172 timeTotal=0.004184 timeWriteBody=0.000012
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1kx6bhiqjwq8p1xjsunm remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&order=uuid"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1kx6bhiqjwq8p1xjsunm remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&order=uuid" respBody="{\"errors\":[\"Federated multi-object may not provide 'limit', 'offset' or 'order'.\"]}\n" respBytes=84 respStatus="Bad Request" respStatusCode=400 timeToStatus=0.001116 timeTotal=0.001120 timeWriteBody=0.000003
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1dofy1vds0q071o5xe1m remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1dofy1vds0q071o5xe1m remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D" respBody="{\"errors\":[\"Federated multi-object request for 2 objects which is more than max page size 1.\"]}\n" respBytes=96 respStatus="Bad Request" respStatusCode=400 timeToStatus=0.000979 timeTotal=0.000983 timeWriteBody=0.000003
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1k32hw8lkoop1q03yasc remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22command%22%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1k32hw8lkoop1q03yasc remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22command%22%5D" respBody="{\"errors\":[\"Federated multi-object request must include 'uuid' in 'select'\"]}\n" respBytes=78 respStatus="Bad Request" respStatusCode=400 timeToStatus=0.000948 timeTotal=0.000951 timeWriteBody=0.000003
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1vwqcqerungz1135zz14 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22uuid%22%2C+%22command%22%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1vwqcqerungz1135zz14 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%5D%5D%5D&select=%5B%22uuid%22%2C+%22command%22%5D" respBytes=193 respStatus=OK respStatusCode=200 timeToStatus=0.025124 timeTotal=0.025137 timeWriteBody=0.000013
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1e6sdkppt0ps8aq8wqfu remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%2C+%22zhome-xvhdp-cr6queuedcontnr%22%5D%5D%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1e6sdkppt0ps8aq8wqfu remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%2C+%22zhome-xvhdp-cr6queuedcontnr%22%5D%5D%5D" respBytes=1316 respStatus=OK respStatusCode=200 timeToStatus=0.026598 timeTotal=0.026630 timeWriteBody=0.000033
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1kipfvahj7p2m16rqs9h remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%2C+%22zhome-xvhdp-cr6queuedcontnr%22%5D%5D%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1kipfvahj7p2m16rqs9h remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%2C+%22zhome-xvhdp-cr5queuedcontnr%22%2C+%22zhome-xvhdp-cr6queuedcontnr%22%5D%5D%5D" respBytes=1373 respStatus=OK respStatusCode=200 timeToStatus=0.029502 timeTotal=0.029533 timeWriteBody=0.000031
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-lmex8h49rgqd5iccz68u remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%5D%5D%5D"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-lmex8h49rgqd5iccz68u remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/containers reqQuery="count=none&filters=%5B%5B%22uuid%22%2C+%22in%22%2C+%5B%22zzzzz-dz642-queuedcontainer%22%5D%5D%5D" respBytes=1310 respStatus=OK respStatusCode=200 timeToStatus=0.026214 timeTotal=0.026238 timeWriteBody=0.000024
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-t2xfnynpzaui1izyeene remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zhome-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-t2xfnynpzaui1izyeene remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zhome-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"Get \\\"http://localhost:1/arvados/v1/workflows/zhome-7fd4e-validworkfloyml\\\": dial tcp [::1]:1: connect: connection refused\"]}\n" respBytes=138 respStatus="Bad Gateway" respStatusCode=502 timeToStatus=0.001542 timeTotal=0.001548 timeWriteBody=0.000006
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-r35y7dixx6dy1jfppquh remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-r35y7dixx6dy1jfppquh remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery= respBytes=2 respStatus=OK respStatusCode=200 timeToStatus=0.009482 timeTotal=0.009497 timeWriteBody=0.000015
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-7ckoahhx9nik10lhnzkb remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zmock-4zz18-uukreo9rbgwsujr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-7ckoahhx9nik10lhnzkb remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zmock-4zz18-uukreo9rbgwsujr reqQuery= respBytes=586 respStatus=OK respStatusCode=200 timeToStatus=0.000737 timeTotal=0.000740 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-wkutkk59cj9acyynrg2z remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-wkutkk59cj9acyynrg2z remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"Path not found (req-wkutkk59cj9acyynrg2z)\"],\"error_token\":\"1765575204+88fe94d4\"}" respBytes=92 respStatus="Not Found" respStatusCode=404 timeToStatus=0.020322 timeTotal=0.020345 timeWriteBody=0.000023
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1xqg8oxi849azqfne96r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1xqg8oxi849azqfne96r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"Not logged in (req-1xqg8oxi849azqfne96r)\"],\"error_token\":\"1765575204+cd886ce8\"}" respBytes=91 respStatus=Unauthorized respStatusCode=401 timeToStatus=0.004101 timeTotal=0.004120 timeWriteBody=0.000019
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-p28fpm53slxcdda3vy9s remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=OPTIONS reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-p28fpm53slxcdda3vy9s remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=OPTIONS reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBytes=0 respStatus=OK respStatusCode=200 timeToStatus=0.009539 timeTotal=0.009543 timeWriteBody=0.000003
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-atayra415nxn9de0qrmy remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-atayra415nxn9de0qrmy remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml reqQuery= respBody="{\"errors\":[\"Get \\\"https://[::]:34723/arvados/v1/workflows/zzzzz-7fd4e-validworkfloyml\\\": http: server gave HTTP response to HTTPS client\"]}\n" respBytes=140 respStatus="Bad Gateway" respStatusCode=502 timeToStatus=0.010162 timeTotal=0.010168 timeWriteBody=0.000006
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-rrtvz6bpu18a176ftpvk remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-rrtvz6bpu18a176ftpvk remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery= respBytes=2 respStatus=OK respStatusCode=200 timeToStatus=0.009207 timeTotal=0.009227 timeWriteBody=0.000020
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-bcpnoh2s88dr1jhxfzlq remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zmock-4zz18-uukreo9rbgwsujr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-bcpnoh2s88dr1jhxfzlq remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/zmock-4zz18-uukreo9rbgwsujr reqQuery= respBytes=586 respStatus=OK respStatusCode=200 timeToStatus=0.000544 timeTotal=0.000547 timeWriteBody=0.000002 tokenUUIDs="[v1 token ending in 00000]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1seh0vllzi4x51t7yl5r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery="api_token=3kg6k6lzmp9kj5cpkcoxie963cmvjahbt2fod9zru30k1jqdmi"
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1seh0vllzi4x51t7yl5r remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zmock-7fd4e-validworkfloyml reqQuery="api_token=3kg6k6lzmp9kj5cpkcoxie963cmvjahbt2fod9zru30k1jqdmi" respBytes=2 respStatus=OK respStatusCode=200 timeToStatus=0.009103 timeTotal=0.009126 timeWriteBody=0.000023
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1mukkyvxqlf281gohm5c remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1mukkyvxqlf281gohm5c remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/b519d9cb706a29fc7ea24dbea2f05851+93 reqQuery= respBytes=801 respStatus=OK respStatusCode=200 timeToStatus=0.012556 timeTotal=0.012559 timeWriteBody=0.000003 tokenUUIDs="[zzzzz-gj3su-077z32aux8dg2s1]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-66gjqra7onav1fnb3802 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-66gjqra7onav1fnb3802 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/collections/99999999999999999999999999999999+99 reqQuery= respBody="{\"errors\":[\"not found\"]}\n" respBytes=25 respStatus="Not Found" respStatusCode=404 timeToStatus=0.024011 timeTotal=0.024015 timeWriteBody=0.000005 tokenUUIDs="[zzzzz-gj3su-077z32aux8dg2s1]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1f3afju3nt2vw1w7511e remoteAddr="192.0.2.1:1234" reqBytes=40 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1f3afju3nt2vw1w7511e remoteAddr="192.0.2.1:1234" reqBytes=40 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery= respBytes=1341 respStatus=OK respStatusCode=200 timeToStatus=0.043462 timeTotal=0.043465 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-y9xxgujrnxw47jboz6oa remoteAddr="192.0.2.1:1234" reqBytes=38 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-y9xxgujrnxw47jboz6oa remoteAddr="192.0.2.1:1234" reqBytes=38 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/container_requests/zzzzz-xvhdp-cr4queuedcontnr reqQuery= respBytes=1339 respStatus=OK respStatusCode=200 timeToStatus=0.039054 timeTotal=0.039057 timeWriteBody=0.000003 tokenUUIDs="[v1 token ending in jqdmi]"
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1pe9axy3nitwj1potwg9 remoteAddr="192.0.2.1:1234" reqBytes=50 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/workflows reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1pe9axy3nitwj1potwg9 remoteAddr="192.0.2.1:1234" reqBytes=50 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/workflows reqQuery= respBytes=367 respStatus=OK respStatusCode=200 timeToStatus=0.016161 timeTotal=0.016286 timeWriteBody=0.000125
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-b4zzaq8pbo6et0o9zz7g remoteAddr="192.0.2.1:1234" reqBytes=60 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-b4zzaq8pbo6et0o9zz7g remoteAddr="192.0.2.1:1234" reqBytes=60 reqForwardedFor= reqHost=example.com reqMethod=PATCH reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBytes=377 respStatus=OK respStatusCode=200 timeToStatus=0.029548 timeTotal=0.029612 timeWriteBody=0.000064
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-1govy1ycerhwfnbhvnmj remoteAddr="192.0.2.1:1234" reqBytes=58 reqForwardedFor= reqHost=example.com reqMethod=PUT reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-1govy1ycerhwfnbhvnmj remoteAddr="192.0.2.1:1234" reqBytes=58 reqForwardedFor= reqHost=example.com reqMethod=PUT reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBytes=375 respStatus=OK respStatusCode=200 timeToStatus=0.017752 timeTotal=0.017802 timeWriteBody=0.000050
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-3gtwmkgo2cf6no4mpnea remoteAddr="192.0.2.1:1234" reqBytes=73 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-3gtwmkgo2cf6no4mpnea remoteAddr="192.0.2.1:1234" reqBytes=73 reqForwardedFor= reqHost=example.com reqMethod=POST reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBytes=376 respStatus=OK respStatusCode=200 timeToStatus=0.017070 timeTotal=0.017088 timeWriteBody=0.000018
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-iheik1to0itdh8kvbk2p remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=DELETE reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-iheik1to0itdh8kvbk2p remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=DELETE reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBytes=376 respStatus=OK respStatusCode=200 timeToStatus=0.017947 timeTotal=0.017974 timeWriteBody=0.000028
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-b5ostpqsajz61cloi7qn remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:24Z" level=info msg=response RequestID=req-b5ostpqsajz61cloi7qn remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=GET reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBody="{\"errors\":[\"Path not found (req-b5ostpqsajz61cloi7qn)\"],\"error_token\":\"1765575204+16a13b80\"}" respBytes=92 respStatus="Not Found" respStatusCode=404 timeToStatus=0.008347 timeTotal=0.008664 timeWriteBody=0.000317
time="2025-12-12T21:33:24Z" level=info msg=request RequestID=req-yp9q2afb5vhu889a4899 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=DELETE reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery=
time="2025-12-12T21:33:25Z" level=info msg=response RequestID=req-yp9q2afb5vhu889a4899 remoteAddr="192.0.2.1:1234" reqBytes=0 reqForwardedFor= reqHost=example.com reqMethod=DELETE reqPath=arvados/v1/workflows/zzzzz-7fd4e-fewrcoafiu5vfrl reqQuery= respBody="{\"errors\":[\"Path not found (req-yp9q2afb5vhu889a4899)\"],\"error_token\":\"1765575205+a5f50450\"}" respBytes=92 respStatus="Not Found" respStatusCode=404 timeToStatus=0.013029 timeTotal=0.013080 timeWriteBody=0.000051
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:25.008296302Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:25.008323982Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"acquired pg_advisory_lock","time":"2025-12-12T21:33:25.027255138Z","worker":"trash sweep"}
{"ID":10002,"level":"debug","msg":"acquired pg_advisory_lock","time":"2025-12-12T21:33:25.033342220Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:27.027892443Z","worker":"trash sweep"}
{"ID":10002,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:27.034280295Z","worker":"container log sweep"}
{"level":"info","msg":"deleted rows from logs table","rows":5,"time":"2025-12-12T21:33:27.043656928Z","worker":"container log sweep"}
{"ID":10002,"level":"debug","msg":"released pg_advisory_lock","time":"2025-12-12T21:33:27.108621218Z","worker":"container log sweep"}
{"error":"POST //railsapi.internal/sys/trash_sweep giving up after 1 attempt(s): Post \"//railsapi.internal/sys/trash_sweep\": context canceled","level":"info","msg":"trash sweep failed","time":"2025-12-12T21:33:27.110967129Z","worker":"trash sweep"}
{"ID":10001,"level":"debug","msg":"released pg_advisory_lock","time":"2025-12-12T21:33:27.111377769Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:32.122493164Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:32.122506524Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:32.141128921Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:32.141144061Z","worker":"container log sweep"}
time="2025-12-12T21:33:32Z" level=warning msg="error refreshing cache" error="HTTP status 405" path=/discovery/v1/apis/arvados/v1/rest
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.626763784Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.626781444Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.855645742Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.855660142Z","worker":"container log sweep"}
{"RequestID":"","level":"info","msg":"request","remoteAddr":"192.0.2.1:1234","reqBytes":0,"reqForwardedFor":"","reqHost":"0.0.0.0","reqMethod":"GET","reqPath":"arvados/v1/users/current","reqQuery":"","time":"2025-12-12T21:33:33.992141550Z"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.993218058Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:33.993232838Z","worker":"container log sweep"}
{"RequestID":"","apiEndpoint":{"Method":"GET","Path":"arvados/v1/users/current","AttrsKey":""},"apiOpts":{"select":null,"include_trash":false},"apiOptsType":"*arvados.GetOptions","level":"debug","msg":"exec","remoteAddr":"192.0.2.1:1234","reqBytes":0,"reqForwardedFor":"","reqHost":"0.0.0.0","reqMethod":"GET","reqPath":"arvados/v1/users/current","reqQuery":"","time":"2025-12-12T21:33:33.993242709Z"}
{"RequestID":"","level":"info","msg":"response","remoteAddr":"192.0.2.1:1234","reqBytes":0,"reqForwardedFor":"","reqHost":"0.0.0.0","reqMethod":"GET","reqPath":"arvados/v1/users/current","reqQuery":"","respBytes":793,"respStatus":"OK","respStatusCode":200,"time":"2025-12-12T21:33:34.004922715Z","timeToStatus":0.012776,"timeTotal":0.012779,"timeWriteBody":0.000003,"tokenUUIDs":["zzzzz-gj3su-077z32aux8dg2s1"]}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.020012907Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.020033817Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.050662331Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.050681661Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.156190087Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.156207577Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.168859872Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.168885302Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.196194700Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.196227450Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.223305648Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.223426808Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.243635324Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.243666344Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.274100258Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.274178138Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"acquired pg_advisory_lock","time":"2025-12-12T21:33:34.295558103Z","worker":"trash sweep"}
{"ID":10002,"level":"debug","msg":"acquired pg_advisory_lock","time":"2025-12-12T21:33:34.301195987Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:34.396494204Z","worker":"trash sweep"}
{"ID":10002,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:34.401928158Z","worker":"container log sweep"}
{"level":"info","msg":"deleted rows from logs table","rows":0,"time":"2025-12-12T21:33:34.403578146Z","worker":"container log sweep"}
{"ID":10002,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:34.503825858Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"connection still alive","time":"2025-12-12T21:33:34.505136086Z","worker":"trash sweep"}
{"ID":10002,"level":"debug","msg":"released pg_advisory_lock","time":"2025-12-12T21:33:34.591441645Z","worker":"container log sweep"}
{"ID":10001,"level":"debug","msg":"released pg_advisory_lock","time":"2025-12-12T21:33:34.591512805Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.601772553Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.601793713Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.631351038Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.631366458Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.648178918Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.648199258Z","worker":"container log sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.664506159Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.664521829Z","worker":"container log sweep"}
time="2025-12-12T21:33:34Z" level=info msg="vocabulary file reloaded successfully"
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.673538998Z","worker":"trash sweep"}
{"level":"debug","msg":"interval is 0s, not running worker","time":"2025-12-12T21:33:34.673571678Z","worker":"container log sweep"}
time="2025-12-12T21:33:34Z" level=info msg="vocabulary file reloaded successfully"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceSHA256"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceTimestamp"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z1111.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceSHA256"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceTimestamp"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z2222.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceSHA256"
time="2025-12-12T21:33:35Z" level=warning msg="deprecated or unknown config entry: SourceTimestamp"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.ManagementToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.SystemRootToken: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=warning msg="Clusters.z3333.Collections.BlobSigningKey: secret token is not set (use 32+ random characters from a-z, A-Z, 0-9)"
time="2025-12-12T21:33:35Z" level=info msg="waiting for z3333 to be ready"
time="2025-12-12T21:33:41Z" level=info msg=waitForConnect addr="127.0.0.33:37933"
time="2025-12-12T21:33:41Z" level=info msg=waitForConnect addr="127.0.0.22:33917"
time="2025-12-12T21:33:42Z" level=info msg=waitForConnect addr="127.0.0.11:37513"
time="2025-12-12T21:33:56Z" level=info msg="z3333 is ready"
time="2025-12-12T21:33:56Z" level=info msg="waiting for z1111 to be ready"
time="2025-12-12T21:33:57Z" level=info msg="z1111 is ready"
time="2025-12-12T21:33:57Z" level=info msg="waiting for z2222 to be ready"
time="2025-12-12T21:33:58Z" level=info msg="z2222 is ready"
time="2025-12-12T21:33:58Z" level=info msg="all clusters are ready"
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
time="2025-12-12T21:38:24Z" level=error msg="postgresql connect succeeded but ping failed" error="pq: remaining connection slots are reserved for non-replication superuser connections"
time="2025-12-12T21:38:24Z" level=warning msg="error updating container priorities" error="getdb: database connection error" worker=runContainerPriorityUpdateThread
2025/12/12 21:41:16 WARNING: Error retrieving services list: GET https://127.0.0.11:37513/arvados/v1/keep_services/accessible giving up after 14 attempt(s): Get "https://127.0.0.11:37513/arvados/v1/keep_services/accessible": dial tcp 127.0.0.11:37513: connect: connection refused (retrying in 3s)
2025/12/12 21:41:16 WARNING: Error retrieving services list: GET https://127.0.0.22:33917/arvados/v1/keep_services/accessible giving up after 15 attempt(s): Get "https://127.0.0.22:33917/arvados/v1/keep_services/accessible": dial tcp 127.0.0.22:33917: connect: connection refused (retrying in 3s)
2025/12/12 21:41:17 WARNING: Error retrieving services list: GET https://127.0.0.33:37933/arvados/v1/keep_services/accessible giving up after 15 attempt(s): Get "https://127.0.0.33:37933/arvados/v1/keep_services/accessible": dial tcp 127.0.0.33:37933: connect: connection refused (retrying in 3s)
2025/12/12 21:43:19 WARNING: Error retrieving services list: GET https://127.0.0.11:37513/arvados/v1/keep_services/accessible giving up after 14 attempt(s): Get "https://127.0.0.11:37513/arvados/v1/keep_services/accessible": dial tcp 127.0.0.11:37513: connect: connection refused (retrying in 3s)
2025/12/12 21:43:19 WARNING: Error retrieving services list: GET https://127.0.0.22:33917/arvados/v1/keep_services/accessible giving up after 14 attempt(s): Get "https://127.0.0.22:33917/arvados/v1/keep_services/accessible": dial tcp 127.0.0.22:33917: connect: connection refused (retrying in 3s)
2025/12/12 21:43:20 WARNING: Error retrieving services list: GET https://127.0.0.33:37933/arvados/v1/keep_services/accessible giving up after 15 attempt(s): Get "https://127.0.0.33:37933/arvados/v1/keep_services/accessible": dial tcp 127.0.0.33:37933: connect: connection refused (retrying in 3s)
coverage: 82.2% of statements
panic: test timed out after 10m0s
	running tests:
		Test (10m0s)

goroutine 7511 [running]:
testing.(*M).startAlarm.func1()
	/opt/go-1.24.10/src/testing/testing.go:2484 +0x394
created by time.goFunc
	/opt/go-1.24.10/src/time/sleep.go:215 +0x2d

goroutine 1 [chan receive, 10 minutes]:
testing.(*T).Run(0xc0004e4380, {0x112dc54?, 0xc00050fb30?}, 0x1191fa8)
	/opt/go-1.24.10/src/testing/testing.go:1859 +0x431
testing.runTests.func1(0xc0004e4380)
	/opt/go-1.24.10/src/testing/testing.go:2279 +0x37
testing.tRunner(0xc0004e4380, 0xc00050fc70)
	/opt/go-1.24.10/src/testing/testing.go:1792 +0xf4
testing.runTests(0xc000176180, {0x19faaa0, 0x1, 0x1}, {0x1aac300?, 0x7?, 0x1aaa740?})
	/opt/go-1.24.10/src/testing/testing.go:2277 +0x4b4
testing.(*M).Run(0xc0004a74a0)
	/opt/go-1.24.10/src/testing/testing.go:2142 +0x64a
main.main()
	_testmain.go:55 +0x9b

goroutine 19 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc00037e080)
	/home/jenkins/tmp/GOPATH/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f
created by go.opencensus.io/stats/view.init.0 in goroutine 1
	/home/jenkins/tmp/GOPATH/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d

goroutine 6 [chan receive, 8 minutes]:
gopkg.in/check%2ev1.(*suiteRunner).runFunc(...)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:677
gopkg.in/check%2ev1.(*suiteRunner).runFixture(0xc0011fe100?, 0xc0025a01c0?, {0x0?, 0xc000eda460?}, 0xc003492d20?)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:720 +0x45
gopkg.in/check%2ev1.(*suiteRunner).run(0xc0011fe100)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:629 +0x177
gopkg.in/check%2ev1.Run({0x11096a0?, 0xc00049c610?}, 0x1820af8?)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/run.go:92 +0x25
gopkg.in/check%2ev1.RunAll(0xc0030f1ef8)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/run.go:84 +0x75
gopkg.in/check%2ev1.TestingT(0xc0004e4540)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/run.go:72 +0x25e
git.arvados.org/arvados.git/lib/controller.Test(0xc0004e4540?)
	/tmp/workspace/run-tests-remainder/lib/controller/handler_test.go:36 +0x13
testing.tRunner(0xc0004e4540, 0x1191fa8)
	/opt/go-1.24.10/src/testing/testing.go:1792 +0xf4
created by testing.(*T).Run in goroutine 1
	/opt/go-1.24.10/src/testing/testing.go:1851 +0x413

goroutine 2511 [select, 8 minutes]:
gopkg.in/check%2ev1.(*resultTracker)._loopRoutine(0xc0025f8090)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:464 +0x93
created by gopkg.in/check%2ev1.(*resultTracker).start in goroutine 6
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:444 +0x4f

goroutine 27 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 8
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 10 [IO wait, 10 minutes]:
internal/poll.runtime_pollWait(0x7f43d849bed8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b2980?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b2980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b2980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000442cc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000442cc0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0001bd400, {0x12e46d8, 0xc000442cc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 9
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 11 [IO wait, 10 minutes]:
internal/poll.runtime_pollWait(0x7f43d849bdc0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b3000?, 0x7f442072cdf0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b3000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b3000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000443100)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000443100)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0001bd540, {0x12e46d8, 0xc000443100})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 9
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 24 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849bca8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b2000?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b2000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b2000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000442100)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000442100)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4100, {0x12e48e8, 0xc000442100})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 9
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 25 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849bb90, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b2080?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b2080)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b2080)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000442140)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000442140)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4200, {0x12e48e8, 0xc000442140})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 9
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 26 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849ba78, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b2f00?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b2f00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b2f00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000443240)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000443240)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0001bc280, {0x12e46d8, 0xc000443240})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 9
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 28 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00015fad0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 8
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 29 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00015fb80, {0x12e6df0?, 0xc000241710?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 8
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 96 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849b0a0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573f00?, 0x7f43d3fee3b8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573f00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573f00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009aec0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009aec0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0000b92c0, {0x12e46d8, 0xc00009aec0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 94
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 488 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0005268f0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 481
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 16 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849b2d0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0001b7700?, 0x7f43d82f6d0a?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0001b7700)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0001b7700)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009ad00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009ad00)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc00048a8c0, {0x12e46d8, 0xc00009ad00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 14
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 50 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0004a96c0, {0x12e6e28, 0xc0003ef270})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 8
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 117 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849b1b8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00037ef80?, 0x7f442072cdf0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc00037ef80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc00037ef80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0003ff280)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc0003ff280)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0005883c0, {0x12e46d8, 0xc0003ff280})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 115
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 611 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80f5c68, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001534d80?, 0x7f43d8274e40?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001534d80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001534d80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00150e940)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00150e940)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001524500, {0x12e46d8, 0xc00150e940})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 545
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 592 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046cc60, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 586
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1702 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b31f0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000871080?, 0xc003d0f000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000871080, {0xc003d0f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000871080, {0xc003d0f000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00206eda8, {0xc003d0f000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc001a6ca20, {0xc003d0f000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc0038cbce0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc0038cbce0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc001a6ca20)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1700
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 152 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0005260b0, {0x12e6df0?, 0xc0003d7590?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 149
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 100 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c0b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 13
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 595 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526c60, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 524
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 204 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264210, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 197
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 110 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 87
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 111 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c2c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 87
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 112 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c370, {0x12e6df0?, 0xc00030a1e0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 87
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1743 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8062f40, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001456d80?, 0xc001e1b000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001456d80, {0xc001e1b000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001456d80, {0xc001e1b000?, 0xc002891ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f188, {0xc001e1b000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0006ff350, {0xc001e1b000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00279ea20)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00279ea20, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000a6ae10, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 200 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d849b3e8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000870d80?, 0xc000185180?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000870d80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000870d80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009ae40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009ae40)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000738140, {0x12e46d8, 0xc00009ae40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 198
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 245 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82bc240, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0007eb000?, 0xc0005e0380?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0007eb000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0007eb000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0004438c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc0004438c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000854a00, {0x12e46d8, 0xc0004438c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 243
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 121 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264160, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 114
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 151 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526000, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 149
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 277 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80d3080, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b3480?, 0x7f43d8490ae8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b3480)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b3480)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0003ffe00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc0003ffe00)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000738280, {0x12e46d8, 0xc0003ffe00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 275
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 136 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c210, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 93
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 575 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d340, {0x12e6df0?, 0xc0002fe120?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 542
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 150 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 149
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 7164 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004105ba0, {0x12e6e28, 0xc00402abe0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1026
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 589 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d827e708, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573480?, 0x7f43d84a5ed8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573480)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573480)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00023e480)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00023e480)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000501180, {0x12e46d8, 0xc00023e480})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 587
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 849 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f698, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000612900?, 0xc001e08000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000612900, {0xc001e08000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000612900, {0xc001e08000?, 0xc001895ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f3f8, {0xc001e08000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001b78120, {0xc001e08000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc001e06000)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001e06000, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc001f465a0, {0x12e6df0, 0xc001b780c0})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 838
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1217 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002200210, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1213
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 747 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8284430, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000871c80?, 0x7f43d8270900?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000871c80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000871c80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009b940)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009b940)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc00183c780, {0x12e46d8, 0xc00009b940})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 745
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 310 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002644d0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 191
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 306 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82bc588, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000489680?, 0x7f43d82f56c8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000489680)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000489680)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009b200)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009b200)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000a0c280, {0x12e46d8, 0xc00009b200})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 192
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 301 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82bbbb0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000870f00?, 0x7f43d82f4a48?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000870f00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000870f00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000443800)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000443800)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000bbe280, {0x12e46d8, 0xc000443800})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 299
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 249 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c630, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 242
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1236 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527760, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1197
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 281 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0005262c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 274
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1760 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00059b560)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1757
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 7171 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003279d40, {0x12e6e28, 0xc002614780})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 840
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 329 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 220
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 330 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264840, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 220
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 331 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002648f0, {0x12e6df0?, 0xc0004a5650?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 220
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 574 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d290, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 542
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 573 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 542
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 7206 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003bcb2b0, {0x12e6e28, 0xc002abf770})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 925
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 354 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526210, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 298
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 508 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264d10, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 583
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 527 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82c3430, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b3800?, 0x7f43d80efa30?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000b3800)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0000b3800)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000523440)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000523440)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000cf8280, {0x12e46d8, 0xc000523440})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 525
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 861 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 872
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 394 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80d2590, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000eacd80?, 0x7f43d82f44a8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000eacd80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000eacd80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8a940)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000c8a940)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000e903c0, {0x12e46d8, 0xc000c8a940})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 392
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 372 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80d28d8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000c8e400?, 0x7f43d82f4a48?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000c8e400)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000c8e400)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00023fe80)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00023fe80)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000c45b80, {0x12e46d8, 0xc00023fe80})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 370
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 432 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82c3e08, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573280?, 0x7f43d8273680?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573280)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573280)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0004437c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc0004437c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000a0c3c0, {0x12e46d8, 0xc0004437c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 430
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 375 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c9a0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 369
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 854 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265760, {0x12e6df0?, 0xc0014adda0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 851
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 466 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c8f0, {0x12e6df0?, 0xc00030a840?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 222
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 225 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c840, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 222
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 484 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82c3778, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613400?, 0xc000a42c40?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000613400)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000613400)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f19a80)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f19a80)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000dbe8c0, {0x12e46d8, 0xc000f19a80})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 482
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 397 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526630, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 391
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 638 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82840e8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000ed7f00?, 0xc001902000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000ed7f00, {0xc001902000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000ed7f00, {0xc001902000?, 0xc001891ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00011d8f0, {0xc001902000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0015592c0, {0xc001902000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc001900000)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001900000, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc0012ee1b0, {0x12e6df0, 0xc001559260})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 707
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 224 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 222
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 853 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002656b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 851
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 852 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 851
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 549 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d82c3548, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000871000?, 0x7f43d82f44a8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000871000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000871000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000443740)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000443740)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000de6280, {0x12e46d8, 0xc000443740})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 547
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 859 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f008, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001e40100?, 0xc000f11000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001e40100, {0xc000f11000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001e40100, {0xc000f11000?, 0xc001b93ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d41f0, {0xc000f11000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc002104c30, {0xc000f11000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00206c1e0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00206c1e0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc0020d6000, {0x12e6df0, 0xc001e460c0})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 828
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 462 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 460
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 436 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00015fc30, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 429
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 463 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046cdc0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 460
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 509 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264dc0, {0x12e6df0?, 0xc00110c060?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 583
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 464 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046ce70, {0x12e6df0?, 0xc00104a570?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 460
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1219 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d809dc38, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001417480?, 0x7f43d80178c8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001417480)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001417480)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001ad3840)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001ad3840)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001ddf180, {0x12e46d8, 0xc001ad3840})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1153
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 921 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8010e50, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001417280?, 0xc001047500?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001417280)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001417280)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001ad30c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001ad30c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001f08280, {0x12e46d8, 0xc001ad30c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 919
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 694 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d827e820, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000741100?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000741100)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000741100)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f19240)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f19240)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000de68c0, {0x12e46d8, 0xc000f19240})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 692
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 553 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046cfd0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 546
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 615 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d4a0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 544
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 507 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 583
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 6993 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001710750, {0x12e6e28, 0xc003f2bc20})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 375
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 862 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526fd0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 872
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 739 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d970, {0x12e6df0?, 0xc00041d320?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 640
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 738 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d8c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 640
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 821 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f7b0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000612880?, 0xc001a5e000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000612880, {0xc001a5e000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000612880, {0xc001a5e000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc000074958, {0xc001a5e000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc001db05a0, {0xc001a5e000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001d34cc0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001d34cc0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc001db05a0)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 846
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 642 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 624
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 643 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d6b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 624
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 644 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d760, {0x12e6df0?, 0xc0013f1260?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 624
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 907 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800faf8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0017c2e80?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0017c2e80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0017c2e80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8a400)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000c8a400)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000a0d180, {0x12e46d8, 0xc000c8a400})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 905
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 830 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002658c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 823
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 665 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc0012ea360)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 635
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 822 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc001db05a0)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 846
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 653 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 663
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 654 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264c60, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 663
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 655 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264e70, {0x12e6df0?, 0xc000d44150?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 663
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 730 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d1e0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 724
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 7092 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004104d00, {0x12e6e28, 0xc001bde000})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 697
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 705 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8284778, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001534f80?, 0x7f43d80fff80?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001534f80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001534f80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000443c80)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000443c80)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0013b4280, {0x12e46d8, 0xc000443c80})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 703
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 697 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526b00, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 691
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1200 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8059020, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000ed7300?, 0x7f43d80128c0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000ed7300)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000ed7300)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f19080)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f19080)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0020cab40, {0x12e46d8, 0xc000f19080})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1198
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 781 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8283c88, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0001b7b80?, 0x7f43d810b1e0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0001b7b80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0001b7b80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f18ac0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f18ac0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0013d2500, {0x12e46d8, 0xc000f18ac0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 779
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 758 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8283fd0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001b1d800?, 0x7f43d82e1c18?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001b1d800)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001b1d800)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001ad2e00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001ad2e00)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001b368c0, {0x12e46d8, 0xc001ad2e00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 756
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 6983 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc00240b930, {0x12e6e28, 0xc003f2ac80})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 310
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 709 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000264fd0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 702
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 863 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527130, {0x12e6df0?, 0xc0017e6bd0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 872
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 664 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8284200, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000ed7e80?, 0xc0016b2000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000ed7e80, {0xc0016b2000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000ed7e80, {0xc0016b2000?, 0x409b14?, 0xc0016a4cc0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc000075ec8, {0xc0016b2000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc0012ea360, {0xc0016b2000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc0012ed920)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc0012ed920, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc0012ea360)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 635
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 840 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046dd90, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 673
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 727 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80f6758, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573700?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573700)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573700)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00023e2c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00023e2c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0016763c0, {0x12e46d8, 0xc00023e2c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 725
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 826 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8283a58, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002043980?, 0x7f43d8106160?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002043980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002043980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00150ff00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00150ff00)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc002045cc0, {0x12e46d8, 0xc00150ff00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 824
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 641 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 640
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 750 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265130, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 744
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 878 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f580, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0007eb400?, 0x7f43d80ff620?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0007eb400)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0007eb400)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000cd2ac0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000cd2ac0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc000d90640, {0x12e46d8, 0xc000cd2ac0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 876
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 6988 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001710680, {0x12e6e28, 0xc003f2b5e0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 354
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6998 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0007c5e10, {0x12e6e28, 0xc0017ac320})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 331
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 809 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046da20, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 802
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 770 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8284318, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000eacf00?, 0x7f43d814a978?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000eacf00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000eacf00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000cd2a40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000cd2a40)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc00104e3c0, {0x12e46d8, 0xc000cd2a40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 736
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 761 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046dad0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 755
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 668 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002653f0, {0x12e6df0?, 0xc001ba2060?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 820
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 7004 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003278000, {0x12e6e28, 0xc001637270})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 436
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 773 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526e70, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 735
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 836 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8283940, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0007ebe00?, 0x7f43d82dc7f8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0007ebe00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0007ebe00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f19d40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f19d40)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001d1dcc0, {0x12e46d8, 0xc000f19d40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 834
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 667 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265340, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 820
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 805 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8283b70, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001417000?, 0x7f43d82f4a48?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001417000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001417000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000523100)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000523100)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0018f6280, {0x12e46d8, 0xc000523100})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 803
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 833 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc001e4e120)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 884
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 784 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002642c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 778
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 666 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 820
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 911 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046d810, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 904
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 763 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800fc10, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000612300?, 0xc00179a000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000612300, {0xc00179a000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000612300, {0xc00179a000?, 0xc001c8bad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0000748d0, {0xc00179a000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0017c6540, {0xc00179a000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00162b080)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00162b080, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc001794090, {0x12e6df0, 0xc0017c63c0})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 807
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 832 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f238, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0021b3680?, 0xc000aa5000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0021b3680, {0xc000aa5000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc0021b3680, {0xc000aa5000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc000414070, {0xc000aa5000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc001e4e120, {0xc000aa5000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaa000)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa000, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc001e4e120)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 884
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 818 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800fd28, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0019cf680?, 0xc001a4c000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0019cf680, {0xc001a4c000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc0019cf680, {0xc001a4c000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d5b68, {0xc001a4c000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc001ce6900, {0xc001a4c000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00192fec0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00192fec0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc001ce6900)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 815
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 819 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc001ce6900)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 815
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1063 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80109f0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001e40e80?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001e40e80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001e40e80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8ac40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000c8ac40)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0021b8280, {0x12e46d8, 0xc000c8ac40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1061
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 995 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800fe40, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573980?, 0x7f43d80931e8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001fbe940)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001fbe940)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001ddeb40, {0x12e46d8, 0xc001fbe940})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 945
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 959 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d800f120, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000ed7a80?, 0x7f43d8018728?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000ed7a80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000ed7a80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000f19000)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000f19000)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc002400500, {0x12e46d8, 0xc000f19000})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 957
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 7001 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc002903450, {0x12e6e28, 0xc000cca320})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 397
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 946 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 873
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 947 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265810, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 873
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 948 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265a20, {0x12e6df0?, 0xc0002423c0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 873
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 881 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0005273f0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 875
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 925 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265c30, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 918
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1021 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002286160, {0x12e6df0?, 0xc001ba3740?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 984
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1812 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53250, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000488d00?, 0xc0024c1000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000488d00, {0xc0024c1000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000488d00, {0xc0024c1000?, 0xc003099ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d4400, {0xc0024c1000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc00208ec00, {0xc0024c1000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00264a960)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a960, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc00058b8c0, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1139 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d809e2c8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0017c2180?, 0xc001a75180?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0017c2180)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0017c2180)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000cd2b40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc000cd2b40)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001f5c640, {0x12e46d8, 0xc000cd2b40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1089
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 998 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022000b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 944
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1049 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022004d0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1043
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1020 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022860b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 984
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1099 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d809df80, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001bb6e80?, 0xc0023341c0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001bb6e80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001bb6e80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009b1c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00009b1c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x7f7185?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001406780, {0x12e46d8, 0xc00009b1c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1097
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 1013 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 983
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 1014 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022002c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 983
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1015 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002200370, {0x12e6df0?, 0xc001a580f0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 983
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1026 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265d90, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 956
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1046 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8010b08, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002726f80?, 0x7f43d80199e8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002726f80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002726f80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001875840)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001875840)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc002728500, {0x12e46d8, 0xc001875840})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1044
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 1019 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 984
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 7081 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001be6ea0, {0x12e6e28, 0xc0030b91d0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 655
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1036 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 1024
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 1301 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8058aa8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002cfe680?, 0x7f43d80128c0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002cfe680)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002cfe680)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0018746c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc0018746c0)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc002ae3a40, {0x12e46d8, 0xc0018746c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1299
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 1037 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022862c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1024
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1038 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002286370, {0x12e6df0?, 0xc0024985d0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1024
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1119 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d809de68, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0021b2d00?, 0x1acdec0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0021b2d00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0021b2d00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001fbea00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc001fbea00)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc001dde3c0, {0x12e46d8, 0xc001fbea00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1117
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 7195 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0038c41a0, {0x12e6e28, 0xc0039892c0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 947
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1173 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d809dd50, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001535500?, 0x7f43d80929c8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001535500)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001535500)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00292d440)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).AcceptTCP(0xc00292d440)
	/opt/go-1.24.10/src/net/tcpsock.go:367 +0x30
git.arvados.org/arvados.git/sdk/go/httpserver.tcpKeepAliveListener.Accept({0x19f8380?})
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:92 +0x13
net/http.(*Server).Serve(0xc0022b4140, {0x12e46d8, 0xc00292d440})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:53 +0x85
created by git.arvados.org/arvados.git/sdk/go/httpserver.(*Server).Start in goroutine 1171
	/tmp/workspace/run-tests-remainder/sdk/go/httpserver/httpserver.go:48 +0x205

goroutine 1066 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002286000, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1060
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2549 [syscall, 9 minutes]:
os/signal.signal_recv()
	/opt/go-1.24.10/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
	/opt/go-1.24.10/src/os/signal/signal_unix.go:23 +0x13
created by os/signal.Notify.func1.1 in goroutine 2512
	/opt/go-1.24.10/src/os/signal/signal.go:152 +0x1f

goroutine 7200 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0038c4f70, {0x12e6e28, 0xc003989ea0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1015
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1103 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000526dc0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1096
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1176 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022006e0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1170
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1864 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53138, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613780?, 0xc0027f5000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613780, {0xc0027f5000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613780, {0xc0027f5000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c405f8, {0xc0027f5000?, 0x40990f?, 0xc001a65f20?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000626120, {0xc0027f5000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaaba0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaaba0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000626120)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1875
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 7153 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003bcb1e0, {0x12e6e28, 0xc002abe460})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 881
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1142 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0002654a0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1088
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1154 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527290, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1116
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1877 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53020, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613800?, 0xc0024f3000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613800, {0xc0024f3000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613800, {0xc0024f3000?, 0xc00309bad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0022029e8, {0xc0024f3000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc00208f2f0, {0xc0024f3000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00264a9c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a9c0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000d498c0, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 7190 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001b87ba0, {0x12e6e28, 0xc003988b40})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 911
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1131 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 1129
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 1799 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53c28, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24880?, 0xc002505000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24880, {0xc002505000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24880, {0xc002505000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c40498, {0xc002505000?, 0x40990f?, 0xc001a30f30?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00019a120, {0xc002505000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaa660)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa660, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00019a120)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1797
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1880 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc001b860d0, {0x12e6e28, 0xc002c56000})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1879
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1703 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc001a6ca20)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1700
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1132 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265600, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1129
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1133 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000265ad0, {0x12e6df0?, 0xc0027d60f0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1129
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1303 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 1298
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 2037 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0017109c0, {0x12e6e28, 0xc0016fe500})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2021
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1888 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8064bd0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000902980?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000902980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000902980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001e0a600)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc001e0a600)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bed00, {0x12e48e8, 0xc001e0a600})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1887
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 7181 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001b875f0, {0x12e6e28, 0xc003988190})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 830
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1248 [chan receive (nil chan), 9 minutes]:
git.arvados.org/arvados.git/lib/controller.(*Handler).setup.func1()
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:117 +0x32
created by git.arvados.org/arvados.git/lib/controller.(*Handler).setup in goroutine 1224
	/tmp/workspace/run-tests-remainder/lib/controller/handler.go:116 +0x179

goroutine 1249 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527970, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1224
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1266 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527a20, {0x12e6df0?, 0xc0025f2cc0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1224
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1789 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53e58, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24700?, 0xc0023a2000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24700, {0xc0023a2000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24700, {0xc0023a2000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c40358, {0xc0023a2000?, 0x40990f?, 0xc000693a70?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000367560, {0xc0023a2000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaa240)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa240, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000367560)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1787
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1674 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80636e8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24280?, 0xc001e9f000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24280, {0xc001e9f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24280, {0xc001e9f000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c400c8, {0xc001e9f000?, 0x40990f?, 0xc0016edce0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000366480, {0xc001e9f000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc0021efce0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc0021efce0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000366480)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1672
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 2047 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002201290, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2043
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1830 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f539f8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001457380?, 0xc002429000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001457380, {0xc002429000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001457380, {0xc002429000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f248, {0xc002429000?, 0x40990f?, 0xc001369aa0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000b610e0, {0xc002429000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00283e300)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00283e300, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000b610e0)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1828
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 2525 [select, 9 minutes]:
git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start.func1()
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:119 +0xf8
created by git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start in goroutine 2512
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:116 +0x205

goroutine 1689 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00046c580, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1685
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1215 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b3ab0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0030bc780?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0030bc780)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0030bc780)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001874640)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc001874640)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4500, {0x12e48e8, 0xc001874640})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1214
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1304 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527c30, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1298
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1305 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527ce0, {0x12e6df0?, 0xc002a5a930?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1298
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1804 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f536b0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24a00?, 0xc002515000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24a00, {0xc002515000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24a00, {0xc002515000?, 0xc000e57ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c404c8, {0xc002515000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0020a84e0, {0xc002515000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc001eaa720)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa720, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc001a6fdd0, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1846 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f537c8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613500?, 0xc00269a000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613500, {0xc00269a000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613500, {0xc00269a000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0022026d8, {0xc00269a000?, 0x40990f?, 0xc0022fbef0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00079fc20, {0xc00269a000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00279efc0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00279efc0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00079fc20)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1844
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1309 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527e40, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1298
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 7076 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001be64e0, {0x12e6e28, 0xc0030b85a0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 644
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1847 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00079fc20)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1844
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 2410 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0032781a0, {0x12e6e28, 0xc002a6e050})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2335
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1853 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000a66c60)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1850
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 7176 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001b87110, {0x12e6e28, 0xc002615450})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 854
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1831 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000b610e0)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1828
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1852 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53598, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613600?, 0xc002775000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613600, {0xc002775000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613600, {0xc002775000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc002202880, {0xc002775000?, 0x40990f?, 0xc0021a9c80?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000a66c60, {0xc002775000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00279f680)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00279f680, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000a66c60)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1850
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1338 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0007c44e0, {0x12e6e28, 0xc0012d60f0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1337
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1865 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000626120)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1875
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1862 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53368, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24d80?, 0xc0027ca000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24d80, {0xc0027ca000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24d80, {0xc0027ca000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c405c8, {0xc0027ca000?, 0x40990f?, 0xc0020a98f0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00041e900, {0xc0027ca000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaa9c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa9c0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00041e900)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1860
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1322 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8058990, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000573300?, 0x900000036?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000573300)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000573300)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8a700)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000c8a700)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4800, {0x12e48e8, 0xc000c8a700})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1321
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1324 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022864d0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1320
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1803 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f538e0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24980?, 0xc002465000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24980, {0xc002465000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24980, {0xc002465000?, 0xc002dd5ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c404b8, {0xc002465000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001369e00, {0xc002465000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00283e360)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00283e360, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc001a6fd40, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1438 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc002b3c0d0, {0x12e6e28, 0xc00139a5a0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1424
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1800 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00019a120)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1797
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1765 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8063170, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613080?, 0xc003cfb000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613080, {0xc003cfb000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613080, {0xc003cfb000?, 0xc00288fad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0022022d8, {0xc003cfb000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001701050, {0xc003cfb000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00279e7e0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00279e7e0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc001794b40, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1679 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8063288, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613000?, 0xc001cda000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613000, {0xc001cda000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613000, {0xc001cda000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c40108, {0xc001cda000?, 0x40990f?, 0xc001700ea0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00059b9e0, {0xc001cda000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc0021efe60)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc0021efe60, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00059b9e0)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1763
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1773 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8062d10, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613280?, 0xc002345000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613280, {0xc002345000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613280, {0xc002345000?, 0xc002d17ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc002202480, {0xc002345000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001d6d530, {0xc002345000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00264a840)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a840, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc0017958c0, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1720 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80635d0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000488800?, 0xc0026b8000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000488800, {0xc0026b8000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000488800, {0xc0026b8000?, 0xc002893ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d4060, {0xc0026b8000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001d6c6f0, {0xc0026b8000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00264a6c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a6c0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc00058a750, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 2023 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc000e8be10, {0x12e6e28, 0xc002c0cff0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2022
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1807 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53480, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24c80?, 0xc00251d000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24c80, {0xc00251d000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24c80, {0xc00251d000?, 0xc00309dad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c40518, {0xc00251d000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0020a8b40, {0xc00251d000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc001eaa7e0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa7e0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000d50240, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1687 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b2d90, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002726880?, 0x900000036?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002726880)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002726880)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000522900)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000522900)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001be900, {0x12e48e8, 0xc000522900})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1686
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1458 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0007c5d40, {0x12e6e28, 0xc001b3ab40})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1457
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1445 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b2fc0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000c8e700?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000c8e700)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000c8e700)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc002768480)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc002768480)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bec00, {0x12e48e8, 0xc002768480})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1444
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1447 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c2c60, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1443
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2055 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8034ab8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001bb6780?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001bb6780)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001bb6780)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00326c500)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00326c500)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4c00, {0x12e48e8, 0xc00326c500})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2054
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1680 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00059b9e0)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1763
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1649 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8063b48, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000612180?, 0xc002698000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000612180, {0xc002698000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000612180, {0xc002698000?, 0xc000e5dad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc002202000, {0xc002698000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc000ed3d40, {0xc002698000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc002c0f4a0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc002c0f4a0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000566750, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1740 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80633a0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001456c80?, 0xc003d2f000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001456c80, {0xc003d2f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001456c80, {0xc003d2f000?, 0xc002dcfad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f128, {0xc003d2f000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001793110, {0xc003d2f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc002195f20)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc002195f20, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000a6a7e0, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1782 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000367200)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1779
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 7159 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004105520, {0x12e6e28, 0xc002901180})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 863
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1476 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b3420, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0021b2680?, 0x900000036?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0021b2680)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0021b2680)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001874c80)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc001874c80)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bf000, {0x12e48e8, 0xc001874c80})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 1475
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1478 [select, 6 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002286dc0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1474
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1790 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000367560)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1787
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1744 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53d40, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001456e00?, 0xc002347000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001456e00, {0xc002347000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001456e00, {0xc002347000?, 0xc00288dad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f1d0, {0xc002347000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001d6da10, {0xc002347000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00264a8a0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a8a0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc000a6b200, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 2030 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8063eb0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0025fa680?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0025fa680)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0025fa680)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001875ec0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc001875ec0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bf900, {0x12e48e8, 0xc001875ec0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2029
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 1724 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8062e28, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000488a80?, 0xc001f6b000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000488a80, {0xc001f6b000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000488a80, {0xc001f6b000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d40e0, {0xc001f6b000?, 0x40990f?, 0xc001d6d1a0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000687320, {0xc001f6b000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00264a7e0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00264a7e0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000687320)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1722
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1710 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0024f44e0, {0x12e6e28, 0xc003010820})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1709
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1725 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000687320)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1722
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1810 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f53b10, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000488c00?, 0xc002513000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000488c00, {0xc002513000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000488c00, {0xc002513000?, 0xc000e5bad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0003d4128, {0xc002513000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc001a31770, {0xc002513000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc001eaa6c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa6c0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc00058b560, {0x12e6df0, 0xc0007e4360})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1687
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 1675 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc000366480)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1672
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1781 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8063058, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000f24580?, 0xc001cdd000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000f24580, {0xc001cdd000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000f24580, {0xc001cdd000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001c40190, {0xc001cdd000?, 0x40990f?, 0xc001f78e40?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc000367200, {0xc001cdd000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc001eaa0c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc001eaa0c0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc000367200)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1779
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 2148 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00239f290, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2112
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 1759 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80634b8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000612f00?, 0xc003d0e000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000612f00, {0xc003d0e000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000612f00, {0xc003d0e000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0022021d0, {0xc003d0e000?, 0x40990f?, 0xc001dcd020?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00059b560, {0xc003d0e000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00279e600)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00279e600, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00059b560)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1757
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 6965 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0008ae1a0, {0x12e6e28, 0xc001c67540})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 204
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1683 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b3538, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0000b2600?, 0xc0029ed000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0000b2600, {0xc0029ed000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc0000b2600, {0xc0029ed000?, 0xc0022abad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1f720, {0xc0029ed000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc002b4dda0, {0xc0029ed000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc002bd53e0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc002bd53e0, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc0012efb90, {0x12e6df0, 0xc002104240})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 1476
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 2045 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8064658, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00037f000?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc00037f000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc00037f000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00150eb40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00150eb40)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bf600, {0x12e48e8, 0xc00150eb40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2044
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 7065 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003278dd0, {0x12e6e28, 0xc0029fad70})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 784
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2363 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc002b3c680, {0x12e6e28, 0xc003b34000})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2362
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1695 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80b2c78, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001456700?, 0xc00301c000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001456700, {0xc00301c000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001456700, {0xc00301c000?, 0x409b14?, 0xc0008fdcc0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc001a1eec0, {0xc00301c000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc00025c360, {0xc00301c000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc0024c7ce0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc0024c7ce0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc00025c360)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 1693
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 1696 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00025c360)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1693
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 7070 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003279ad0, {0x12e6e28, 0xc0029fbb30})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 668
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6970 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0008ae750, {0x12e6e28, 0xc001f2d180})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 225
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 1863 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc00041e900)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 1860
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 1890 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00239e580, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 1886
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 7046 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0041044e0, {0x12e6e28, 0xc0014a79f0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 595
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2466 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002200c60, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2430
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2032 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002287e40, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2028
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2237 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc000527b80, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2233
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 6977 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004104000, {0x12e6e28, 0xc00126e960})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 574
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6922 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0010a0c30, {0x12e6e28, 0xc001b3ae60})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 553
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2174 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0038c4340, {0x12e6e28, 0xc003b34280})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2173
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6927 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0010a1d40, {0x12e6e28, 0xc002027900})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 615
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7051 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004104820, {0x12e6e28, 0xc001e92e10})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 509
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6908 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc00059c820, {0x12e6e28, 0xc0027251d0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 112
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2146 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8034540, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002f98c80?, 0x8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002f98c80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002f98c80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00326cb80)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00326cb80)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4f00, {0x12e48e8, 0xc00326cb80})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2113
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 7102 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004104f70, {0x12e6e28, 0xc0016ff720})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 809
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2057 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c3290, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2053
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2110 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8034888, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001457900?, 0xc003990000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001457900, {0xc003990000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc001457900, {0xc003990000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00011d610, {0xc003990000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc0027985a0, {0xc003990000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc00398a060)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00398a060, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc0027985a0)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 2061
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 2123 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc003814750, {0x12e6e28, 0xc003988280})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2122
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6931 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0004f2ea0, {0x12e6e28, 0xc002f26370})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 100
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2111 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc0027985a0)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 2061
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 2109 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d80349a0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000613a00?, 0xc00398c000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000613a00, {0xc00398c000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000613a00, {0xc00398c000?, 0xc00319fad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00011d608, {0xc00398c000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc0033a0930, {0xc00398c000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc00398a000)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc00398a000, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc002ce6090, {0x12e6df0, 0xc0033a06c0})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 2055
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 2076 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc001be7790, {0x12e6e28, 0xc0024c5180})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2075
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2154 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8034428, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0030bd100?, 0xc003a91000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0030bd100, {0xc003a91000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc0030bd100, {0xc003a91000?, 0x409b14?, 0x0?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00011da68, {0xc003a91000?, 0x40990f?, 0xc00042d0b0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*persistConn).Read(0xc002b4a360, {0xc003a91000?, 0x804865?, 0x12d9dc0?})
	/opt/go-1.24.10/src/net/http/transport.go:2125 +0x47
bufio.(*Reader).fill(0xc003b0c6c0)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc003b0c6c0, 0x1)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*persistConn).readLoop(0xc002b4a360)
	/opt/go-1.24.10/src/net/http/transport.go:2278 +0x172
created by net/http.(*Transport).dialConn in goroutine 2152
	/opt/go-1.24.10/src/net/http/transport.go:1947 +0x174f

goroutine 2155 [select, 9 minutes]:
net/http.(*persistConn).writeLoop(0xc002b4a360)
	/opt/go-1.24.10/src/net/http/transport.go:2593 +0xe7
created by net/http.(*Transport).dialConn in goroutine 2152
	/opt/go-1.24.10/src/net/http/transport.go:1948 +0x17a5

goroutine 2497 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00239e8f0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2493
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2081 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8034310, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc00037f080?, 0xc003b0f000?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00037f080, {0xc003b0f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc00037f080, {0xc003b0f000?, 0xc0031a1ad0?, 0x4fd2e5?})
	/opt/go-1.24.10/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00206f3c8, {0xc003b0f000?, 0x0?, 0x0?})
	/opt/go-1.24.10/src/net/net.go:194 +0x45
net/http.(*connReader).Read(0xc00391d0b0, {0xc003b0f000, 0x1000, 0x1000})
	/opt/go-1.24.10/src/net/http/server.go:798 +0x159
bufio.(*Reader).fill(0xc003b0c720)
	/opt/go-1.24.10/src/bufio/bufio.go:113 +0x103
bufio.(*Reader).Peek(0xc003b0c720, 0x4)
	/opt/go-1.24.10/src/bufio/bufio.go:152 +0x53
net/http.(*conn).serve(0xc0009ae240, {0x12e6df0, 0xc0038b2840})
	/opt/go-1.24.10/src/net/http/server.go:2137 +0x785
created by net/http.(*Server).Serve in goroutine 2146
	/opt/go-1.24.10/src/net/http/server.go:3454 +0x485

goroutine 2158 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f565f8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001457d80?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001457d80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001457d80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00326d600)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00326d600)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5500, {0x12e48e8, 0xc00326d600})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2157
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2145 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d8033fc8, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0020dc800?, 0x8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0020dc800)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0020dc800)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0039384c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc0039384c0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5200, {0x12e48e8, 0xc0039384c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2144
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2137 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0032791e0, {0x12e6e28, 0xc003829e50})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2136
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2179 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002201600, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2143
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2160 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc00239f4a0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2156
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2224 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc003815ba0, {0x12e6e28, 0xc003f2a280})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2223
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2417 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f5ad60, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001416d00?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001416d00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001416d00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc001874780)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc001874780)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5000, {0x12e48e8, 0xc001874780})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2416
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 7117 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004ef6680, {0x12e6e28, 0xc002d02aa0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1066
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2482 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1effdf0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002602780?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002602780)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002602780)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00023edc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00023edc0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bf400, {0x12e48e8, 0xc00023edc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2369
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 6945 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0007c4b60, {0x12e6e28, 0xc001085270})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 281
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6978 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc00240a750, {0x12e6e28, 0xc003f2a550})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 249
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6936 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0004f3520, {0x12e6e28, 0xc002f26b90})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 136
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2279 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f56080, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001e40a80?, 0x8?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001e40a80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001e40a80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00326dbc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00326dbc0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5800, {0x12e48e8, 0xc00326dbc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2278
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2281 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0022018c0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2277
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2419 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c2210, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2415
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2400 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc003814c30, {0x12e6e28, 0xc003fee960})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2399
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 6957 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc000418680, {0x12e6e28, 0xc00241b360})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 152
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2432 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f00020, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc001456800?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001456800)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc001456800)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00009acc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00009acc0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5400, {0x12e48e8, 0xc00009acc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2431
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2546 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1eff760, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002042f80?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002042f80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002042f80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8bcc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000c8bcc0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bfc00, {0x12e48e8, 0xc000c8bcc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2512
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 7029 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003278340, {0x12e6e28, 0xc001d2b270})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 488
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7016 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001711040, {0x12e6e28, 0xc001538910})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 464
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2307 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f55b08, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0016e4d00?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0016e4d00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0016e4d00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0038c9e40)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc0038c9e40)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5c00, {0x12e48e8, 0xc0038c9e40})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2306
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2299 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0040a41a0, {0x12e6e28, 0xc0040941e0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2298
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2309 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c36b0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2305
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 6952 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0004185b0, {0x12e6e28, 0xc00241a910})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 121
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2319 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc0007c5ad0, {0x12e6e28, 0xc000f9f9a0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2318
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2342 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f5b3f0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000740a00?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000740a00)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc000740a00)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc003080440)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc003080440)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4700, {0x12e48e8, 0xc003080440})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2341
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2344 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c2000, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2340
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2228 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc001b86410, {0x12e6e28, 0xc002cba050})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2227
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2235 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1f5b1c0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002726a80?, 0x10066a0?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002726a80)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002726a80)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000522fc0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000522fc0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c4b00, {0x12e48e8, 0xc000522fc0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2234
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2484 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc0030c2580, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2368
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2547 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1eff648, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002043000?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002043000)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002043000)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc000c8bd00)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc000c8bd00)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bfd00, {0x12e48e8, 0xc000c8bd00})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2512
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2446 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc00304aa90, {0x12e6e28, 0xc0037c81e0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2445
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2495 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1effbc0, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc0019ce980?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0019ce980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc0019ce980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc0027689c0)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc0027689c0)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0000c5b00, {0x12e48e8, 0xc0027689c0})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2494
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2454 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc00418eb60, {0x12e6e28, 0xc00416c370})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2453
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2478 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f43d1eff990, 0x72)
	/opt/go-1.24.10/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc002f98980?, 0x380016?, 0x0)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
	/opt/go-1.24.10/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002f98980)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:620 +0x295
net.(*netFD).accept(0xc002f98980)
	/opt/go-1.24.10/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc00326c680)
	/opt/go-1.24.10/src/net/tcpsock_posix.go:159 +0x1b
net.(*TCPListener).Accept(0xc00326c680)
	/opt/go-1.24.10/src/net/tcpsock.go:380 +0x30
net/http.(*Server).Serve(0xc0001bf800, {0x12e48e8, 0xc00326c680})
	/opt/go-1.24.10/src/net/http/server.go:3424 +0x30c
net/http/httptest.(*Server).goServe.func1()
	/opt/go-1.24.10/src/net/http/httptest/server.go:311 +0x55
created by net/http/httptest.(*Server).goServe in goroutine 2477
	/opt/go-1.24.10/src/net/http/httptest/server.go:309 +0x65

goroutine 2506 [select, 9 minutes]:
database/sql.(*DB).connectionOpener(0xc002a67040, {0x12e6e28, 0xc002bb4730})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 2505
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 2480 [select, 4 minutes]:
git.arvados.org/arvados.git/lib/controller/localdb.(*Conn).runContainerPriorityUpdateThread(0xc002286fd0, {0x12e6cd8?, 0x1acc1a0?})
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/container.go:43 +0x155
created by git.arvados.org/arvados.git/lib/controller/localdb.NewConn in goroutine 2476
	/tmp/workspace/run-tests-remainder/lib/controller/localdb/conn.go:57 +0x1a5

goroutine 2556 [syscall, 8 minutes]:
syscall.Syscall(0xd9, 0x30, 0xc0043a6000, 0x2000)
	/opt/go-1.24.10/src/syscall/syscall_linux.go:73 +0x25
syscall.Getdents(0x7f43d80c7650?, {0xc0043a6000?, 0x20?, 0xc000400008?})
	/opt/go-1.24.10/src/syscall/zsyscall_linux_amd64.go:479 +0x3b
syscall.ReadDirent(...)
	/opt/go-1.24.10/src/syscall/syscall_linux.go:1006
internal/poll.ignoringEINTRIO(...)
	/opt/go-1.24.10/src/internal/poll/fd_unix.go:745
internal/poll.(*FD).ReadDirent(0x1a090e0?, {0xc0043a6000, 0x2000, 0x2000})
	/opt/go-1.24.10/src/internal/poll/fd_unixjs.go:58 +0x1dc
os.(*File).readdir(0xc004eec808, 0x400, 0x0)
	/opt/go-1.24.10/src/os/dir_unix.go:78 +0x21e
os.(*File).Readdirnames(0x1f?, 0xc0040484c0?)
	/opt/go-1.24.10/src/os/dir.go:73 +0x1a
os.removeAllFrom(0x1e?, {0xc0040484c0, 0x5})
	/opt/go-1.24.10/src/os/removeall_at.go:102 +0x5f7
os.removeAllFrom(0x49?, {0xc0040483f0, 0xe})
	/opt/go-1.24.10/src/os/removeall_at.go:114 +0x7da
os.removeAllFrom(0x3f?, {0xc006891300, 0x31})
	/opt/go-1.24.10/src/os/removeall_at.go:114 +0x7da
os.removeAllFrom(0x0?, {0xc0036f6305, 0x1e})
	/opt/go-1.24.10/src/os/removeall_at.go:114 +0x7da
os.removeAll({0xc0036f6300, 0x23})
	/opt/go-1.24.10/src/os/removeall_at.go:48 +0x21e
os.RemoveAll(...)
	/opt/go-1.24.10/src/os/path.go:74
git.arvados.org/arvados.git/lib/boot.(*Supervisor).runCluster(0xc00327ab00)
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:431 +0x2eac
git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start.func4()
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:184 +0xd1
created by git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start in goroutine 2512
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:177 +0x5af

goroutine 2557 [chan receive, 8 minutes]:
git.arvados.org/arvados.git/lib/boot.(*Supervisor).Wait(...)
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:197
git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start.func3()
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:170 +0xd5
created by git.arvados.org/arvados.git/lib/boot.(*Supervisor).Start in goroutine 2512
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:166 +0x559

goroutine 7112 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004ef6340, {0x12e6e28, 0xc002d02690})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1049
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7225 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0038c5110, {0x12e6e28, 0xc0040953b0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1021
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 3905 [select]:
github.com/hashicorp/go-retryablehttp.(*Client).Do(0xc002ec0900, 0xc0004f9760)
	/home/jenkins/tmp/GOPATH/pkg/mod/github.com/hashicorp/go-retryablehttp@v0.7.7/client.go:768 +0x733
git.arvados.org/arvados.git/sdk/go/arvados.(*Client).Do(0xc002882540, 0xc0021e3180)
	/tmp/workspace/run-tests-remainder/sdk/go/arvados/client.go:350 +0x91e
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).CallRaw(0xc004c76580, {0x112d69f, 0x3}, {0x1138bd1, 0x18?}, {0x0, 0x0}, {0x11357bd, 0xa}, 0x0)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:241 +0xb65
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).Call(0x0?, {0x112d69f?, 0x1?}, {0x1138bd1?, 0x0?}, {0x0?, 0x0?}, {0x11357bd?, 0x0?}, 0x0, ...)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:294 +0x65
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll(0xc002d0d0e0)
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:104 +0x1b7
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*KeepClient).discoverServices in goroutine 3904
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:191 +0x30c

goroutine 4191 [select]:
github.com/hashicorp/go-retryablehttp.(*Client).Do(0xc0020dc400, 0xc002d15760)
	/home/jenkins/tmp/GOPATH/pkg/mod/github.com/hashicorp/go-retryablehttp@v0.7.7/client.go:768 +0x733
git.arvados.org/arvados.git/sdk/go/arvados.(*Client).Do(0xc002906f00, 0xc001f2e500)
	/tmp/workspace/run-tests-remainder/sdk/go/arvados/client.go:350 +0x91e
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).CallRaw(0xc004c76840, {0x112d69f, 0x3}, {0x1138bd1, 0x18?}, {0x0, 0x0}, {0x11357bd, 0xa}, 0x0)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:241 +0xb65
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).Call(0x0?, {0x112d69f?, 0x1?}, {0x1138bd1?, 0x0?}, {0x0?, 0x0?}, {0x11357bd?, 0x0?}, 0x0, ...)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:294 +0x65
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll(0xc001ebf6f8)
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:104 +0x1b7
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*KeepClient).discoverServices in goroutine 4121
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:191 +0x30c

goroutine 3970 [select, 9 minutes]:
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:78 +0x137
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll in goroutine 3905
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:74 +0xb3

goroutine 3995 [select, 9 minutes]:
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:78 +0x137
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll in goroutine 3994
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:74 +0xb3

goroutine 6812 [chan receive, 8 minutes]:
git.arvados.org/arvados.git/lib/boot.(*Supervisor).Stop(...)
	/tmp/workspace/run-tests-remainder/lib/boot/supervisor.go:464
git.arvados.org/arvados.git/lib/controller.(*IntegrationSuite).TearDownSuite(0xc00049c610, 0x0?)
	/tmp/workspace/run-tests-remainder/lib/controller/integration_test.go:168 +0x45
reflect.Value.call({0x11096a0?, 0xc00049c610?, 0x4130f7?}, {0x112de28, 0x4}, {0xc0047def40, 0x1, 0x6975b86a7a?})
	/opt/go-1.24.10/src/reflect/value.go:584 +0xca6
reflect.Value.Call({0x11096a0?, 0xc00049c610?, 0x0?}, {0xc0047def40?, 0x4130f7?, 0x0?})
	/opt/go-1.24.10/src/reflect/value.go:368 +0xb9
gopkg.in/check%2ev1.(*suiteRunner).runFixture.func1(0xc001a0a0f0)
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:724 +0xd7
gopkg.in/check%2ev1.(*suiteRunner).forkCall.func1()
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:669 +0x88
created by gopkg.in/check%2ev1.(*suiteRunner).forkCall in goroutine 6
	/home/jenkins/tmp/GOPATH/pkg/mod/gopkg.in/check.v1@v1.0.0-20201130134442-10cb98267c6c/check.go:666 +0x235

goroutine 3994 [select]:
github.com/hashicorp/go-retryablehttp.(*Client).Do(0xc002ec0e80, 0xc0004f7760)
	/home/jenkins/tmp/GOPATH/pkg/mod/github.com/hashicorp/go-retryablehttp@v0.7.7/client.go:768 +0x733
git.arvados.org/arvados.git/sdk/go/arvados.(*Client).Do(0xc002882840, 0xc0021e3e00)
	/tmp/workspace/run-tests-remainder/sdk/go/arvados/client.go:350 +0x91e
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).CallRaw(0xc003956fd0, {0x112d69f, 0x3}, {0x1138bd1, 0x18?}, {0x0, 0x0}, {0x11357bd, 0xa}, 0x0)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:241 +0xb65
git.arvados.org/arvados.git/sdk/go/arvadosclient.(*ArvadosClient).Call(0x0?, {0x112d69f?, 0x202020200a2c6101?}, {0x1138bd1?, 0x6e2073656e6f2067?}, {0x0?, 0x60206e6920646564?}, {0x11357bd?, 0x6e2260202a20200a?}, 0x0, ...)
	/tmp/workspace/run-tests-remainder/sdk/go/arvadosclient/arvadosclient.go:294 +0x65
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll(0xc002aafe90)
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:104 +0x1b7
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*KeepClient).discoverServices in goroutine 3851
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:191 +0x30c

goroutine 4192 [select, 8 minutes]:
git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll.func1()
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:78 +0x137
created by git.arvados.org/arvados.git/sdk/go/keepclient.(*cachedSvcList).poll in goroutine 4191
	/tmp/workspace/run-tests-remainder/sdk/go/keepclient/discover.go:74 +0xb3

goroutine 7130 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003bca270, {0x12e6e28, 0xc003bfc000})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 750
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7060 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc0032789c0, {0x12e6e28, 0xc0029fa280})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 592
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7025 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001711450, {0x12e6e28, 0xc00275e640})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 739
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7140 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003bca9c0, {0x12e6e28, 0xc003bfccd0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 730
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7086 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc001be7520, {0x12e6e28, 0xc001a60af0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 709
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7169 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc00304a000, {0x12e6e28, 0xc00402b1d0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 1037
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7135 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc003bca410, {0x12e6e28, 0xc003bfc410})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 761
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7107 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004ef60d0, {0x12e6e28, 0xc001a61cc0})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 998
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130

goroutine 7097 [select, 6 minutes]:
database/sql.(*DB).connectionOpener(0xc004104ea0, {0x12e6e28, 0xc0016fe000})
	/opt/go-1.24.10/src/database/sql/sql.go:1261 +0x87
created by database/sql.OpenDB in goroutine 773
	/opt/go-1.24.10/src/database/sql/sql.go:841 +0x130
*** Test killed with quit: ran too long (11m0s).
FAIL	git.arvados.org/arvados.git/lib/controller	1745.440s
FAIL
======= lib/controller tests -- FAILED
======= test lib/controller -- 1747s
======= test lib/controller/api
	git.arvados.org/arvados.git/lib/controller/api		coverage: 0.0% of statements
======= test lib/controller/api -- 0s
======= test lib/controller/dblock
ok  	git.arvados.org/arvados.git/lib/controller/dblock	0.131s	coverage: 63.2% of statements
======= test lib/controller/dblock -- 1s
======= test lib/controller/federation
ok  	git.arvados.org/arvados.git/lib/controller/federation	1.023s	coverage: 40.0% of statements
======= test lib/controller/federation -- 3s
======= test lib/controller/localdb
ok  	git.arvados.org/arvados.git/lib/controller/localdb	184.089s	coverage: 70.2% of statements
======= test lib/controller/localdb -- 187s
======= test lib/controller/railsproxy
	git.arvados.org/arvados.git/lib/controller/railsproxy		coverage: 0.0% of statements
======= test lib/controller/railsproxy -- 0s
======= test lib/controller/router
ok  	git.arvados.org/arvados.git/lib/controller/router	1.963s	coverage: 62.6% of statements
======= test lib/controller/router -- 3s
======= test lib/controller/rpc
ok  	git.arvados.org/arvados.git/lib/controller/rpc	0.139s	coverage: 15.2% of statements
======= test lib/controller/rpc -- 1s
======= test lib/crunchrun
ok  	git.arvados.org/arvados.git/lib/crunchrun	97.516s	coverage: 65.3% of statements
======= test lib/crunchrun -- 99s
======= test lib/crunchstat
ok  	git.arvados.org/arvados.git/lib/crunchstat	1.026s	coverage: 71.7% of statements
======= test lib/crunchstat -- 2s
======= test lib/ctrlctx
ok  	git.arvados.org/arvados.git/lib/ctrlctx	0.093s	coverage: 64.6% of statements
======= test lib/ctrlctx -- 1s
======= test lib/deduplicationreport
ok  	git.arvados.org/arvados.git/lib/deduplicationreport	0.184s	coverage: 88.6% of statements
======= test lib/deduplicationreport -- 1s
======= test lib/diagnostics
ok  	git.arvados.org/arvados.git/lib/diagnostics	0.008s	coverage: 2.9% of statements
======= test lib/diagnostics -- 1s
======= test lib/dispatchcloud
ok  	git.arvados.org/arvados.git/lib/dispatchcloud	4.563s	coverage: 76.0% of statements
======= test lib/dispatchcloud -- 6s
======= test lib/dispatchcloud/container
ok  	git.arvados.org/arvados.git/lib/dispatchcloud/container	1.631s	coverage: 67.9% of statements
======= test lib/dispatchcloud/container -- 2s
======= test lib/dispatchcloud/scheduler
ok  	git.arvados.org/arvados.git/lib/dispatchcloud/scheduler	0.058s	coverage: 69.6% of statements
======= test lib/dispatchcloud/scheduler -- 1s
======= test lib/dispatchcloud/sshexecutor
ok  	git.arvados.org/arvados.git/lib/dispatchcloud/sshexecutor	0.128s	coverage: 82.4% of statements
======= test lib/dispatchcloud/sshexecutor -- 1s
======= test lib/dispatchcloud/test
	git.arvados.org/arvados.git/lib/dispatchcloud/test		coverage: 0.0% of statements
======= test lib/dispatchcloud/test -- 1s
======= test lib/dispatchcloud/worker
ok  	git.arvados.org/arvados.git/lib/dispatchcloud/worker	0.098s	coverage: 70.5% of statements
======= test lib/dispatchcloud/worker -- 1s
======= test lib/lsf
ok  	git.arvados.org/arvados.git/lib/lsf	4.561s	coverage: 83.4% of statements
======= test lib/lsf -- 6s
======= test lib/mount
ok  	git.arvados.org/arvados.git/lib/mount	0.143s	coverage: 54.5% of statements
======= test lib/mount -- 1s
======= test lib/pam
ok  	git.arvados.org/arvados.git/lib/pam	18.832s	coverage: 1.4% of statements
======= test lib/pam -- 20s
======= test lib/recovercollection
ok  	git.arvados.org/arvados.git/lib/recovercollection	0.989s	coverage: 83.7% of statements
======= test lib/recovercollection -- 1s
======= test lib/selfsigned
ok  	git.arvados.org/arvados.git/lib/selfsigned	0.085s	coverage: 71.4% of statements
======= test lib/selfsigned -- 0s
======= test lib/service
ok  	git.arvados.org/arvados.git/lib/service	2.639s	coverage: 74.0% of statements
======= test lib/service -- 3s
======= test lib/webdavfs
ok  	git.arvados.org/arvados.git/lib/webdavfs	0.005s	coverage: 12.8% of statements [no tests to run]
======= test lib/webdavfs -- 0s
======= test sdk/go/arvados
ok  	git.arvados.org/arvados.git/sdk/go/arvados	37.747s	coverage: 78.7% of statements
======= test sdk/go/arvados -- 39s
======= test sdk/go/arvadosclient
ok  	git.arvados.org/arvados.git/sdk/go/arvadosclient	22.531s	coverage: 65.4% of statements
======= test sdk/go/arvadosclient -- 23s
======= test sdk/go/arvadostest
ok  	git.arvados.org/arvados.git/sdk/go/arvadostest	0.006s	coverage: 0.0% of statements [no tests to run]
======= test sdk/go/arvadostest -- 1s
======= test sdk/go/asyncbuf
ok  	git.arvados.org/arvados.git/sdk/go/asyncbuf	0.024s	coverage: 96.4% of statements
======= test sdk/go/asyncbuf -- 0s
======= test sdk/go/auth
ok  	git.arvados.org/arvados.git/sdk/go/auth	0.005s	coverage: 59.5% of statements
======= test sdk/go/auth -- 1s
======= test sdk/go/blockdigest
ok  	git.arvados.org/arvados.git/sdk/go/blockdigest	0.003s	coverage: 71.4% of statements
======= test sdk/go/blockdigest -- 1s
======= test sdk/go/config
	git.arvados.org/arvados.git/sdk/go/config		coverage: 0.0% of statements
======= test sdk/go/config -- 0s
======= test sdk/go/ctxlog
	git.arvados.org/arvados.git/sdk/go/ctxlog		coverage: 0.0% of statements
======= test sdk/go/ctxlog -- 0s
======= test sdk/go/dispatch
ok  	git.arvados.org/arvados.git/sdk/go/dispatch	0.024s	coverage: 28.2% of statements
======= test sdk/go/dispatch -- 2s
======= test sdk/go/health
ok  	git.arvados.org/arvados.git/sdk/go/health	7.124s	coverage: 86.4% of statements
======= test sdk/go/health -- 8s
======= test sdk/go/httpserver
ok  	git.arvados.org/arvados.git/sdk/go/httpserver	0.323s	coverage: 70.0% of statements
======= test sdk/go/httpserver -- 1s
======= test sdk/go/keepclient
ok  	git.arvados.org/arvados.git/sdk/go/keepclient	6.090s	coverage: 86.2% of statements
======= test sdk/go/keepclient -- 7s
======= test sdk/go/stats
ok  	git.arvados.org/arvados.git/sdk/go/stats	0.003s	coverage: 71.4% of statements
======= test sdk/go/stats -- 0s
======= test services/crunch-dispatch-local
ok  	git.arvados.org/arvados.git/services/crunch-dispatch-local	6.630s	coverage: 50.2% of statements
======= test services/crunch-dispatch-local -- 8s
======= test services/crunch-dispatch-slurm
ok  	git.arvados.org/arvados.git/services/crunch-dispatch-slurm	17.909s	coverage: 68.4% of statements
======= test services/crunch-dispatch-slurm -- 20s
======= test services/keep-balance
ok  	git.arvados.org/arvados.git/services/keep-balance	3.631s	coverage: 90.0% of statements
======= test services/keep-balance -- 5s
======= test services/keepproxy
ok  	git.arvados.org/arvados.git/services/keepproxy	6.967s	coverage: 86.7% of statements
======= test services/keepproxy -- 8s
======= test services/keepstore
ok  	git.arvados.org/arvados.git/services/keepstore	8.946s	coverage: 84.6% of statements
======= test services/keepstore -- 11s
======= test services/keep-web
ok  	git.arvados.org/arvados.git/services/keep-web	86.641s	coverage: 86.5% of statements
======= test services/keep-web -- 88s
======= test services/ws
ok  	git.arvados.org/arvados.git/services/ws	18.670s	coverage: 77.9% of statements
======= test services/ws -- 20s
======= test tools/keep-block-check
ok  	git.arvados.org/arvados.git/tools/keep-block-check	19.840s	coverage: 90.4% of statements
======= test tools/keep-block-check -- 21s
======= test tools/keep-exercise
	git.arvados.org/arvados.git/tools/keep-exercise		coverage: 0.0% of statements
======= test tools/keep-exercise -- 1s
======= test tools/keep-rsync
ok  	git.arvados.org/arvados.git/tools/keep-rsync	20.216s	coverage: 88.7% of statements
======= test tools/keep-rsync -- 22s
======= test tools/sync-groups
ok  	git.arvados.org/arvados.git/tools/sync-groups	33.692s	coverage: 76.9% of statements
======= test tools/sync-groups -- 35s
======= test tools/sync-users
ok  	git.arvados.org/arvados.git/tools/sync-users	13.333s	coverage: 84.9% of statements
======= test tools/sync-users -- 15s
======= test services/workbench2_units
yarn install
➤ YN0000: ┌ Resolution step
➤ YN0002: │ @coreui/coreui@npm:4.3.2 [f1240] doesn't provide postcss (pb5968), requested by postcss-combine-duplicated-selectors
➤ YN0060: │ arvados-workbench-2@workspace:. provides @coreui/coreui (p399b5) with version 4.3.2, which doesn't satisfy what @coreui/react requests
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (p7649e), requested by @coreui/coreui
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (p89fa5), requested by bootstrap
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide @popperjs/core (pf8400), requested by popper-max-size-modifier
➤ YN0002: │ arvados-workbench-2@workspace:. doesn't provide history (pd5686), requested by connected-react-router
➤ YN0060: │ arvados-workbench-2@workspace:. provides node-sass (pb7041) with version 9.0.0, which doesn't satisfy what sass-loader requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p27aeb) with version 17.0.2, which doesn't satisfy what @fortawesome/react-fontawesome requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pee4fb) with version 17.0.2, which doesn't satisfy what react-dnd and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pf5923) with version 17.0.2, which doesn't satisfy what react-dom requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p278ae) with version 17.0.2, which doesn't satisfy what react-highlight-words requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p3a545) with version 17.0.2, which doesn't satisfy what react-idle-timer requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p179ab) with version 17.0.2, which doesn't satisfy what react-redux requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pe562a) with version 17.0.2, which doesn't satisfy what react-splitter-layout requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p4a88d) with version 17.0.2, which doesn't satisfy what react-virtualized-auto-sizer requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (pfde37) with version 17.0.2, which doesn't satisfy what react-window requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react (p14a77) with version 17.0.2, which doesn't satisfy what redux-devtools requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (p83810) with version 16.14.0, which doesn't satisfy what @coreui/react requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (pe71f1) with version 16.14.0, which doesn't satisfy what @mui/material and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-dom (pf8b2f) with version 16.14.0, which doesn't satisfy what @mui/x-date-pickers and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides react-redux (pdee57) with version 6.0.1, which doesn't satisfy what redux-devtools requests
➤ YN0060: │ arvados-workbench-2@workspace:. provides redux (p1ed3a) with version 4.0.3, which doesn't satisfy what redux-devtools and some of its descendants request
➤ YN0060: │ arvados-workbench-2@workspace:. provides typescript (p920f2) with version 4.3.4, which doesn't satisfy what tslint-etc and some of its descendants request
➤ YN0002: │ eslint-config-react-app@npm:7.0.1 [f1240] doesn't provide @babel/plugin-syntax-flow (p900d0), requested by eslint-plugin-flowtype
➤ YN0002: │ eslint-config-react-app@npm:7.0.1 [f1240] doesn't provide @babel/plugin-transform-react-jsx (p8598a), requested by eslint-plugin-flowtype
➤ YN0002: │ react-dev-utils@npm:12.0.1 doesn't provide typescript (p9c21e), requested by fork-ts-checker-webpack-plugin
➤ YN0002: │ react-dev-utils@npm:12.0.1 doesn't provide webpack (p882e9), requested by fork-ts-checker-webpack-plugin
➤ YN0000: │ Some peer dependencies are incorrectly met; run yarn explain peer-requirements <hash> for details, where <hash> is the six-letter p-prefixed code
➤ YN0000: └ Completed in 0s 240ms
➤ YN0000: ┌ Fetch step
➤ YN0013: │ 1788 packages were already cached
➤ YN0000: └ Completed in 0s 451ms
➤ YN0000: ┌ Link step
➤ YN0000: └ Completed in 0s 758ms
➤ YN0000: Done with warnings in 1s 713ms
yarn test
It looks like this is your first time using Cypress: 13.6.6

[STARTED] Task without title.
[SUCCESS] Task without title.

Opening Cypress...

DevTools listening on ws://127.0.0.1:40595/devtools/browser/fbe003ed-eac3-4e25-8db6-21287dd5e6dc
Browserslist: caniuse-lite is outdated. Please run:
  npx update-browserslist-db@latest
  Why you should do it regularly: https://github.com/browserslist/update-db#readme

tput: No value for $TERM and no -T specified
====================================================================================================

  (Run Starting)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Cypress:        13.6.6                                                                         │
  │ Browser:        Electron 118 (headless)                                                        │
  │ Node Version:   v20.19.4 (/opt/node-v20.19.4-linux-x64/bin/node)                               │
  │ Specs:          81 found (common/formatters.cy.js, common/resource-to-menukind.cy.js, common/u │
  │                 rl.cy.js, common/use-async-interval.cy.js, common/webdav.cy.js, lib/resource-p │
  │                 roperties.cy.js, models/tree.cy.js, models/user.cy.js, models/vocabulary.cy.js │
  │                 , validators/is-rsa-key...)                                                    │
  │ Searched:       **/*.cy.{js,jsx,ts,tsx}                                                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  common/formatters.cy.js                                                        (1 of 81)
153 assets
13505 modules
webpack 5.94.0 compiled successfully in 75883 ms
No issues found.


  formatFileSize
    ✓ should pick the largest unit (42ms)
    ✓ should handle accidental empty string or undefined input (20ms)
    ✓ should handle accidental non-empty string input (25ms)

  formatCWLResourceSize
    ✓ should format bytes as MiB (38ms)

  formatUploadSpeed
    ✓ should show speed less than 1MB/s (14ms)
    ✓ should show 5MB/s (19ms)

  formatContainerCost
    ✓ should correctly round to tenth of a cent (16ms)
    ✓ should round up any smaller value to 0.001 (24ms)


  8 passing (309ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     common/formatters.cy.js                                                          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  common/resource-to-menukind.cy.js                                              (2 of 81)


  context-menu-actions
    resourceToMenuKind
      ✓ should return the correct menu kind (236ms)


  1 passing (335ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     common/resource-to-menukind.cy.js                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  common/url.cy.js                                                               (3 of 81)


  url
    customDecodeURI
      ✓ should decode encoded URI (17ms)
      ✓ ignores non parsable URI and return its original form (8ms)
    customEncodeURI
      ✓ should encode URI (7ms)
      ✓ ignores non encodable URI and return its original form (10ms)

  injectTokenParam
    ✓ injects tokens into valid URLs (13ms)
    ✓ raises exceptions for invalid situations (8ms)


  6 passing (115ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     common/url.cy.js                                                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  common/use-async-interval.cy.js                                                (4 of 81)


  useAsyncInterval
    ✓ should fire repeatedly after the interval (71ms)
    ✓ should wait for async callbacks to complete in between polling (17ms)


  2 passing (130ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     common/use-async-interval.cy.js                                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  common/webdav.cy.js                                                            (5 of 81)


  WebDAV
    ✓ makes use of provided config (36ms)
    ✓ allows to modify defaults after instantiation (18ms)
    ✓ PROPFIND (14ms)
    ✓ PUT (17ms)
    ✓ COPY (15ms)
    ✓ COPY - adds baseURL with trailing slash to Destination header (15ms)
    ✓ COPY - adds baseURL without trailing slash to Destination header (15ms)
    ✓ MOVE (15ms)
    ✓ MOVE - adds baseURL with trailing slash to Destination header (13ms)
    ✓ MOVE - adds baseURL without trailing slash to Destination header (14ms)
    ✓ DELETE (12ms)


  11 passing (228ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     common/webdav.cy.js                                                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  lib/resource-properties.cy.js                                                  (6 of 81)


  Resource properties lib
    ✓ should convert a single string value into a list when adding values (32ms)
    ✓ should convert a 2 value list into a string when removing values (12ms)
    ✓ shouldn't add duplicated key:value items (11ms)
    ✓ should remove the key when deleting from a one value list (10ms)
    ✓ should return the same when deleting non-existant value (18ms)
    ✓ should return the same when deleting non-existant key (21ms)


  6 passing (156ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     lib/resource-properties.cy.js                                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  models/tree.cy.js                                                              (7 of 81)


  Tree
    ✓ sets new node (17ms)
    ✓ appends a subtree (11ms)
    ✓ adds new node reference to parent children (8ms)
    ✓ gets node ancestors (9ms)
    ✓ gets node descendants (7ms)
    ✓ gets root descendants (8ms)
    ✓ gets node children (7ms)
    ✓ gets root children (8ms)
    ✓ maps tree (8ms)
    ✓ expands node ancestor chains (13ms)


  10 passing (138ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        10                                                                               │
  │ Passing:      10                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     models/tree.cy.js                                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  models/user.cy.js                                                              (8 of 81)


  User
    ✓ gets the user display name (41ms)


  1 passing (50ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     models/user.cy.js                                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  models/vocabulary.cy.js                                                        (9 of 81)


  Vocabulary
    ✓ returns the list of tag keys (21ms)
    ✓ returns the list of preferred tag keys (8ms)
    ✓ returns the list of preferred tag keys with matching synonyms (8ms)
    ✓ returns the tag values for a given key (10ms)
    ✓ returns the preferred tag values for a given key (11ms)
    ✓ returns the preferred tag values with matching synonyms for a given key (7ms)
    ✓ returns an empty list of values for an non-existent key (7ms)
    ✓ returns a key id for a given key label (9ms)
    ✓ returns an key label for a given key id (10ms)
    ✓ returns a value id for a given key id and value label (11ms)
    ✓ returns a value label for a given key & value id pair (9ms)


  11 passing (155ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     models/vocabulary.cy.js                                                          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  validators/is-rsa-key.cy.js                                                   (10 of 81)


  rsa-key-validator
    rsaKeyValidation
      ✓ should accept keys with comment (17ms)
      ✓ should accept keys without comment (9ms)
      ✓ should reject keys with trailing whitespace (11ms)
      ✓ should reject invalid keys (7ms)


  4 passing (73ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     validators/is-rsa-key.cy.js                                                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  websocket/websocket-service.cy.js                                             (11 of 81)


  WebSocketService
    ✓ should operate as a singleton and allow externally checking connection status (35ms)
    ✓ should fire open callback after connecting (39ms)
    ✓ throttles calls to DE (31ms)


  3 passing (132ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     websocket/websocket-service.cy.js                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/breadcrumbs/breadcrumbs.cy.js                                      (12 of 81)


  <Breadcrumbs />
    ✓ renders one item (85ms)
    ✓ renders multiple items (34ms)
    ✓ calls onClick with clicked item (125ms)


  3 passing (283ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/breadcrumbs/breadcrumbs.cy.js                                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/column-selector/column-selector.cy.js                              (13 of 81)


  <ColumnSelector />
    ✓ shows only configurable columns (217ms)
    ✓ renders checked checkboxes next to selected columns (141ms)
    ✓ calls onColumnToggle with clicked column (201ms)


  3 passing (628ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/column-selector/column-selector.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/conditional-tabs/conditional-tabs.cy.js                            (14 of 81)


  <ConditionalTabs />
    ✓ renders only visible tabs (265ms)
    ✓ resets selected tab on tab visibility change (150ms)


  2 passing (465ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/conditional-tabs/conditional-tabs.cy.js                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/data-explorer/data-explorer.cy.js                                  (15 of 81)


  <DataExplorer />
    ✓ communicates with <SearchInput/> (1479ms)
    ✓ communicates with <ColumnSelector/> (279ms)
    ✓ communicates with <DataTable/> (1762ms)
    ✓ communicates with <TablePagination/> (801ms)


  4 passing (4s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     4 seconds                                                                        │
  │ Spec Ran:     components/data-explorer/data-explorer.cy.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/data-table/data-table.cy.js                                        (16 of 81)


  <DataTable />
    ✓ shows only selected columns (108ms)
    ✓ renders column name (47ms)
    ✓ uses renderHeader instead of name prop (53ms)
    ✓ passes column key prop to corresponding cells (31ms)
    ✓ renders items (35ms)
    ✓ passes sorting props to <TableSortLabel /> (33ms)
    ✓ does not display <DataTableFiltersPopover /> if there is no filters provided (34ms)
    ✓ passes filter props to <DataTableFiltersPopover /> (34ms)


  8 passing (436ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/data-table/data-table.cy.js                                           │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/data-table-filters/data-table-filters-popover.cy.js                (17 of 81)


  <DataTableFiltersPopover />
    ✓ renders filters according to their state (931ms)


  1 passing (974ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/data-table-filters/data-table-filters-popover.cy.js                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/date-picker/date-picker.cy.js                                      (18 of 81)


  DatePicker Component
    ✓ renders with label (115ms)
    ✓ initializes with current date when no minDate provided (37ms)
    ✓ initializes with minDate when provided (53ms)
    ✓ opens calendar on click (250ms)
    ✓ disables past dates when disablePast is true (204ms)
    ✓ calls onChange when date is selected (607ms)
    ✓ updates input value when date is selected (672ms)
    ✓ handles keyboard navigation (495ms)
    ✓ initializes with startValue (47ms)


  9 passing (3s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     2 seconds                                                                        │
  │ Spec Ran:     components/date-picker/date-picker.cy.js                                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/dropdown-menu/dropdown-menu.cy.js                                  (19 of 81)


  <DropdownMenu />
    ✓ renders menu icon (67ms)
    ✓ opens and closes (347ms)
    ✓ render menu items (125ms)


  3 passing (585ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/dropdown-menu/dropdown-menu.cy.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/file-tree/file-thumbnail.cy.js                                     (20 of 81)


  <FileThumbnail />
    ✓ renders file thumbnail with proper src (69ms)


  1 passing (96ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/file-tree/file-thumbnail.cy.js                                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/multi-panel-view/multi-panel-view.cy.js                            (21 of 81)


  <MPVContainer />
    ✓ should show default panel buttons for every child (122ms)
    ✓ should show panel when clicking on its button (143ms)
    ✓ should show custom panel buttons when config provided (133ms)
    ✓ should set initial panel visibility according to panelStates prop (30ms)


  4 passing (476ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/multi-panel-view/multi-panel-view.cy.js                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/popover/popover.cy.js                                              (22 of 81)


  <Popover />
    ✓ opens on default trigger click (175ms)
    ✓ renders custom trigger (24ms)
    ✓ opens on custom trigger click (112ms)
    ✓ renders children when opened (115ms)
    ✓ does not close if closeOnContentClick is not set (195ms)
    ✓ closes on content click if closeOnContentClick is set (364ms)


  6 passing (1s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     1 second                                                                         │
  │ Spec Ran:     components/popover/popover.cy.js                                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/refresh-button/refresh-button.cy.js                                (23 of 81)


  <RefreshButton />
    ✓ should render without issues (69ms)
    ✓ should pass window location to router (122ms)


  2 passing (230ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/refresh-button/refresh-button.cy.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/search-input/search-input.cy.js                                    (24 of 81)


  <SearchInput />
    on submit
      ✓ calls onSearch with initial value passed via props (149ms)
      ✓ calls onSearch with current value (410ms)
      ✓ calls onSearch with new value passed via props (396ms)
      ✓ cancels timeout set on input value change (387ms)
    on input value change
      ✓ calls onSearch after default timeout (329ms)
      ✓ calls onSearch after the time specified in props has passed (331ms)
      ✓ calls onSearch only once after no change happened during the specified time (548ms)
      ✓ calls onSearch again after the specified time has passed since previous call (990ms)
    on input target change
      ✓ clears the input value on selfClearProp change (43ms)


  9 passing (4s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     3 seconds                                                                        │
  │ Spec Ran:     components/search-input/search-input.cy.js                                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/string-array-input/string-array-mui-input.cy.js                    (25 of 81)


  StringArrayMuiInput Component
    ✓ renders with initial empty state (87ms)
    ✓ calls onChange on Enter key press (347ms)
    ✓ calls onChange on Add button click (397ms)
    ✓ trims whitespace from input values (375ms)
    ✓ clears input after adding value (316ms)


  5 passing (2s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     1 second                                                                         │
  │ Spec Ran:     components/string-array-input/string-array-mui-input.cy.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  components/tree/tree.cy.js                                                    (26 of 81)


  Tree component
    ✓ should render ListItem (78ms)
    ✓ should render arrow (27ms)
    ✓ should render checkbox (37ms)
    ✓ call onSelectionChanged with associated item (125ms)


  4 passing (305ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     components/tree/tree.cy.js                                                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/api/filter-builder.cy.js                                             (27 of 81)


  FilterBuilder
    ✓ should add 'equal' rule (string) (16ms)
    ✓ should add 'equal' rule (boolean) (8ms)
    ✓ should add 'like' rule (7ms)
    ✓ should add 'ilike' rule (8ms)
    ✓ should add 'contains' rule (8ms)
    ✓ should add 'is_a' rule (8ms)
    ✓ should add 'is_a' rule for set (8ms)
    ✓ should add 'in' rule (7ms)
    ✓ should add 'in' rule for set (7ms)
    ✓ should add 'not in' rule for set (8ms)
    ✓ should add multiple rules (6ms)
    ✓ should add attribute prefix (7ms)
    ✓ should add full text search (8ms)


  13 passing (152ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        13                                                                               │
  │ Passing:      13                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/api/filter-builder.cy.js                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/api/order-builder.cy.js                                              (28 of 81)


  OrderBuilder
    ✓ should build correct order query (22ms)


  1 passing (32ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/api/order-builder.cy.js                                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/api/url-builder.cy.js                                                (29 of 81)


  UrlBuilder
    ✓ should join urls properly 1 (17ms)
    ✓ should join urls properly 2 (8ms)
    ✓ should join urls properly 3 (9ms)
    ✓ should join urls properly 4 (10ms)
    ✓ should join urls properly 5 (7ms)
    ✓ should join urls properly 6 (7ms)
    ✓ should join urls properly 7 (9ms)
    ✓ should join urls properly 8 (7ms)
    ✓ should join urls properly 9 (7ms)


  9 passing (113ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/api/url-builder.cy.js                                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/api-client-authorization-service/api-client-authorization-s          (30 of 81)
            ervice.cy.js                                                                            


  ApiClientAuthorizationService
    createCollectionSharingToken
      ✓ should return error on invalid collection uuid (19ms)
      ✓ should make a create request with proper scopes and no expiration date (14ms)
      ✓ should make a create request with proper scopes and expiration date (13ms)
    listCollectionSharingToken
      ✓ should return error on invalid collection uuid (8ms)
      ✓ should make a list request with proper scopes (12ms)


  5 passing (129ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/api-client-authorization-service/api-client-authorization-service.cy.js │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/collection-service/collection-service-files-response.cy.js           (31 of 81)


  collection-service-files-response
    extractFilesData
      ✓ should correctly decode URLs & file names (25ms)
    getFileFullPath
      ✓ should encode weird names (11ms)


  2 passing (63ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/collection-service/collection-service-files-response.cy.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/collection-service/collection-service.cy.js                          (32 of 81)


  collection-service
    get
      ✓ should make a request with default selected fields (32ms)
      ✓ should be able to request specific fields (15ms)
    update
      ✓ should call put selecting updated fields + others (18ms)
    uploadFiles
      ✓ should skip if no files to upload files (13ms)
      ✓ should upload files (15ms)
      ✓ should upload files with custom uplaod target (14ms)
    deleteFiles
      ✓ should remove no files (16ms)
      ✓ should remove only root files (16ms)
      ✓ should batch remove files (14ms)
    renameFile
      ✓ should rename file (31ms)
    copyFiles
      ✓ should batch copy files (23ms)
      ✓ should copy files from rooth (20ms)
      ✓ should copy files to root path (15ms)
    moveFiles
      ✓ should batch move files (25ms)
      ✓ should batch move files within collection (21ms)
      ✓ should abort batch move when copy fails (18ms)
    createDirectory
      ✓ creates empty directory (20ms)
    getMinNecessaryPaths
      ✓ should return the minimum unique paths (12ms)


  18 passing (576ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        18                                                                               │
  │ Passing:      18                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/collection-service/collection-service.cy.js                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/common-service/common-resource-service.cy.js                         (33 of 81)


  CommonResourceService
    ✓ #create (23ms)
    ✓ #create maps request params to snake case (10ms)
    ✓ #create ignores fields listed as readonly (11ms)
    ✓ #update ignores fields listed as readonly (10ms)
    ✓ #delete (8ms)
    ✓ #get (10ms)
    ✓ #list (8ms)
    ✓ #list using POST when query string is too big (10ms)
    ✓ #list using GET when query string is not too big (9ms)


  9 passing (130ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/common-service/common-resource-service.cy.js                            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/common-service/common-service.cy.js                                  (34 of 81)


  CommonService
    ✓ throws an exception when passing uuid as empty string to get() (17ms)
    ✓ throws an exception when passing uuid as empty string to update() (11ms)
    ✓ throws an exception when passing uuid as empty string to delete() (9ms)


  3 passing (53ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/common-service/common-service.cy.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/groups-service/groups-service.cy.js                                  (35 of 81)


  GroupsService
    ✓ #contents (26ms)


  1 passing (37ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/groups-service/groups-service.cy.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/favorite-service/favorite-service.cy.js                              (36 of 81)


  FavoriteService
    ✓ marks resource as favorite (25ms)
    ✓ unmarks resource as favorite (16ms)
    ✓ lists favorite resources (14ms)
    ✓ checks if resources are present in favorites (11ms)


  4 passing (86ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/favorite-service/favorite-service.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/log-service/log-service.cy.js                                        (37 of 81)


  LogService
    ✓ lists log files using propfind on live logs api endpoint (27ms)
    ✓ requests log file contents with correct range request (19ms)


  2 passing (61ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/log-service/log-service.cy.js                                           │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  services/project-service/project-service.cy.js                                (38 of 81)


  CommonResourceService
    ✓ #create has groupClass set to "project" (24ms)
    ✓ #list has groupClass filter set by default (13ms)


  2 passing (52ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     services/project-service/project-service.cy.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/auth/auth-reducer.cy.js                                                 (39 of 81)


  auth-reducer
    ✓ should correctly initialise state (21ms)
    ✓ should set user details on success fetch (9ms)


  2 passing (44ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/auth/auth-reducer.cy.js                                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/data-explorer/data-explorer-middleware.cy.js                            (40 of 81)


  DataExplorerMiddleware
    ✓ handles only actions that are identified by service id (26ms)
    ✓ handles REQUEST_ITEMS action (11ms)
    ✓ handles SET_PAGE action (12ms)
    ✓ handles SET_ROWS_PER_PAGE action (11ms)
    ✓ handles SET_FILTERS action (14ms)
    ✓ handles SET_ROWS_PER_PAGE action (11ms)
    ✓ handles TOGGLE_SORT action (10ms)
    ✓ handles SET_SEARCH_VALUE action (11ms)
    ✓ forwards other actions (12ms)


  9 passing (149ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/data-explorer/data-explorer-middleware.cy.js                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/data-explorer/data-explorer-reducer.cy.js                               (41 of 81)


  data-explorer-reducer
    ✓ should set columns (18ms)
    ✓ should toggle sorting (10ms)
    ✓ should set filters (8ms)
    ✓ should set items (8ms)
    ✓ should set page (11ms)
    ✓ should set rows per page (7ms)


  6 passing (87ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/data-explorer/data-explorer-reducer.cy.js                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/dialog/dialog-reducer.cy.js                                             (42 of 81)


  DialogReducer
    ✓ OPEN_DIALOG (21ms)
    ✓ CLOSE_DIALOG (8ms)
    ✓ CLOSE_DIALOG persist data (8ms)


  3 passing (55ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/dialog/dialog-reducer.cy.js                                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/external-credentials/external-credentials-actions.cy.js                 (43 of 81)


  External Credentials Actions
    ✓ creates external credential with correct values (29ms)
    ✓ updates external credential without secret when empty (15ms)
    ✓ updates external credential with secret when non-empty (16ms)
    ✓ removes multiple external credentials (12ms)


  4 passing (99ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/external-credentials/external-credentials-actions.cy.js                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/groups-panel/groups-panel-middleware-service.cy.js                      (44 of 81)


  GroupsPanelMiddlewareService
    ✓ requests group member counts and updates resource store (56ms)
    ✓ requests group member count and stores null on failure (21ms)


  2 passing (92ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/groups-panel/groups-panel-middleware-service.cy.js                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/link-account-panel/link-account-panel-reducer.cy.js                     (45 of 81)


  link-account-panel-reducer
    ✓ handles initial link account state (19ms)
    ✓ handles loaded link account state (8ms)
    ✓ handles loaded invalid account state (8ms)


  3 passing (51ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/link-account-panel/link-account-panel-reducer.cy.js                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/process-logs-panel/process-logs-panel-actions.cy.js                     (46 of 81)


  pollProcessLogs
    ✓ Dispatches ADD_PROCESS_LOGS_PANEL_ITEM for valid SCHEDULING logs (23ms)
    ✓ Does not dispatch ADD_PROCESS_LOGS_PANEL_ITEM for whitespace-only SCHEDULING logs (11ms)


  2 passing (47ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/process-logs-panel/process-logs-panel-actions.cy.js                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/processes/process-copy-actions.cy.js                                    (47 of 81)


  ProcessCopyAction
    ✓ should request the failed process and return a copy with the proper fields (43ms)


  1 passing (53ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/processes/process-copy-actions.cy.js                                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/resource-type-filters/resource-type-filters.cy.js                       (48 of 81)


  buildProcessStatusFilters
    ✓ can filter "All" processes (17ms)
    ✓ can filter "On hold" processes (9ms)
    ✓ can filter "Completed" processes (7ms)
    ✓ can filter "Failed" processes (7ms)
    ✓ can filter "Queued" processes (6ms)
    ✓ can filter "Cancelled" processes (7ms)
    ✓ can filter "Running" processes (6ms)

  serializeResourceTypeFilters
    ✓ should serialize all filters (7ms)
    ✓ should serialize all but collection filters (7ms)
    ✓ should serialize output collections and projects (7ms)
    ✓ should serialize output collections and projects (8ms)
    ✓ should serialize general collections (7ms)
    ✓ should serialize only main processes (6ms)
    ✓ should serialize only child processes (8ms)
    ✓ should serialize all project types (6ms)
    ✓ should serialize filter groups (7ms)
    ✓ should serialize projects (normal) (8ms)


  17 passing (186ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        17                                                                               │
  │ Passing:      17                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/resource-type-filters/resource-type-filters.cy.js                          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/run-process-panel/run-process-panel-actions.cy.js                       (49 of 81)


  run-process-panel-actions
    runProcess
      ✓ should return when userUuid is null (20ms)
      ✓ should run workflow with project-uuid (20ms)


  2 passing (71ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/run-process-panel/run-process-panel-actions.cy.js                          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/search-bar/search-bar-actions.cy.js                                     (50 of 81)


  search-bar-actions
    getAdvancedDataFromQuery
      ✓ should correctly build advanced data record from query #1 (18ms)
      ✓ should correctly build advanced data record from query #2 (10ms)
    getQueryFromAdvancedData
      ✓ should build query from advanced data (9ms)
      ✓ should build query from advanced data #2 (8ms)
      ✓ should add has:"key":"value" expression to query from same property key (8ms)
      ✓ should add has:"keyID":"valueID" expression to query when necessary (6ms)
      ✓ should remove has:"key":"value" expression from query (7ms)


  7 passing (105ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/search-bar/search-bar-actions.cy.js                                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/search-results-panel/search-results-middleware-service.cy.js            (51 of 81)


  search-results-middleware
    getParams
      ✓ should use include_old_versions=true when asked (23ms)
      ✓ should not use include_old_versions=true when not asked (7ms)


  2 passing (54ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/search-results-panel/search-results-middleware-service.cy.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/tree-picker/tree-picker-actions.cy.js                                   (52 of 81)


  tree-picker-actions
    ✓ initializes preselected tree picker nodes (108ms)


  1 passing (118ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/tree-picker/tree-picker-actions.cy.js                                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/tree-picker/tree-picker-reducer.cy.js                                   (53 of 81)


  TreePickerReducer
    ✓ LOAD_TREE_PICKER_NODE - initial state (16ms)
    ✓ LOAD_TREE_PICKER_NODE (8ms)
    ✓ LOAD_TREE_PICKER_NODE_SUCCESS - initial state (7ms)
    ✓ LOAD_TREE_PICKER_NODE_SUCCESS (7ms)
    ✓ TOGGLE_TREE_PICKER_NODE_COLLAPSE - expanded (12ms)
    ✓ TOGGLE_TREE_PICKER_NODE_COLLAPSE - expanded (8ms)
    ✓ ACTIVATE_TREE_PICKER_NODE (6ms)
    ✓ TOGGLE_TREE_PICKER_NODE_SELECTION (7ms)
    ✓ does not set malformed node (8ms)


  9 passing (111ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/tree-picker/tree-picker-reducer.cy.js                                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/workflow-panel/workflow-panel-actions.cy.js                             (54 of 81)


  workflow-panel-actions
    ✓ opens the run process panel (77ms)


  1 passing (128ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/workflow-panel/workflow-panel-actions.cy.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/inactive-panel/inactive-panel.cy.js                                     (55 of 81)


  InactivePanel
    ✓ should render content and link account option (80ms)
    ✓ should render content and link account warning on LoginCluster federations (28ms)


  2 passing (132ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/inactive-panel/inactive-panel.cy.js                                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/instance-types-panel/instance-types-panel.cy.js                         (56 of 81)


  <InstanceTypesPanel />
    ✓ renders instance types (181ms)

  calculateKeepBufferOverhead
    ✓ should calculate correct buffer size (12ms)

  discountRamByPercent
    ✓ should inflate ram requirement by 5% of final amount (8ms)


  3 passing (226ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/instance-types-panel/instance-types-panel.cy.js                            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/login-panel/login-panel.cy.js                                           (57 of 81)


  <LoginPanel />
    requirePasswordLogin
      ✓ should return false if no config specified (15ms)
      ✓ should return false if no config.clusterConfig specified (7ms)
      ✓ should return false if no config.clusterConfig.Login specified (7ms)
      ✓ should return false if no config.clusterConfig.Login.LDAP and config.clusterConfig.Login.PAM specified (6ms)
      ✓ should return false if config.clusterConfig.Login.LDAP.Enable and config.clusterConfig.Login.PAM.Enable not specified (7ms)
      ✓ should return value from config.clusterConfig.Login.LDAP.Enable (6ms)
      ✓ should return value from config.clusterConfig.Login.PAM.Enable (7ms)
      ✓ should return false for not specified config option config.clusterConfig.Login.NOT_EXISTING.Enable (6ms)


  8 passing (98ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/login-panel/login-panel.cy.js                                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/not-found-panel/not-found-panel-root.cy.js                              (58 of 81)


  NotFoundPanelRoot
    ✓ should render component (59ms)
    ✓ should render component without email url when no email (20ms)
    ✓ should render component with additional message and email url (25ms)


  3 passing (142ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/not-found-panel/not-found-panel-root.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/process-panel/process-io-card.cy.js                                     (59 of 81)


  renderers
    ProcessStatus
      ✓ shows main process input loading when raw or params null (105ms)
      ✓ shows main process empty params and raw (35ms)
      ✓ shows main process with raw (70ms)
      ✓ shows main process with params (86ms)
      ✓ shows main process with output collection (232ms)
      ✓ shows subprocess loading (21ms)
      ✓ shows subprocess mounts (54ms)
      ✓ shows subprocess output collection (57ms)
      ✓ shows empty subprocess raw (61ms)


  9 passing (858ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/process-panel/process-io-card.cy.js                                        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views/workbench/workbench.cy.js                                               (60 of 81)


  ✓ renders without crashing (184ms)

  1 passing (195ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views/workbench/workbench.cy.js                                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/auto-logout/auto-logout.cy.js                                (61 of 81)


  <AutoLogoutComponent />
    ✓ should logout after idle timeout (58ms)
    ✓ should warn the user previous to close the session (21ms)
    ✓ should reset the idle timer when activity event is received (21ms)


  3 passing (137ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/auto-logout/auto-logout.cy.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/baner/banner.cy.js                                           (62 of 81)


  <BannerComponent />
    ✓ renders without crashing (85ms)
    ✓ calls collectionService (44ms)


  2 passing (156ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/baner/banner.cy.js                                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/data-explorer/renderers.cy.js                                (63 of 81)


  renderers
    ProcessStatus
      ✓ should render the state label 'Running' and color 'rgb(255, 255, 255)' for CR state=Committed, priority=1, C state=Running, exitCode=null and RuntimeStatus={} (76ms)
      ✓ should render the state label 'Failing' and color 'rgb(255, 255, 255)' for CR state=Committed, priority=1, C state=Running, exitCode=null and RuntimeStatus={"error":"whoops"} (26ms)
      ✓ should render the state label 'Warning' and color 'rgb(255, 255, 255)' for CR state=Committed, priority=1, C state=Running, exitCode=null and RuntimeStatus={"warning":"watch out!"} (24ms)
      ✓ should render the state label 'Cancelled' and color 'rgb(255, 0, 0)' for CR state=Final, priority=1, C state=Cancelled, exitCode=null and RuntimeStatus={} (30ms)
      ✓ should render the state label 'Failed' and color 'rgb(255, 0, 0)' for CR state=Final, priority=1, C state=Complete, exitCode=137 and RuntimeStatus={} (26ms)
      ✓ should render the state label 'Completed' and color 'rgb(0, 255, 0)' for CR state=Final, priority=1, C state=Complete, exitCode=0 and RuntimeStatus={} (25ms)
      ✓ should render the state label 'On hold' and color 'rgb(128, 128, 128)' for CR state=Committed, priority=0, C state=Locked, exitCode=null and RuntimeStatus={} (24ms)
      ✓ should render the state label 'On hold' and color 'rgb(128, 128, 128)' for CR state=Committed, priority=0, C state=Queued, exitCode=null and RuntimeStatus={} (23ms)
      ✓ should render the state label 'Queued' and color 'rgb(255, 255, 255)' for CR state=Committed, priority=1, C state=Locked, exitCode=null and RuntimeStatus={} (24ms)
      ✓ should render the state label 'Queued' and color 'rgb(255, 255, 255)' for CR state=Committed, priority=1, C state=Queued, exitCode=null and RuntimeStatus={} (20ms)
    ResourceFileSize
      ✓ should render collection fileSizeTotal (23ms)
      ✓ should render 0 B as file size (18ms)
      ✓ should render empty string for non collection resource (25ms)
    GroupMembersCount
      ✓ shows loading group count when no memberCount (26ms)
      ✓ shows group count when memberCount present (16ms)
      ✓ shows group count error icon when memberCount is null (38ms)


  16 passing (617ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        16                                                                               │
  │ Passing:      16                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/data-explorer/renderers.cy.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/details-card/service-menu.cy.js                              (64 of 81)


  ServiceMenu
    ✓ displays single service (180ms)
    ✓ displays multiple services (414ms)


  2 passing (635ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/details-card/service-menu.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/main-app-bar/account-menu.cy.js                              (65 of 81)


  <AccountMenu />
    Logout Menu Item
      ✓ should dispatch a logout action when clicked (365ms)


  1 passing (405ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/main-app-bar/account-menu.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/property-chips/get-property-chips.cy.js                      (66 of 81)


  getPropertyChips
    ✓ renders property chips (85ms)
    ✓ filters out objects (23ms)


  2 passing (130ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/property-chips/get-property-chips.cy.js                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/search-bar/search-bar-view.cy.js                             (67 of 81)


  <SearchBarView />
    on input value change
      ✓ fix tests (30ms)


  1 passing (61ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/search-bar/search-bar-view.cy.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/sharing-dialog/sharing-dialog-component.cy.js                (68 of 81)


  <SharingDialogComponent />
    ✓ show sharing urls tab on collections when not disabled (233ms)
    ✓ does not show sharing urls on non-collection resources (60ms)


  2 passing (322ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/sharing-dialog/sharing-dialog-component.cy.js                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/sharing-dialog/sharing-urls-component.cy.js                  (69 of 81)


  <SharingURLsComponent />
    ✓ renders a list of sharing URLs (128ms)
    ✓ renders a list URLs with collection UUIDs as subdomains (65ms)
    ✓ renders a list of URLs with no expiration (55ms)
    ✓ calls delete token handler when delete button is clicked (128ms)


  4 passing (432ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/sharing-dialog/sharing-urls-component.cy.js                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/side-panel-button/side-panel-button.cy.js                    (70 of 81)


  <SidePanelButton />
    isProjectTrashed
      ✓ should return false if project is undefined (16ms)
      ✓ should return false if parent project is undefined (14ms)
      ✓ should return false for owner (8ms)
      ✓ should return true for trashed (7ms)
      ✓ should return false for undefined parent projects (7ms)


  5 passing (82ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/side-panel-button/side-panel-button.cy.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/token-dialog/token-dialog.cy.js                              (71 of 81)


  <CurrentTokenDialog />
    Get API Token dialog
      ✓ should include API host and token (115ms)
      ✓ should show the token expiration if present (72ms)
      ✓ should show a create new token button when allowed (66ms)
    Copy link to clipboard button
      ✓ should copy API TOKEN to the clipboard (130ms)


  4 passing (486ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/token-dialog/token-dialog.cy.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/tree-picker/tree-picker.cy.js                                (72 of 81)


  <TreePicker />
    ✓ renders tree picker with initial home project state (90ms)
    ✓ displays item loaded into treePicker store (32ms)
    ✓ preserves treenode name when exists in resources (32ms)


  3 passing (185ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/tree-picker/tree-picker.cy.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/webdav-s3-dialog/webdav-s3-dialog.cy.js                      (73 of 81)


  WebDavS3InfoDialog
    ✓ render cyberduck tab (131ms)
    ✓ render win/mac tab (49ms)
    ✓ render s3 tab with federated token (48ms)
    ✓ render s3 tab with local token (42ms)
    ✓ render cyberduck tab with wildcard DNS (46ms)


  5 passing (357ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/webdav-s3-dialog/webdav-s3-dialog.cy.js                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  store/collection-panel/collection-panel-files/collection-panel-files          (74 of 81)
            -reducer.cy.js                                                                          


  CollectionPanelFilesReducer
    ✓ SET_COLLECTION_FILES (16ms)
    ✓ TOGGLE_COLLECTION_FILE_COLLAPSE (10ms)
    ✓ TOGGLE_COLLECTION_FILE_SELECTION (8ms)
    ✓ TOGGLE_COLLECTION_FILE_SELECTION ancestors (7ms)
    ✓ TOGGLE_COLLECTION_FILE_SELECTION descendants (8ms)
    ✓ TOGGLE_COLLECTION_FILE_SELECTION unselect ancestors (9ms)
    ✓ SELECT_ALL_COLLECTION_FILES (16ms)
    ✓ SELECT_ALL_COLLECTION_FILES (16ms)


  8 passing (122ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     store/collection-panel/collection-panel-files/collection-panel-files-reducer.cy. │
  │               js                                                                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/action-sets/collection-action-set.cy.j          (75 of 81)
            s                                                                                       


  collection-action-set
    collectionActionSet
      ✓ should not be empty (23ms)
      ✓ should contain readOnlyCollectionActionSet items (7ms)
    readOnlyCollectionActionSet
      ✓ should not be empty (8ms)
      ✓ should not contain collectionActionSet items (6ms)


  4 passing (78ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/action-sets/collection-action-set.cy.js            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/action-sets/project-action-set.cy.js            (76 of 81)


  project-action-set
    projectActionSet
      ✓ should not be empty (19ms)
      ✓ should contain readOnlyProjectActionSet items (8ms)
    readOnlyProjectActionSet
      ✓ should not be empty (8ms)
      ✓ should not contain projectActionSet items (7ms)
    filterGroupActionSet
      ✓ should not be empty (11ms)
      ✓ should not contain projectActionSet items (6ms)


  6 passing (99ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/action-sets/project-action-set.cy.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/actions/collection-file-viewer-action.          (77 of 81)
            cy.js                                                                                   


  CollectionFileViewerAction
    ✓ should hide open in new tab when unsafe (48ms)
    ✓ should show open in new tab when TrustAllContent=true (41ms)
    ✓ should show open in new tab when inline url is secure (22ms)


  3 passing (135ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/actions/collection-file-viewer-action.cy.js        │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/actions/copy-to-clipboard-action.cy.js          (78 of 81)


  CopyToClipboardAction
    ✓ should render properly and handle click (196ms)


  1 passing (221ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/actions/copy-to-clipboard-action.cy.js             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/actions/download-action.cy.js                   (79 of 81)


  <DownloadAction />
    ✓ should return null if missing href or kind of file in props (49ms)
    ✓ should return a element (47ms)
    ✓ should handle download (137ms)


  3 passing (268ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/actions/download-action.cy.js                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/actions/file-viewer-action.cy.js                (80 of 81)


  FileViewerAction
    ✓ should render properly and handle click (197ms)


  1 passing (305ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/actions/file-viewer-action.cy.js                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  views-components/context-menu/actions/helpers.cy.js                           (81 of 81)


  helpers
    sanitizeToken
      ✓ should sanitize token from the url (16ms)
    getInlineFileUrl
      ✓ should add the collection's uuid to the hostname (14ms)
      ✓ should keep the url the same when no inline url available (7ms)
      ✓ should replace the url when available (7ms)


  4 passing (77ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        false                                                                            │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     views-components/context-menu/actions/helpers.cy.js                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


tput: No value for $TERM and no -T specified
====================================================================================================

  (Run Finished)


       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  common/formatters.cy.js                  324ms        8        8        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  common/resource-to-menukind.cy.js        338ms        1        1        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  common/url.cy.js                         118ms        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  common/use-async-interval.cy.js          133ms        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  common/webdav.cy.js                      230ms       11       11        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  lib/resource-properties.cy.js            165ms        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  models/tree.cy.js                        140ms       10       10        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  models/user.cy.js                         53ms        1        1        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  models/vocabulary.cy.js                  157ms       11       11        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  validators/is-rsa-key.cy.js               76ms        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  websocket/websocket-service.cy.js        135ms        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/breadcrumbs/breadcrumbs.      285ms        3        3        -        -        - │
  │    cy.js                                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/column-selector/column-s      627ms        3        3        -        -        - │
  │    elector.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/conditional-tabs/conditi      470ms        2        2        -        -        - │
  │    onal-tabs.cy.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/data-explorer/data-explo      00:04        4        4        -        -        - │
  │    rer.cy.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/data-table/data-table.cy      438ms        8        8        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/data-table-filters/data-      976ms        1        1        -        -        - │
  │    table-filters-popover.cy.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/date-picker/date-picker.      00:02        9        9        -        -        - │
  │    cy.js                                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/dropdown-menu/dropdown-m      588ms        3        3        -        -        - │
  │    enu.cy.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/file-tree/file-thumbnail       98ms        1        1        -        -        - │
  │    .cy.js                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/multi-panel-view/multi-p      478ms        4        4        -        -        - │
  │    anel-view.cy.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/popover/popover.cy.js         00:01        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/refresh-button/refresh-b      233ms        2        2        -        -        - │
  │    utton.cy.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/search-input/search-inpu      00:03        9        9        -        -        - │
  │    t.cy.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/string-array-input/strin      00:01        5        5        -        -        - │
  │    g-array-mui-input.cy.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  components/tree/tree.cy.js               307ms        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/api/filter-builder.cy.js        157ms       13       13        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/api/order-builder.cy.js          34ms        1        1        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/api/url-builder.cy.js           116ms        9        9        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/api-client-authorization-s      131ms        5        5        -        -        - │
  │    ervice/api-client-authorization-ser                                                         │
  │    vice.cy.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/collection-service/collect       65ms        2        2        -        -        - │
  │    ion-service-files-response.cy.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/collection-service/collect      579ms       18       18        -        -        - │
  │    ion-service.cy.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/common-service/common-reso      133ms        9        9        -        -        - │
  │    urce-service.cy.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/common-service/common-serv       55ms        3        3        -        -        - │
  │    ice.cy.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/groups-service/groups-serv       38ms        1        1        -        -        - │
  │    ice.cy.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/favorite-service/favorite-       89ms        4        4        -        -        - │
  │    service.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/log-service/log-service.cy       63ms        2        2        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  services/project-service/project-se       54ms        2        2        -        -        - │
  │    rvice.cy.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/auth/auth-reducer.cy.js             46ms        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/data-explorer/data-explorer-m      152ms        9        9        -        -        - │
  │    iddleware.cy.js                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/data-explorer/data-explorer-r       90ms        6        6        -        -        - │
  │    educer.cy.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/dialog/dialog-reducer.cy.js         57ms        3        3        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/external-credentials/external      102ms        4        4        -        -        - │
  │    -credentials-actions.cy.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/groups-panel/groups-panel-mid       95ms        2        2        -        -        - │
  │    dleware-service.cy.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/link-account-panel/link-accou       54ms        3        3        -        -        - │
  │    nt-panel-reducer.cy.js                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/process-logs-panel/process-lo       49ms        2        2        -        -        - │
  │    gs-panel-actions.cy.js                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/processes/process-copy-action       56ms        1        1        -        -        - │
  │    s.cy.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/resource-type-filters/resourc      189ms       17       17        -        -        - │
  │    e-type-filters.cy.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/run-process-panel/run-process       74ms        2        2        -        -        - │
  │    -panel-actions.cy.js                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/search-bar/search-bar-actions      107ms        7        7        -        -        - │
  │    .cy.js                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/search-results-panel/search-r       57ms        2        2        -        -        - │
  │    esults-middleware-service.cy.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/tree-picker/tree-picker-actio      121ms        1        1        -        -        - │
  │    ns.cy.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/tree-picker/tree-picker-reduc      114ms        9        9        -        -        - │
  │    er.cy.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/workflow-panel/workflow-panel      130ms        1        1        -        -        - │
  │    -actions.cy.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/inactive-panel/inactive-panel      132ms        2        2        -        -        - │
  │    .cy.js                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/instance-types-panel/instance      229ms        3        3        -        -        - │
  │    -types-panel.cy.js                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/login-panel/login-panel.cy.js      100ms        8        8        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/not-found-panel/not-found-pan      145ms        3        3        -        -        - │
  │    el-root.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/process-panel/process-io-card      858ms        9        9        -        -        - │
  │    .cy.js                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views/workbench/workbench.cy.js          198ms        1        1        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/auto-logout/auto-l      139ms        3        3        -        -        - │
  │    ogout.cy.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/baner/banner.cy.js      159ms        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/data-explorer/rend      620ms       16       16        -        -        - │
  │    erers.cy.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/details-card/servi      638ms        2        2        -        -        - │
  │    ce-menu.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/main-app-bar/accou      407ms        1        1        -        -        - │
  │    nt-menu.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/property-chips/get      132ms        2        2        -        -        - │
  │    -property-chips.cy.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/search-bar/search-       62ms        1        1        -        -        - │
  │    bar-view.cy.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/sharing-dialog/sha      324ms        2        2        -        -        - │
  │    ring-dialog-component.cy.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/sharing-dialog/sha      435ms        4        4        -        -        - │
  │    ring-urls-component.cy.js                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/side-panel-button/       85ms        5        5        -        -        - │
  │    side-panel-button.cy.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/token-dialog/token      486ms        4        4        -        -        - │
  │    -dialog.cy.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/tree-picker/tree-p      188ms        3        3        -        -        - │
  │    icker.cy.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/webdav-s3-dialog/w      359ms        5        5        -        -        - │
  │    ebdav-s3-dialog.cy.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  store/collection-panel/collection-p      124ms        8        8        -        -        - │
  │    anel-files/collection-panel-files-r                                                         │
  │    educer.cy.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio       81ms        4        4        -        -        - │
  │    n-sets/collection-action-set.cy.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio      102ms        6        6        -        -        - │
  │    n-sets/project-action-set.cy.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio      138ms        3        3        -        -        - │
  │    ns/collection-file-viewer-action.cy                                                         │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio      223ms        1        1        -        -        - │
  │    ns/copy-to-clipboard-action.cy.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio      270ms        3        3        -        -        - │
  │    ns/download-action.cy.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio      223ms        1        1        -        -        - │
  │    ns/file-viewer-action.cy.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  views-components/context-menu/actio       78ms        4        4        -        -        - │
  │    ns/helpers.cy.js                                                                            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        00:29      373      373        -        -        -  

======= test services/workbench2_units -- 471s
Sent SIGTERM to 15627 (/tmp/workspace/run-tests-remainder/tmp/nginx.pid)
2025/12/12 22:22:01 [notice] 15627#15627: signal 15 (SIGTERM) received from 62090, exiting
2025/12/12 22:22:01 [notice] 15630#15630: exiting
2025/12/12 22:22:01 [notice] 15630#15630: exit
2025/12/12 22:22:01 [notice] 15627#15627: signal 17 (SIGCHLD) received from 15630
2025/12/12 22:22:01 [notice] 15627#15627: worker process 15630 exited with code 0
2025/12/12 22:22:01 [notice] 15627#15627: exit
Sent SIGTERM to 15689 (/tmp/workspace/run-tests-remainder/tmp/ws.pid)
Sent SIGTERM to 15671 (/tmp/workspace/run-tests-remainder/tmp/keep-web.pid)
Sent SIGTERM to 15658 (/tmp/workspace/run-tests-remainder/tmp/keepproxy.pid)
Sent SIGTERM to 15634 (/tmp/workspace/run-tests-remainder/tmp/controller.pid)
Sent SIGTERM to 15484 (/tmp/workspace/run-tests-remainder/tmp/api.pid)
Pass: sdk/python install (4s)
Pass: env install (0s)
Pass: doc install (1s)
Pass: sdk/ruby-google-api-client install (3s)
Pass: sdk/ruby install (12s)
Pass: contrib/R-sdk install (0s)
Pass: sdk/cli install (4s)
Pass: services/login-sync install (4s)
Pass: sdk/python install (4s)
Pass: tools/crunchstat-summary install (4s)
Pass: sdk/cwl install (4s)
Pass: services/dockercleaner install (3s)
Pass: services/fuse install (3s)
Pass: tools/cluster-activity install (3s)
Pass: cmd/arvados-client install (4s)
Pass: cmd/arvados-server install (44s)
Pass: lib/boot install (0s)
Pass: lib/cli install (0s)
Pass: lib/cloud install (0s)
Pass: lib/cloud/azure install (0s)
Pass: lib/cloud/cloudtest install (0s)
Pass: lib/cloud/ec2 install (0s)
Pass: lib/cloud/loopback install (0s)
Pass: lib/cmd install (0s)
Pass: lib/cmdtest install (0s)
Pass: lib/config install (0s)
Pass: lib/controller install (1s)
Pass: lib/controller/api install (0s)
Pass: lib/controller/dblock install (0s)
Pass: lib/controller/federation install (0s)
Pass: lib/controller/localdb install (0s)
Pass: lib/controller/railsproxy install (0s)
Pass: lib/controller/router install (0s)
Pass: lib/controller/rpc install (0s)
Pass: lib/crunchrun install (0s)
Pass: lib/crunchstat install (0s)
Pass: lib/ctrlctx install (0s)
Pass: lib/deduplicationreport install (0s)
Pass: lib/diagnostics install (0s)
Pass: lib/dispatchcloud install (1s)
Pass: lib/dispatchcloud/container install (0s)
Pass: lib/dispatchcloud/scheduler install (0s)
Pass: lib/dispatchcloud/sshexecutor install (0s)
Pass: lib/dispatchcloud/test install (0s)
Pass: lib/dispatchcloud/worker install (0s)
Pass: lib/lsf install (0s)
Pass: lib/mount install (0s)
Pass: lib/pam install (1s)
Pass: lib/recovercollection install (0s)
Pass: lib/selfsigned install (0s)
Pass: lib/service install (0s)
Pass: lib/webdavfs install (0s)
Pass: sdk/go/arvados install (0s)
Pass: sdk/go/arvadosclient install (0s)
Pass: sdk/go/arvadostest install (0s)
Pass: sdk/go/asyncbuf install (0s)
Pass: sdk/go/auth install (0s)
Pass: sdk/go/blockdigest install (0s)
Pass: sdk/go/config install (0s)
Pass: sdk/go/ctxlog install (0s)
Pass: sdk/go/dispatch install (0s)
Pass: sdk/go/health install (1s)
Pass: sdk/go/httpserver install (0s)
Pass: sdk/go/keepclient install (0s)
Pass: sdk/go/stats install (0s)
Pass: services/crunch-dispatch-local install (1s)
Pass: services/crunch-dispatch-slurm install (0s)
Pass: services/keep-balance install (0s)
Pass: services/keepproxy install (0s)
Pass: services/keepstore install (0s)
Pass: services/keep-web install (0s)
Pass: services/ws install (0s)
Pass: tools/keep-block-check install (0s)
Pass: tools/keep-exercise install (1s)
Pass: tools/keep-rsync install (1s)
Pass: tools/sync-groups install (1s)
Pass: tools/sync-users install (1s)
Pass: services/api install (15s)
Pass: services/workbench2 install (23s)
Pass: gofmt tests (16s)
Pass: arvados_version.py tests (0s)
Pass: sdk/ruby-google-api-client tests (0s)
Pass: sdk/ruby tests (2s)
Pass: sdk/cli tests (33s)
Pass: services/login-sync tests (3s)
Pass: tools/crunchstat-summary tests (0s)
Pass: sdk/cwl tests (76s)
Pass: services/dockercleaner tests (0s)
Pass: tools/cluster-activity tests (0s)
Pass: cmd/arvados-client tests (19s)
Pass: cmd/arvados-server tests (5s)
Pass: lib/boot tests (1s)
Pass: lib/cli tests (1s)
Pass: lib/cloud tests (0s)
Pass: lib/cloud/azure tests (1s)
Pass: lib/cloud/cloudtest tests (2s)
Pass: lib/cloud/ec2 tests (2s)
Pass: lib/cloud/loopback tests (1s)
Pass: lib/cmd tests (1s)
Pass: lib/cmdtest tests (0s)
Pass: lib/config tests (3s)
Pass: lib/controller/api tests (0s)
Pass: lib/controller/dblock tests (1s)
Pass: lib/controller/federation tests (3s)
Pass: lib/controller/localdb tests (187s)
Pass: lib/controller/railsproxy tests (0s)
Pass: lib/controller/router tests (3s)
Pass: lib/controller/rpc tests (1s)
Pass: lib/crunchrun tests (99s)
Pass: lib/crunchstat tests (2s)
Pass: lib/ctrlctx tests (1s)
Pass: lib/deduplicationreport tests (1s)
Pass: lib/diagnostics tests (1s)
Pass: lib/dispatchcloud tests (6s)
Pass: lib/dispatchcloud/container tests (2s)
Pass: lib/dispatchcloud/scheduler tests (1s)
Pass: lib/dispatchcloud/sshexecutor tests (1s)
Pass: lib/dispatchcloud/test tests (1s)
Pass: lib/dispatchcloud/worker tests (1s)
Pass: lib/lsf tests (6s)
Pass: lib/mount tests (1s)
Pass: lib/pam tests (20s)
Pass: lib/recovercollection tests (1s)
Pass: lib/selfsigned tests (0s)
Pass: lib/service tests (3s)
Pass: lib/webdavfs tests (0s)
Pass: sdk/go/arvados tests (39s)
Pass: sdk/go/arvadosclient tests (23s)
Pass: sdk/go/arvadostest tests (1s)
Pass: sdk/go/asyncbuf tests (0s)
Pass: sdk/go/auth tests (1s)
Pass: sdk/go/blockdigest tests (1s)
Pass: sdk/go/config tests (0s)
Pass: sdk/go/ctxlog tests (0s)
Pass: sdk/go/dispatch tests (2s)
Pass: sdk/go/health tests (8s)
Pass: sdk/go/httpserver tests (1s)
Pass: sdk/go/keepclient tests (7s)
Pass: sdk/go/stats tests (0s)
Pass: services/crunch-dispatch-local tests (8s)
Pass: services/crunch-dispatch-slurm tests (20s)
Pass: services/keep-balance tests (5s)
Pass: services/keepproxy tests (8s)
Pass: services/keepstore tests (11s)
Pass: services/keep-web tests (88s)
Pass: services/ws tests (20s)
Pass: tools/keep-block-check tests (21s)
Pass: tools/keep-exercise tests (1s)
Pass: tools/keep-rsync tests (22s)
Pass: tools/sync-groups tests (35s)
Pass: tools/sync-users tests (15s)
Pass: services/workbench2_units tests (471s)
Failures (1):
Fail: lib/controller tests (1747s)
Leaving behind temp dirs in /home/jenkins/tmp
Build step 'Execute shell' marked build as failure
Archiving artifacts
Started calculate disk usage of build
Finished Calculation of disk usage of build in 0 seconds
Started calculate disk usage of workspace
Finished Calculation of disk usage of workspace in  2 second
Finished: FAILURE