Project

General

Profile

Actions

Bug #7840

closed

[NODE-MANAGER] exception

Added by Nico César over 10 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
-

Description

nodemanager had this log:

2015-11-23_14:23:10.45379 2015-11-23 14:23:10 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) sending poll
2015-11-23_14:23:10.45419 2015-11-23 14:23:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) sending poll
2015-11-23_14:23:11.60014 2015-11-23 14:23:11 arvnodeman.jobqueue[26132] DEBUG: Sending server wishlist: (empty)
2015-11-23_14:23:11.60027 2015-11-23 14:23:11 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) got response with 0 items
2015-11-23_14:23:11.60100 2015-11-23 14:23:11 arvnodeman.daemon[26132] DEBUG: Standard_D4: idle nodes 0, wishlist size 0
2015-11-23_14:23:11.99791 2015-11-23 14:23:11 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) got response with 233 items
2015-11-23_14:23:23.13713 2015-11-23 14:23:23 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) sending poll
2015-11-23_14:23:34.91245 2015-11-23 14:23:34 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) got response with 11 items
2015-11-23_14:23:34.91302 2015-11-23 14:23:34 arvnodeman.daemon[26132] INFO: Registering new cloud node /subscriptions/a731f419-596b-4b64-a278-364e76506b06/resourceGroups/c97qk/providers/Microsoft.Compute/virtualMachines/c97qk-api
2015-11-23_14:23:34.91353 2015-11-23 14:23:34 pykka[26132] DEBUG: Exception returned from NodeManagerDaemonActor (urn:uuid:2e59adc8-a0eb-4d8d-875c-1f1e20af25ad) to caller:
2015-11-23_14:23:34.91354 Traceback (most recent call last):
2015-11-23_14:23:34.91354   File "/usr/lib/python2.7/dist-packages/pykka/actor.py", line 200, in _actor_loop
2015-11-23_14:23:34.91355     response = self._handle_receive(message)
2015-11-23_14:23:34.91355   File "/usr/lib/python2.7/dist-packages/pykka/actor.py", line 294, in _handle_receive
2015-11-23_14:23:34.91356     return callee(*message['args'], **message['kwargs'])
2015-11-23_14:23:34.91356   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/daemon.py", line 188, in update_cloud_nodes
2015-11-23_14:23:34.91357     record = self._new_node(node)
2015-11-23_14:23:34.91357   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/daemon.py", line 160, in _new_node
2015-11-23_14:23:34.91358     start_time = self._cloud_driver.node_start_time(cloud_node)
2015-11-23_14:23:34.91358   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/driver/azure.py", line 105, in node_start_time
2015-11-23_14:23:34.91359     return arvados_timestamp(node.extra["tags"].get("booted_at"))
2015-11-23_14:23:34.91360   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/__init__.py", line 21, in arvados_timestamp
2015-11-23_14:23:34.91361     subsec_match = ARVADOS_TIMESUBSEC_RE.search(timestr)
2015-11-23_14:23:34.91361 TypeError: expected string or buffer
2015-11-23_14:24:10.45061 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) sending poll
2015-11-23_14:24:10.45509 2015-11-23 14:24:10 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) sending poll
2015-11-23_14:24:10.76321 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: Sending server wishlist: (empty)
2015-11-23_14:24:10.76326 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) got response with 0 items
2015-11-23_14:24:10.76401 2015-11-23 14:24:10 arvnodeman.daemon[26132] DEBUG: Standard_D4: idle nodes 0, wishlist size 0
2015-11-23_14:24:11.19536 2015-11-23 14:24:11 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) got response with 233 items
2015-11-23_14:24:23.13576 2015-11-23 14:24:23 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) sending poll

Actions #1

Updated by Peter Amstutz over 10 years ago

  • Status changed from New to Resolved

Fixed in 856c4e2

Actions

Also available in: Atom PDF