Actions
Bug #7840
closed[NODE-MANAGER] exception
Status:
Resolved
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
-
Description
nodemanager had this log:
2015-11-23_14:23:10.45379 2015-11-23 14:23:10 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) sending poll
2015-11-23_14:23:10.45419 2015-11-23 14:23:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) sending poll
2015-11-23_14:23:11.60014 2015-11-23 14:23:11 arvnodeman.jobqueue[26132] DEBUG: Sending server wishlist: (empty)
2015-11-23_14:23:11.60027 2015-11-23 14:23:11 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) got response with 0 items
2015-11-23_14:23:11.60100 2015-11-23 14:23:11 arvnodeman.daemon[26132] DEBUG: Standard_D4: idle nodes 0, wishlist size 0
2015-11-23_14:23:11.99791 2015-11-23 14:23:11 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) got response with 233 items
2015-11-23_14:23:23.13713 2015-11-23 14:23:23 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) sending poll
2015-11-23_14:23:34.91245 2015-11-23 14:23:34 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) got response with 11 items
2015-11-23_14:23:34.91302 2015-11-23 14:23:34 arvnodeman.daemon[26132] INFO: Registering new cloud node /subscriptions/a731f419-596b-4b64-a278-364e76506b06/resourceGroups/c97qk/providers/Microsoft.Compute/virtualMachines/c97qk-api
2015-11-23_14:23:34.91353 2015-11-23 14:23:34 pykka[26132] DEBUG: Exception returned from NodeManagerDaemonActor (urn:uuid:2e59adc8-a0eb-4d8d-875c-1f1e20af25ad) to caller:
2015-11-23_14:23:34.91354 Traceback (most recent call last):
2015-11-23_14:23:34.91354 File "/usr/lib/python2.7/dist-packages/pykka/actor.py", line 200, in _actor_loop
2015-11-23_14:23:34.91355 response = self._handle_receive(message)
2015-11-23_14:23:34.91355 File "/usr/lib/python2.7/dist-packages/pykka/actor.py", line 294, in _handle_receive
2015-11-23_14:23:34.91356 return callee(*message['args'], **message['kwargs'])
2015-11-23_14:23:34.91356 File "/usr/local/lib/python2.7/dist-packages/arvnodeman/daemon.py", line 188, in update_cloud_nodes
2015-11-23_14:23:34.91357 record = self._new_node(node)
2015-11-23_14:23:34.91357 File "/usr/local/lib/python2.7/dist-packages/arvnodeman/daemon.py", line 160, in _new_node
2015-11-23_14:23:34.91358 start_time = self._cloud_driver.node_start_time(cloud_node)
2015-11-23_14:23:34.91358 File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/driver/azure.py", line 105, in node_start_time
2015-11-23_14:23:34.91359 return arvados_timestamp(node.extra["tags"].get("booted_at"))
2015-11-23_14:23:34.91360 File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/__init__.py", line 21, in arvados_timestamp
2015-11-23_14:23:34.91361 subsec_match = ARVADOS_TIMESUBSEC_RE.search(timestr)
2015-11-23_14:23:34.91361 TypeError: expected string or buffer
2015-11-23_14:24:10.45061 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) sending poll
2015-11-23_14:24:10.45509 2015-11-23 14:24:10 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) sending poll
2015-11-23_14:24:10.76321 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: Sending server wishlist: (empty)
2015-11-23_14:24:10.76326 2015-11-23 14:24:10 arvnodeman.jobqueue[26132] DEBUG: JobQueueMonitorActor (at 140320800085136) got response with 0 items
2015-11-23_14:24:10.76401 2015-11-23 14:24:10 arvnodeman.daemon[26132] DEBUG: Standard_D4: idle nodes 0, wishlist size 0
2015-11-23_14:24:11.19536 2015-11-23 14:24:11 arvnodeman.arvados_nodes[26132] DEBUG: ArvadosNodeListMonitorActor (at 140320799469840) got response with 233 items
2015-11-23_14:24:23.13576 2015-11-23 14:24:23 arvnodeman.cloud_nodes[26132] DEBUG: CloudNodeListMonitorActor (at 140320887266704) sending poll
Actions