Project

General

Profile

Actions

Bug #14710

open

[Workbench] Child containers run on federated clusters do not show up

Added by Peter Amstutz almost 6 years ago. Updated almost 5 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
3.0
Release relationship:
Auto

Description

Child containers are determined by querying for container requests where requested_by_container_uuid matches the parent container. This does not work for federated workflows, because (a) containers run on remote clusters don't set requested_by_container_uuid and (b) even if it was set, we don't have an easy way to query remotes (requires either #14374 or generalizing javascript multi-site search feature).

Solution:

  1. When controller creates a remote container request, it can supply requested_by_container_uuid
  2. Controller records the uuid of the remote container request, and saves a cache copy of container request record in the local database with the appropriate requested_by_container_uuid
  3. The client can filter on requested_by_container_uuid in the local database and get both local and remote container requests.
  4. When a client makes a list or get request that returns remote objects, fetch the latest records from the remote cluster and merge the updated records into the response. (And update the cached copy?)

What should the owner_uuid by on the cache copy?


Related issues 3 (3 open0 closed)

Related to Arvados - Story #14374: Multi-site (federated) object search in controllerNew

Actions
Related to Arvados Workbench 2 - Feature #15278: [Workbench 2] Search for & execute workflows defined on federated clustersNew

Actions
Related to Arvados - Feature #15457: [Controller] Delegate new container requests to other clusters based on location of input dataNew

Actions
Actions #1

Updated by Peter Amstutz almost 6 years ago

  • Status changed from New to In Progress
Actions #2

Updated by Peter Amstutz almost 6 years ago

  • Description updated (diff)
Actions #3

Updated by Tom Morris almost 6 years ago

  • Status changed from In Progress to New
Actions #4

Updated by Tom Morris almost 6 years ago

  • Related to Story #14374: Multi-site (federated) object search in controller added
Actions #5

Updated by Peter Amstutz almost 6 years ago

  • Description updated (diff)
Actions #6

Updated by Peter Amstutz almost 6 years ago

  • Description updated (diff)
Actions #7

Updated by Peter Amstutz almost 6 years ago

  • Description updated (diff)
  • Story points set to 3.0
Actions #8

Updated by Tom Morris almost 6 years ago

  • Target version changed from To Be Groomed to Arvados Future Sprints
Actions #9

Updated by Peter Amstutz over 5 years ago

  • Related to Story #15455: Outputs of workflow runs get put into a default location other than the user's home project added
Actions #10

Updated by Peter Amstutz over 5 years ago

  • Related to Feature #15278: [Workbench 2] Search for & execute workflows defined on federated clusters added
Actions #11

Updated by Peter Amstutz over 5 years ago

  • Related to deleted (Story #15455: Outputs of workflow runs get put into a default location other than the user's home project)
Actions #12

Updated by Tom Clegg over 5 years ago

  • Related to Feature #15457: [Controller] Delegate new container requests to other clusters based on location of input data added
Actions #13

Updated by Peter Amstutz almost 5 years ago

  • Target version deleted (Arvados Future Sprints)
  • Release set to 20
Actions

Also available in: Atom PDF