Common Workflow Language integration with Arvados » History » Version 3
Peter Amstutz, 08/08/2016 02:35 PM
| 1 | 1 | Peter Amstutz | h1. Common Workflow Language integration with Arvados |
|---|---|---|---|
| 2 | |||
| 3 | 3 | Peter Amstutz | The main integration is @arvados-cwl-runner@. This tool is used both as a client to submit a job to run the workflow (@arvados-cwl-runner --submit@) and for running the workflow directly (@arvados-cwl-runner --local@). When the user starts a CWL workflow from workbench, it functions similar to @--submit@ mode. |
| 4 | 2 | Peter Amstutz | |
| 5 | Because submit mode works by creating a "runner" job whose purpose is to manage execution of the workflow, it requires an @arvados/jobs@ Docker image with an up-to-date @arvados-cwl-runner@. |
||
| 6 | |||
| 7 | When running a workflow, the workflow runner: |
||
| 8 | # creates a job for each workflow steps |
||
| 9 | # submits it |
||
| 10 | # waits for it to complete |
||
| 11 | # gets the output collection for the job |
||
| 12 | # computes the CWL output object for the workflow step. |
||
| 13 | |||
| 14 | 1 | Peter Amstutz | !cwl-arvados-flow-local.png! |
| 15 | |||
| 16 | !cwl-arvados-flow-submit.png! |