Project

General

Profile

Actions
Copy link

Idea #8663

closed

[Python SDK] Import commonly used methods to arvados.crunch

Added by Sarah Guthrie about 10 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
03/08/2016
Due date:
Story points:
-

Description

The pipeline developers have noticed they reuse a lot of functions when writing crunch scripts. Port these into the sdk

  • Get path of file matching regex given input parameter
  • Add regex support for one_task_per_input_file
  • Add function to spawn one_task_per_iterator that takes an iterator and does the rest

Examples of functions: https://github.com/bcosc/arvados-tools/blob/master/arvados_tools.py

Actions
Copy link
 #1

Updated by Bryan Cosca about 10 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Peter Amstutz about 6 years ago

  • Status changed from New to Closed
Actions
Copy link

Also available in: Atom PDF