Actions
Task #3309
open
Story #3511: [Documentation] Present an efficient pattern for developing a pipeline template with multiple crunch scripts
[Documentation] Present an efficient pattern for developing a Python program as a Crunch job
Status:
New
Priority:
Normal
Assigned To:
-
Category:
Documentation
Target version:
-
Start date:
Due date:
% Done:
0%
Estimated time:
Description
Approximate outline:
- Find/make a small test dataset and put it in Keep
- Clone git repository to shell VM (or start a new one)
- Put crunch wrapper in
/crunch_scripts/foobar - Run on VM in terminal using crunch-job
- Repeat until this works
- Commit and push
- Run as a real job using small test dataset
- Repeat until this works
- Run as a real job using real data
- One task per job
Here, just present the minimum feature set. Refer to appropriate doc sections for related features, something like "Learn more about what scripts are expected to see/do/output on the {foobar doc page}" (link to outcome of #3044)
Updated by 
Updated by 
Updated by
Actions