Actions
Bug #3825
closed[Crunch] crunch-job should save (very) large log files without filling up tmp space
Start date:
10/02/2014
Due date:
% Done:
100%
Estimated time:
(Total: 0.00 h)
Story points:
1.0
Description
Instead of writing to a temporary file and then calling arv-put, pipe the log directly to an arv-put process.
Updated by Tom Clegg over 10 years ago
- Subject changed from [Crunch] fix crunch-dispatch so it does not fill up tmp space when there a job has a (very) large log file to [Crunch] crunch-job should save (very) large log files without filling up tmp space
- Description updated (diff)
- Category set to Crunch
Updated by Tom Clegg over 10 years ago
- Target version changed from Arvados Future Sprints to 2014-10-08 sprint
Updated by Tom Clegg over 10 years ago
Reviewing 3825-crunch-pipe-to-arv-put at c6a6231
- I think it would read better if
output_log_*
were renamed tolog_writer_*
- The word "output" usually means "output of a task or job" around here, and that's already a bit overloaded and confusing.
- Perhaps
write_output_log
should rename to something slightly different thanwrite_log_writer
, though. Maybewrite_to_log_writer
orlog_writer_send
? - I do like the idea of using the whole substring
log_writer
(néeoutput_log
) in all of the related functions. It makes a really clear distinction between "this log pipe" and "some mysterious perl feature" and "some other logging-related thing we do here" etc.
+sub output_log_is_active() { + return $log_pipe_pid +}
Other than that, LGTM!
Updated by Tim Pierce over 10 years ago
- Status changed from In Progress to Resolved
- % Done changed from 67 to 100
Applied in changeset arvados|commit:d65963976174bd9c94fdb0b91eeb8a281f01e7b3.
Updated by Ward Vandewege over 10 years ago
- Target version changed from 2014-10-08 sprint to 2014-10-29 sprint
Updated by Ward Vandewege over 10 years ago
- Target version changed from 2014-10-29 sprint to 2014-10-08 sprint
Actions