Actions
Task #8485
closed
Bug #8483: datamanager fails if >=50 collections have the same modified_at timestamp
Fix GetCollections (datamanager) so that it can reliably retrieve all collections, regardless of the distribution of modified_at values
Description
Fix the loop/query code so that an offset is used for paging for records with identical modified_at values. If the first and last record of a batch have identical modified_at timestamps, increment the offset by BatchSize. As long as that continues to be the case, keep incrementing the offset by BatchSize. Once there is any range in modified_at time in the batch results, set offset back to 0.
Updated by Joshua Randall about 10 years ago
- Status changed from New to Feedback
- % Done changed from 0 to 100
PR ready for review: https://github.com/curoverse/arvados/pull/39
Updated by Tom Clegg about 10 years ago
- Status changed from Feedback to Resolved
- Remaining (hours) set to 0.0
Applied in changeset arvados|commit:58e1942ff008780d88a3e512dd7806c6a3b975a6.
Actions