Bug #1762
closedredux cache remove error
0%
Description
REQUEST: pipeline=standard&filename=/ami/data00/leginon/12mar26c/rawdata/12mar26c_b_00022gr_00029sq_v02_00012hl_v01.mrc&shape=256x256&scaletype=stdev&scalemin=-3&scalemax=3&oformat=JPEG
NOT IN MEMORY: Format(40370000,oformat=JPEG,rgb=False)
NOT IN MEMORY: Scale(40369744,scalemax=3.0,scalemin=-3.0,scaletype=stdev)
NOT IN MEMORY: Shape(40369936,shape=(256, 256))
"redux.log" 1597321L, 142061896C
NOT IN MEMORY: Format(140224864115728,oformat=JPEG,rgb=False)
NOT IN MEMORY: Scale(140224864116304,scalemax=3.0,scalemin=-3.0,scaletype=stdev)
NOT IN MEMORY: Mask(140224864113936,maskradius=5)
NOT IN MEMORY: Shape(140224864112720,shape=(512, 512))
NOT IN MEMORY: Power(140224864116112,)
1335534373.15
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/redux/server.py", line 37, in run_process
result = pipeline.process(**kwargs)
File "/usr/lib/python2.6/site-packages/redux/pipeline.py", line 90, in process
result = results.get(done)
File "/usr/lib/python2.6/site-packages/redux/cache.py", line 44, in get
result = self.file_get(pipeline)
File "/usr/lib/python2.6/site-packages/redux/cache.py", line 76, in file_get
f.close()
File "/usr/lib/python2.6/site-packages/redux/cachefs.py", line 26, in close
self.closecallback(self.name, self.mode)
File "/usr/lib/python2.6/site-packages/redux/cachefs.py", line 81, in close_callback
self.order.remove(name)
ValueError: deque.remove(x): x not in deque
Updated by Anchi Cheng over 12 years ago
- Priority changed from Normal to Immediate
Updated by Jim Pulokas over 12 years ago
- Status changed from Assigned to In Test
- Assignee changed from Jim Pulokas to Anchi Cheng
Can not reproduce this. For some reason, in CacheFS, self.order does not contain a file that was supposedly just read from the disk cache. If the file exists, then it should be in self.order. It is either added to self.order during initialization, or added when the file is initially opened for write and closed. For now the solution is to catch and ignore the exception. fix is in r16958.
I suggest that this be closed if no problems for a couple weeks.
Updated by Jim Pulokas over 12 years ago
commit r16962 for better organization and keeping deque and dict updates together.
commit r16963 to put a thread lock around the insert method, hopefully preventing multiple threads from getting deque and dict out of sync.
Updated by Jim Pulokas over 12 years ago
- Status changed from In Test to Duplicate
- Assignee deleted (
Anchi Cheng)