DataManager size reached, removing data as needed
Added by Anonymous over 14 years ago
During Image acquisition and computing we received this message, and the workstation has slowed down much.
- DataManager size reached, removing data as needed
Where or how can we increase the size limit?
Replies (2)
Re: DataManager size reached, removing data as needed - Added by Jim Pulokas over 14 years ago
How much memory is on this machine? You may need to add more memory, especially if this machine is running leginon and the web server and the database.
The leginon datamanager size limit can be adjusted if you want to experiment with it. In this case, you want to set the limit lower to prevent the cache from getting too big. The problem will be if the cache is limited too much it will remove important things from memory.
The value to adjust is in sinedon/data.py, approximately line 80. There is a value "megs = 300" and you just need to set it to something lower, like 200. This may not reduce the memory usage enough to fix your problem, but you can try it. The cache is made large in order to hold on to images that may be needed in the future, without needing to read the images from the filesystem.
Memory managment in the new leginon (myami 2.0) is better. There is no longer a fixed cache size. It still will use a large amount of memory, but not as much as before. The best solution is definietly to add more memory to the machine.
Re: DataManager size reached, removing data as needed - Added by Anonymous over 14 years ago
We were getting the same error message, thought it would take 1 exposure and then stop--we would have to kill the application and try again. How does Leginon decide what data to delete? Is it the oldest data? That would be fin with us--the oldest data on file are just test pictures we took of a test grid. Still, it would be good to know...