How to remove data
Added by Anchi Cheng almost 14 years ago
This a question from Liguo.
If your data disk is full and you don't expect to ever want to look at it through myamiweb web server, yes, you can remove the images from the session. Go to http://your_host/myamiweb/imageviewer.php and click on the 'summary' tab on top left to find the location of the image path for the particular session you choose. Then you can follow that path from your terminal and remove them.
It is important not to remove anything that other Leginon users may need even if they are not aware of the connection, though. I am referring to the gain bright/dark and gain normilization images you may have created in this old session. As a general rule you should leave them alone in the same path that the database record says it is. Leginon needs access to the most recent bright, bright, and normalization images for each camera configuration regardless of the user. If you really want to remove the whole old session, you should first confirm that none of the camera configuration would regard the gain references in that session as most recent or reacquire a whole new set of the reference images in a new session.
In the future Leginon version (2.2 and later), a special reference session is used for storing gain references from any normal session so that the latter can be archived or removed safely with ease.
The database should not be touched except to change the 'image path' field of SessionData if you have simply moved the data to a new disk or want to mark it as archived.
Replies (4)
RE: How to remove data - Added by Liguo Wang almost 14 years ago
No, the data disk is not full. 8.4TB is available. What else can I do?
Thanks.
RE: How to remove data - Added by Anchi Cheng almost 14 years ago
The only reason that I mention full data disk is because we do not recommend that you delete data just because you don't want to see it now. If you are sure that you don't want the data ever, you can delete the images as I mentioned above. The web viewer will show blank when it needs to read them, but it won't break. Only the removal of bright/dark/norm images have consequences. They are named xxxxbrightxxxx.mrc etc in the same folder as other images acquired in the session.
RE: How to remove data - Added by Liguo Wang almost 14 years ago
I think my question is how to fix the "DataManager size reached, removing data as needed" error. As I still have enough free space on the disk (more than 8000GB), why did I get that error and what should I do with that error? Should I just leave it alone?
Thanks.
Liguo
RE: How to remove data - Added by Anchi Cheng almost 14 years ago
Sorry for the misunderstanding of your original question. You don't. "DataManager size reached, removing data as needed" is not an error and it does not clean up on the hard disk, It is cleaning up images from the memory that have not been used for a while to make room in the RAM for new images acquired. The message is there in Leginon 1.6 to let you know that it is doing so. Jim has removed that print message in the newer version (and also a bit different (better) way to keep the load small). When the computer memory is relatively small like 2-4 GB, Without the cleaning, even the process of acquiring 10 4kx4k gain normalized images will take most of it and force Leginon to start using disk cache, which is a lot slower. If a reference image is needed later, Leginon will load it into memory again.