Project

General

Profile

Myami on Ubuntu » History » Revision 25

Revision 24 (Jim Pulokas, 08/09/2012 11:58 AM) → Revision 25/35 (Jim Pulokas, 08/09/2012 04:33 PM)

h1. myami on Ubuntu 

 This is mainly a log of various experiences installing myami on Ubuntu which will gradually evolve into a more formal document.    This will attempt to demonstrate the installation of all of myami including both leginon and appion on a single Ubuntu host.    This will also include running MySQL, Apache Torque, etc. on this local host without needing to connect to any other host. 

 h2. Installing a basic Ubuntu system 

 We use Ubuntu 12.04 LTS (Precise) Desktop 64 bit.    Install a basic system from an image on CD or bootable USB drive. Default selections during the install process, no 3rd party repositories, no network configuration and no updates during the installation.    This makes it easier in the remainder of this document to know that we have started from a known base system.    Reboot. 

 Following the initial reboot: 
 * connect to the internet (click network icon in upper right) 
 * update packages:<pre>sudo apt-get update 
 sudo apt-get upgrade</pre> 
 * Reboot 

 You now have a basic up-to-date Ubuntu system 

 h2. Installing additional packages required by myami 

 There are many additional packages to install, but we can try to condense that list to the smallest set necessary to pass to the update command which will then figure out all the other dependencies. 

 Here is a single command to install all the necessary packages:<pre>sudo apt-get install subversion vim python-MySQLdb python-wxgtk2.8 python-fs mysql-server php5 php5-mysql libssh2-php php5-gd</pre>During installation, you will be prompted several times to create a mysql root password.    This can optionally be left blank at the expense of less security.    Note:    installing the vim text editor is my own preference... use an inferior text editor if you wish :) 

 The Scipy package is also required, but the current version 0.9.0 that comes with Ubuntu 12.04 is broken.    You need to grab the more recent version of Scipy from Ubuntu Quantal (development version).    To make a clean installation that will not confuse the package manager we have prepared a mini-repository that includes this new scipy.    You can download and install scipy using the following set of commands copied into your terminal.<pre>sudo mkdir /usr/local/share/myami</pre>That should get your password in the sudo cache so you can copy the rest of these without entering a password:<pre>cd /usr/local/share/myami 
 sudo wget http://emg.nysbc.org/attachments/download/1488/ubuntu-scipy-0.10.1.tar.bz 
 sudo tar jxf ubuntu-scipy-0.10.1.tar.bz 
 sudo sh -c 'echo "deb file:///usr/local/share/myami/ubuntu-scipy-0.10.1 ./" > /etc/apt/sources.list.d/myami.list' 
 sudo apt-get update 
 sudo apt-get install python-scipy</pre>Make sure that last line executes (may have to hit enter).    Also, you may have to confirm installing it without authentication. 

 h2. Setting up MySQL databases 

 * create /etc/mysql/conf.d/myami.cnf with the following contents:<pre>[mysqld] 
 default-storage-engine=myisam 
 query_cache_size = 100M 
 query_cache_limit = 100M</pre> 
 * restart mysql server:<pre>sudo service mysql restart</pre> 
 * create databases:<pre>sudo mysqladmin create leginondb 
 sudo mysqladmin create projectdb</pre> 
 * create user and grand privileges... login to mysql as root:<pre>mysql -u root mysql</pre> 
 ** once inside mysql client, grant privs:<pre>create user user usr_object@'localhost'; 
 grant all privileges on leginondb.* to usr_object@'localhost'; 
 grant all privileges on projectdb.* to usr_object@'localhost'; 
 grant alter, create, insert, select, update on `ap%`.* to usr_object@localhost;</pre> 

 h2. Setting up Apache web server 

 create /etc/php5/conf.d/myami.ini with the following contents:<pre>error_reporting = E_ALL & ~E_NOTICE & ~E_WARNING 
 display_errors = On 
 register_argc_argv = On 
 short_open_tag = On 
 max_execution_time = 300 
 max_input_time = 300 
 memory_limit = 256M</pre>restart apache:<pre>sudo service apache2 restart</pre> 

 h2. Install myami 

 * check out a trunk sandbox:<pre>cd 
 svn co http://emg.nysbc.org/svn/myami/trunk myami-trunk</pre> 
 * install myami python packages:<pre>cd myami-trunk 
 sudo ./pysetup.sh install 
 ADD APPION PYTHON PACKAGE INSTALL HERE</pre> 
 * create image storage directory:<pre>sudo mkdir /data 
 sudo mkdir /data/leginon 
 sudo chmod a+w /data/leginon</pre> 
 * configure python packages:<pre>cp leginon/leginon.cfg.template ~/leginon.cfg 
 cp sinedon/examples/sinedon.cfg ~/sinedon.cfg 
 cp pyscope/instruments.cfg.template ~/instruments.cfg</pre>then edit and config all three of the above files. 
 * Install myamiweb:<pre>sudo cp -r myamiweb /var/www 
 sudo chmod 777 /var/www/myamiweb</pre> 
 * setup and configure redux:<pre>sudo mkdir /var/cache/myami 
 sudo mkdir /var/cache/myami/redux 
 sudo chown -R www-data.www-data /var/cache/myami 
 sudo vim /user/local/lib/python2.7/dist-packages/redux/pipeline.py</pre>(set cache path and size) 
 * initialize databases and generate config.php using web tool: http://localhost/myamiweb/setup 
 * make any manual fixes to /var/www/myamiweb/config.php, such as enable redux cache, disable regular cache... 
 * Other administrative setup: 
 ** http://localhost/myamiweb/admin.php 
 *** add user 
 *** import apps 
 ** http://localhost/myamiweb/project/project.php 
 *** add new project 
 * test if leginon starts:<pre>start-leginon.py</pre> 

 h2. Optional additions 

 * for mounting external network shares 
 ** install nfs-common<pre>sudo apt-get install nfs-common</pre> 
 ** For automounting and similar services install NIS:<pre>sudo apt-get install nis</pre>