Project

General

Profile

Actions

MLCR Deployment » History » Revision 29

« Previous | Revision 29/42 (diff) | Next »
Rogers, Chris, 10 June 2013 09:51


MLCR Deployment

There are three installations of MAUS in the MICE Local Control Room:

  • The current version .maus_release (bound to lp:maus)
  • The previous version .maus_release_old (bound to lp:maus)
  • A development copy .maus_control-room (bound to lp:~maus-mlcr/maus/control-room/)

The current and previous version are updated by leapfrogging; at the moment only the control-room version is used for online reconstruction, the control room stuff was never merged into the trunk. Note that versions are in hidden folders (prefixed by '.'). To see them do

ls -h
There is a soft link that points to the "default" version (for use by shifters). This should usually point at the current version .maus_release.

New version of main MAUS release

To update to a new version:

  1. Let MOM know what you are doing
  2. First move the current MAUS install onto the fall back release
    1. mv .maus_release_old .maus_release_old_
    2. mv .maus_release .maus_release_old
    3. Reconfigure the old install
      • cd .maus_release_old; ./configure; source env.sh
    4. Check it is okay
      • bash tests/unit_tests.bash; bash tests/application_tests.bash
  3. Next get the current MAUS release copy (or a version as specified by MAUS experts)
    1. Do bzr checkout lp:maus .maus_release
    2. Build the code cd .maus_release; ./install_build_test.bash
    3. Rebuild with added online library bash third_party/bash/70daq.bash; scons -j8
    4. Run the integration tests bash tests/application_tests.bash >& application_tests.log
      • If there is a SKIPPED, this is bad - should not skip any tests
      • If you are working through a terminal, there is a test which fails if you don't forward X11 connections (test_help.py)
    5. Check that the online libraries are running okay python python tests/integration/test_distributed_processing/_test_online_okay.py
    6. Run tests/integration/test_analyze_data_online/test_analyze_data_online.py. Bring up a browser and look at pretty plots.
    7. Check that the integration tests passed; check that analyze_data_online and test_multi_vs_single_threaded tests did not skip.
  4. Check for changes in power cycle procedure Onrec_power_cycle_procedure or shifter instructions
  5. Check the updated installation functions correctly by following the shifter instructions
    • A cosmics run is ideal
  6. Remove the old old release rm -rf .maus_release_old_
  7. Add a note in the ELog
  8. Email MOGUL head and MOM to let them know that something changed

New version of control room branch

To update the control room branch

  1. Let MOM know what you are doing and MAUS online person.
  2. cd MAUS/.maus_control_room
  3. bzr update
  4. ./install_build_test.bash
  5. Run whatever tests you want

Apache server (Not used)

If you want to use the Apache web server, then:

  • Configure the web server,
    cd /home/mice/MAUS.new/maus-apps
    ./configure
    rm -rf media/thumbs/*
    rm -rf media/raw/*
    
  • As super user, restart Apache,
    /usr/local/apache2/bin/apachectl restart
    
  • Check the logs,
    more /usr/local/apache2/logs/error_log 
    
  • You should see something like,
    [Mon Mar 12 12:41:16 2012] [notice] Apache/2.2.22 (Unix) mod_wsgi/3.3 
     Python/2.7.2 configured -- resuming normal operations
    
  • If you get a warning like,
    httpd: Syntax error on line 55 of /usr/local/apache2/conf/httpd.conf: 
    Cannot load /usr/local/apache2/modules/mod_wsgi.so into server: libpython2.7.so.1.0: 
    cannot open shared object file: No such file or directory
    
    • Then unset MAUS_ROOT_DIR and try again:
      unset MAUS_ROOT_DIR
      /usr/local/apache2/bin/apachectl restart
      

Install from Scratch

The following libraries/services need to be installed and do not come as part of the MAUS prepacked stuff.

Install MongoDB

MongoDB can be installed using yum as follows.

  • Log in as a super-user by using sudo su - or su.
  • Edit /etc/yum.repos.d/10gen.repo and add the lines
    [10gen]
    name=10gen Repository
    baseurl=http://downloads-distro.mongodb.org/repo/redhat/os/i686
    gpgcheck=0
    
  • Run
    $ yum install mongo-10gen
     ...
     mongo-10gen         i686         2.0.1-mongodb_1           10gen          28 M
     ...
    $ yum install mongo-10gen-server
     ...
     mongo-10gen-server       i686       2.0.1-mongodb_1          10gen       5.4 M
    ...
    
  • Start the server
    $ /sbin/service mongod start
    Starting mongod: forked process: 4357
                                                               [  OK  ]
    all output going to: /var/log/mongo/mongod.log
    $ /sbin/service mongod status
    mongod (pid 4357) is running...
    

    (as an alternative to service mongod you can use /etc/init.d/mongod)

By default MongoDB is available on http://localhost:27017/.

Install RabbitMQ

To install on Scientific Linux or RedHat you should:

  • Log in as a super-user by using sudo su - or su.
  • Run:
    $ yum install rabbitmq-server
    
    Installing:
     rabbitmq-server        noarch        2.2.0-1.el5          epel           890 k
    Installing for dependencies:
     erlang                 i386          R12B-5.10.el5        epel            39 M
     unixODBC               i386          2.2.11-7.1           sl-base        832 k
    
  • Check that /usr/sbin is in the PATH:
    $ echo %PATH
    ...
    
  • If not, then add it:
    $ export PATH=$PATH:/usr/sbin
    
  • Start the RabbitMQ server:
    $ /sbin/service rabbitmq-server start
    
  • Create a MAUS username and password pair e.g.
    $ rabbitmqctl add_user maus suam
    Creating user "maus" ...
    ...done.
    
  • Create a MAUS virtual host:
    $ rabbitmqctl add_vhost maushost
    Creating vhost "maushost" ...
    ...done.
    
  • Set the permissions for the user on this host:
    $ rabbitmqctl set_permissions -p maushost maus ".*" ".*" ".*" 
    Setting permissions for user "maus" in vhost "maushost" ...
    ...done.
    
  • Check it is running OK:
    $ /sbin/service rabbitmq-server status
    Status of all running nodes...
    Node 'rabbit@maus' with Pid 1377: running
    done.
    

Default port:

By default RabbitMQ uses port 5672. If you want worker nodes outside your firewall to use the RabbitMQ broker then you will need to open this port.

Updated by Rogers, Chris over 8 years ago · 29 revisions