MICE Shifter Guides » History » Version 61
Franchini, Paolo, 08 December 2016 22:24
1 | 1 | Boyd, Steven | h1. MICE Shifter Guides |
---|---|---|---|
2 | |||
3 | 57 | Nebrensky, Henry | {{>toc}} |
4 | |||
5 | 1 | Boyd, Steven | * [[First shift]] guide |
6 | * [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]] |
||
7 | * [[ShifterRostering|Shifter scheduling]] |
||
8 | * [[Shifter Training]] |
||
9 | 40 | Boyd, Steven | * [[Shifter Rules and Checklists]] |
10 | 6 | Boyd, Steven | * "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/ |
11 | 21 | Boyd, Steven | * [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]] |
12 | 45 | Boyd, Steven | * "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178 |
13 | 11 | Boyd, Steven | |
14 | 58 | Franchini, Paolo | h2. Solenoid and FC Shifter guides |
15 | 47 | Boyd, Steven | |
16 | 48 | Boyd, Steven | These documents are provided by the magnet group. The instructions are at somewhat of a higher level |
17 | than required by shifters. The basic instruction for shifters is: |
||
18 | |||
19 | If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display) |
||
20 | call the magnet expert. |
||
21 | |||
22 | 47 | Boyd, Steven | "Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181 |
23 | "Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183 |
||
24 | |||
25 | 12 | Boyd, Steven | h2. Shifter Instructions or What to Do on Shift |
26 | |||
27 | "What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144 |
||
28 | |||
29 | 22 | Boyd, Steven | As part of your shift you should keep a record of people present, the main parameters of the |
30 | run and incidents that occurred during the run. A good example is shown in the |
||
31 | |||
32 | 23 | Boyd, Steven | Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf |
33 | |||
34 | Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials |
||
35 | in the conventional magnets every half hour. |
||
36 | 22 | Boyd, Steven | |
37 | 12 | Boyd, Steven | h2. How to launch and work with the Run Control |
38 | |||
39 | "Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135 |
||
40 | |||
41 | h2. Shifter checklist : How to start a run |
||
42 | |||
43 | 1 | Boyd, Steven | [[Shifter checklist to start a MICE run]] |
44 | 58 | Franchini, Paolo | |
45 | h2. Online monitoring and online reconstruction |
||
46 | |||
47 | * [[OnlineReconstruction|Online Reconstruction Instructions]] |
||
48 | * document#22 |
||
49 | 1 | Boyd, Steven | |
50 | h2. Where to find the CDB Viewer |
||
51 | |||
52 | The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer) |
||
53 | 56 | Nebrensky, Henry | |
54 | h1. What to do when something happens on shift |
||
55 | |||
56 | Shifter information for various problems that may be encountered on shift |
||
57 | 12 | Boyd, Steven | |
58 | 51 | Nebrensky, Henry | h2. Target and Beamline: What to do when... |
59 | 12 | Boyd, Steven | |
60 | 51 | Nebrensky, Henry | [[BeamlineProcsTargetFail|... the RATS daemon crashes]] |
61 | 59 | Franchini, Paolo | [[BeamlineProcsTargetFail|... a BPS error is encountered]] |
62 | 32 | Nebrensky, Henry | [[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]] |
63 | 34 | Nebrensky, Henry | [[BeamlineProcsTargetFail|... the target throws an error]] |
64 | 36 | Nebrensky, Henry | ... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished) |
65 | 37 | Nebrensky, Henry | [[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]] |
66 | 13 | Boyd, Steven | |
67 | 46 | Boyd, Steven | h2. What to do when you are requested by the BLOC to reset one of the conventional magnets |
68 | |||
69 | * Press the Controls Menu desktop GUI |
||
70 | * under BeamLine Elements, select BeamLine Summary |
||
71 | * press the third option, control option on the right hand side of the Beamline summary GUI |
||
72 | * the Danfysik MPS 8000 - MICE Beamline Magnets window opens |
||
73 | * press the Reset option in the second box, control box of this window. |
||
74 | |||
75 | 52 | Nebrensky, Henry | h2. Computing |
76 | 1 | Boyd, Steven | |
77 | 55 | Franchini, Paolo | h3. What if the Heartbeat alarm goes off? |
78 | 1 | Boyd, Steven | |
79 | 55 | Franchini, Paolo | * Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed |
80 | * Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or |
||
81 | * Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/ (u/p = mice/c****) |
||
82 | 52 | Nebrensky, Henry | |
83 | h3. What if one of the MICE thin clients crashes? |
||
84 | |||
85 | 26 | Boyd, Steven | Very rarely one the thin clients can crash like this https://micewww.pp.rl.ac.uk/elog/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG |
86 | 1 | Boyd, Steven | |
87 | 18 | Boyd, Steven | The current response to this is : |
88 | |||
89 | If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email |
||
90 | should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run |
||
91 | in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online |
||
92 | 1 | Boyd, Steven | expert. |
93 | 25 | Boyd, Steven | |
94 | 52 | Nebrensky, Henry | h3. What if an error from the DataMover is reported from Run Control |
95 | 25 | Boyd, Steven | |
96 | If an error is reported via Run Control then the shifters don't NEED to do anything - they can |
||
97 | carry on with the next run; all that will happen is that the data distribution will be delayed. |
||
98 | |||
99 | Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual |
||
100 | script. If it still doesn't work, eLog the error and escalate to (for now) Henry. |
||
101 | 27 | Boyd, Steven | |
102 | 1 | Boyd, Steven | Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10 |
103 | 49 | Franchini, Paolo | |
104 | h2. Alarm Handler |
||
105 | |||
106 | 60 | Franchini, Paolo | [[ALH|Instructions for the Alarm Handler]] |
107 | |||
108 | 50 | Franchini, Paolo | --- |