Project

General

Profile

MICE Shifter Guides » History » Version 59

Franchini, Paolo, 08 December 2016 20:15

1 1 Boyd, Steven
h1. MICE Shifter Guides
2
3 57 Nebrensky, Henry
{{>toc}}
4
5 1 Boyd, Steven
* [[First shift]] guide
6
* [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]]
7
* [[ShifterRostering|Shifter scheduling]]
8
* [[Shifter Training]]
9 40 Boyd, Steven
* [[Shifter Rules and Checklists]]
10 6 Boyd, Steven
* "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/
11 21 Boyd, Steven
* [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]]
12 45 Boyd, Steven
* "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178
13 11 Boyd, Steven
14 58 Franchini, Paolo
h2. Solenoid and FC Shifter guides
15 47 Boyd, Steven
16 48 Boyd, Steven
These documents are provided by the magnet group. The instructions are at somewhat of a higher level 
17
than required by shifters. The basic instruction for shifters is:
18
19
If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display)
20
call the magnet expert.
21
22 47 Boyd, Steven
"Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181
23
"Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183
24
25 12 Boyd, Steven
h2. Shifter Instructions or What to Do on Shift
26
27
"What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144
28
29 22 Boyd, Steven
As part of your shift you should keep a record of people present, the main parameters of the
30
run and incidents that occurred during the run. A good example is shown in the 
31
32 23 Boyd, Steven
Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf
33
34
Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials
35
in the conventional magnets every half hour. 
36 22 Boyd, Steven
37 12 Boyd, Steven
h2. How to launch and work with the Run Control
38
39
"Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135
40
41
h2. Shifter checklist : How to start a run
42
43 1 Boyd, Steven
[[Shifter checklist to start a MICE run]]
44 58 Franchini, Paolo
45
h2. Online monitoring and online reconstruction
46
47
* [[OnlineReconstruction|Online Reconstruction Instructions]]
48
* document#22
49 1 Boyd, Steven
50
h2. Where to find the CDB Viewer
51
52
The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer)
53 56 Nebrensky, Henry
54
h1. What to do when something happens on shift
55
56
Shifter information for various problems that may be encountered on shift
57 12 Boyd, Steven
58 51 Nebrensky, Henry
h2. Target and Beamline: What to do when...
59 12 Boyd, Steven
60 51 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the RATS daemon crashes]]
61 59 Franchini, Paolo
[[BeamlineProcsTargetFail|... a BPS error is encountered]]
62 32 Nebrensky, Henry
[[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]]
63 34 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the target throws an error]]
64 36 Nebrensky, Henry
... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished)
65 37 Nebrensky, Henry
[[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]]
66 13 Boyd, Steven
67 46 Boyd, Steven
h2. What to do when you are requested by the BLOC to reset one of the conventional magnets
68
69
* Press the Controls Menu desktop GUI
70
* under BeamLine Elements, select BeamLine Summary
71
* press the third option, control option on the right hand side of the Beamline summary GUI
72
* the Danfysik MPS 8000 - MICE Beamline Magnets window opens
73
* press the Reset option in the second box, control box of this window.
74
75 52 Nebrensky, Henry
h2. Computing
76 1 Boyd, Steven
77 55 Franchini, Paolo
h3. What if the Heartbeat alarm goes off?
78 1 Boyd, Steven
79 55 Franchini, Paolo
* Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed
80
* Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or
81
* Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/  (u/p = mice/c****)
82 52 Nebrensky, Henry
83
h3. What if one of the MICE thin clients crashes?
84
85 26 Boyd, Steven
Very rarely one the thin clients can crash like this https://micewww.pp.rl.ac.uk/elog/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG
86 1 Boyd, Steven
87 18 Boyd, Steven
The current response to this is :
88
89
If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email
90
should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run
91
in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online
92 1 Boyd, Steven
expert.
93 25 Boyd, Steven
94 52 Nebrensky, Henry
h3. What if an error from the DataMover is reported from Run Control
95 25 Boyd, Steven
96
If an error is reported via Run Control then the shifters don't NEED to do anything - they can
97
carry on with the next run; all that will happen is that the data distribution will be delayed. 
98
99
Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual
100
script. If it still doesn't work, eLog the error and escalate to (for now) Henry.
101 27 Boyd, Steven
102 1 Boyd, Steven
Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10
103 49 Franchini, Paolo
104
h2. Alarm Handler
105
106
Few instruction are "here":https://micewww.pp.rl.ac.uk/projects/cm/wiki/Alarm_handler
107 50 Franchini, Paolo
108
---