Project

General

Profile

MICE Shifter Guides » History » Version 63

Franchini, Paolo, 10 May 2017 12:23

1 1 Boyd, Steven
h1. MICE Shifter Guides
2
3 57 Nebrensky, Henry
{{>toc}}
4
5 1 Boyd, Steven
* [[First shift]] guide
6
* [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]]
7
* [[ShifterRostering|Shifter scheduling]]
8
* [[Shifter Training]]
9 40 Boyd, Steven
* [[Shifter Rules and Checklists]]
10 6 Boyd, Steven
* "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/
11 21 Boyd, Steven
* [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]]
12 45 Boyd, Steven
* "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178
13 11 Boyd, Steven
14 58 Franchini, Paolo
h2. Solenoid and FC Shifter guides
15 47 Boyd, Steven
16 48 Boyd, Steven
These documents are provided by the magnet group. The instructions are at somewhat of a higher level 
17
than required by shifters. The basic instruction for shifters is:
18
19
If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display)
20
call the magnet expert.
21
22 47 Boyd, Steven
"Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181
23
"Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183
24
25 12 Boyd, Steven
h2. Shifter Instructions or What to Do on Shift
26
27
"What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144
28
29 22 Boyd, Steven
As part of your shift you should keep a record of people present, the main parameters of the
30
run and incidents that occurred during the run. A good example is shown in the 
31
32 23 Boyd, Steven
Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf
33
34
Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials
35
in the conventional magnets every half hour. 
36 22 Boyd, Steven
37 12 Boyd, Steven
h2. How to launch and work with the Run Control
38
39
"Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135
40
41
h2. Shifter checklist : How to start a run
42
43 1 Boyd, Steven
[[Shifter checklist to start a MICE run]]
44 58 Franchini, Paolo
45
h2. Online monitoring and online reconstruction
46
47
* [[OnlineReconstruction|Online Reconstruction Instructions]]
48
* document#22
49 1 Boyd, Steven
50
h2. Where to find the CDB Viewer
51
52
The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer)
53 56 Nebrensky, Henry
54 63 Franchini, Paolo
h2. Trackers calibration
55
56
https://micewww.pp.rl.ac.uk/projects/operations/wiki/Trackers
57
58 56 Nebrensky, Henry
h1. What to do when something happens on shift
59
60
Shifter information for various problems that may be encountered on shift
61 12 Boyd, Steven
62 51 Nebrensky, Henry
h2. Target and Beamline: What to do when...
63 12 Boyd, Steven
64 51 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the RATS daemon crashes]]
65 59 Franchini, Paolo
[[BeamlineProcsTargetFail|... a BPS error is encountered]]
66 32 Nebrensky, Henry
[[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]]
67 34 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the target throws an error]]
68 36 Nebrensky, Henry
... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished)
69 37 Nebrensky, Henry
[[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]]
70 13 Boyd, Steven
71 46 Boyd, Steven
h2. What to do when you are requested by the BLOC to reset one of the conventional magnets
72
73
* Press the Controls Menu desktop GUI
74
* under BeamLine Elements, select BeamLine Summary
75
* press the third option, control option on the right hand side of the Beamline summary GUI
76
* the Danfysik MPS 8000 - MICE Beamline Magnets window opens
77
* press the Reset option in the second box, control box of this window.
78
79 52 Nebrensky, Henry
h2. Computing
80 1 Boyd, Steven
81 55 Franchini, Paolo
h3. What if the Heartbeat alarm goes off?
82 1 Boyd, Steven
83 55 Franchini, Paolo
* Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed
84
* Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or
85
* Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/  (u/p = mice/c****)
86 52 Nebrensky, Henry
87
h3. What if one of the MICE thin clients crashes?
88
89 62 Franchini, Paolo
Very rarely one the thin clients can crash like this http://elog.mice.rl.ac.uk/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG
90 1 Boyd, Steven
91 18 Boyd, Steven
The current response to this is :
92
93
If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email
94
should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run
95
in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online
96 1 Boyd, Steven
expert.
97 25 Boyd, Steven
98 52 Nebrensky, Henry
h3. What if an error from the DataMover is reported from Run Control
99 25 Boyd, Steven
100
If an error is reported via Run Control then the shifters don't NEED to do anything - they can
101
carry on with the next run; all that will happen is that the data distribution will be delayed. 
102
103
Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual
104
script. If it still doesn't work, eLog the error and escalate to (for now) Henry.
105 27 Boyd, Steven
106 1 Boyd, Steven
Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10
107 49 Franchini, Paolo
108
h2. Alarm Handler
109
110 60 Franchini, Paolo
[[ALH|Instructions for the Alarm Handler]]
111
112 50 Franchini, Paolo
---