Project

General

Profile

MICE Shifter Guides » History » Version 64

Franchini, Paolo, 10 July 2017 13:04

1 1 Boyd, Steven
h1. MICE Shifter Guides
2
3 57 Nebrensky, Henry
{{>toc}}
4
5 64 Franchini, Paolo
* [[Shifterreminders | Shifter reminders ]]
6 1 Boyd, Steven
* [[First shift]] guide
7
* [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]]
8
* [[ShifterRostering|Shifter scheduling]]
9
* [[Shifter Training]]
10 40 Boyd, Steven
* [[Shifter Rules and Checklists]]
11 6 Boyd, Steven
* "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/
12 21 Boyd, Steven
* [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]]
13 45 Boyd, Steven
* "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178
14 11 Boyd, Steven
15 58 Franchini, Paolo
h2. Solenoid and FC Shifter guides
16 47 Boyd, Steven
17 48 Boyd, Steven
These documents are provided by the magnet group. The instructions are at somewhat of a higher level 
18
than required by shifters. The basic instruction for shifters is:
19
20
If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display)
21
call the magnet expert.
22
23 47 Boyd, Steven
"Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181
24
"Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183
25
26 12 Boyd, Steven
h2. Shifter Instructions or What to Do on Shift
27
28
"What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144
29
30 22 Boyd, Steven
As part of your shift you should keep a record of people present, the main parameters of the
31
run and incidents that occurred during the run. A good example is shown in the 
32
33 23 Boyd, Steven
Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf
34
35
Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials
36
in the conventional magnets every half hour. 
37 22 Boyd, Steven
38 12 Boyd, Steven
h2. How to launch and work with the Run Control
39
40
"Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135
41
42
h2. Shifter checklist : How to start a run
43
44 1 Boyd, Steven
[[Shifter checklist to start a MICE run]]
45 58 Franchini, Paolo
46
h2. Online monitoring and online reconstruction
47
48
* [[OnlineReconstruction|Online Reconstruction Instructions]]
49
* document#22
50 1 Boyd, Steven
51
h2. Where to find the CDB Viewer
52
53
The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer)
54 56 Nebrensky, Henry
55 63 Franchini, Paolo
h2. Trackers calibration
56
57
https://micewww.pp.rl.ac.uk/projects/operations/wiki/Trackers
58
59 56 Nebrensky, Henry
h1. What to do when something happens on shift
60
61
Shifter information for various problems that may be encountered on shift
62 12 Boyd, Steven
63 51 Nebrensky, Henry
h2. Target and Beamline: What to do when...
64 12 Boyd, Steven
65 51 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the RATS daemon crashes]]
66 59 Franchini, Paolo
[[BeamlineProcsTargetFail|... a BPS error is encountered]]
67 32 Nebrensky, Henry
[[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]]
68 34 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the target throws an error]]
69 36 Nebrensky, Henry
... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished)
70 37 Nebrensky, Henry
[[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]]
71 13 Boyd, Steven
72 46 Boyd, Steven
h2. What to do when you are requested by the BLOC to reset one of the conventional magnets
73
74
* Press the Controls Menu desktop GUI
75
* under BeamLine Elements, select BeamLine Summary
76
* press the third option, control option on the right hand side of the Beamline summary GUI
77
* the Danfysik MPS 8000 - MICE Beamline Magnets window opens
78
* press the Reset option in the second box, control box of this window.
79
80 52 Nebrensky, Henry
h2. Computing
81 1 Boyd, Steven
82 55 Franchini, Paolo
h3. What if the Heartbeat alarm goes off?
83 1 Boyd, Steven
84 55 Franchini, Paolo
* Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed
85
* Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or
86
* Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/  (u/p = mice/c****)
87 52 Nebrensky, Henry
88
h3. What if one of the MICE thin clients crashes?
89
90 62 Franchini, Paolo
Very rarely one the thin clients can crash like this http://elog.mice.rl.ac.uk/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG
91 1 Boyd, Steven
92 18 Boyd, Steven
The current response to this is :
93
94
If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email
95
should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run
96
in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online
97 1 Boyd, Steven
expert.
98 25 Boyd, Steven
99 52 Nebrensky, Henry
h3. What if an error from the DataMover is reported from Run Control
100 25 Boyd, Steven
101
If an error is reported via Run Control then the shifters don't NEED to do anything - they can
102
carry on with the next run; all that will happen is that the data distribution will be delayed. 
103
104
Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual
105
script. If it still doesn't work, eLog the error and escalate to (for now) Henry.
106 27 Boyd, Steven
107 1 Boyd, Steven
Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10
108 49 Franchini, Paolo
109
h2. Alarm Handler
110
111 60 Franchini, Paolo
[[ALH|Instructions for the Alarm Handler]]
112
113 50 Franchini, Paolo
---