Project

General

Profile

MICE Shifter Guides » History » Version 66

Boyd, Steven, 19 September 2017 08:20

1 1 Boyd, Steven
h1. MICE Shifter Guides
2
3 57 Nebrensky, Henry
{{>toc}}
4
5 64 Franchini, Paolo
* [[Shifterreminders | Shifter reminders ]]
6 1 Boyd, Steven
* [[First shift]] guide
7
* [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]]
8
* [[ShifterRostering|Shifter scheduling]]
9
* [[Shifter Training]]
10 40 Boyd, Steven
* [[Shifter Rules and Checklists]]
11 6 Boyd, Steven
* "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/
12 21 Boyd, Steven
* [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]]
13 65 Boyd, Steven
* "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178  
14 66 Boyd, Steven
* "MICE Reconstructed data store":http://reco.mice.rl.ac.uk/
15 11 Boyd, Steven
16 58 Franchini, Paolo
h2. Solenoid and FC Shifter guides
17 47 Boyd, Steven
18 48 Boyd, Steven
These documents are provided by the magnet group. The instructions are at somewhat of a higher level 
19
than required by shifters. The basic instruction for shifters is:
20
21
If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display)
22
call the magnet expert.
23
24 47 Boyd, Steven
"Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181
25
"Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183
26
27 12 Boyd, Steven
h2. Shifter Instructions or What to Do on Shift
28
29
"What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144
30
31 22 Boyd, Steven
As part of your shift you should keep a record of people present, the main parameters of the
32
run and incidents that occurred during the run. A good example is shown in the 
33
34 23 Boyd, Steven
Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf
35
36
Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials
37
in the conventional magnets every half hour. 
38 22 Boyd, Steven
39 12 Boyd, Steven
h2. How to launch and work with the Run Control
40
41
"Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135
42
43
h2. Shifter checklist : How to start a run
44
45 1 Boyd, Steven
[[Shifter checklist to start a MICE run]]
46 58 Franchini, Paolo
47
h2. Online monitoring and online reconstruction
48
49
* [[OnlineReconstruction|Online Reconstruction Instructions]]
50
* document#22
51 1 Boyd, Steven
52
h2. Where to find the CDB Viewer
53
54
The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer)
55 56 Nebrensky, Henry
56 63 Franchini, Paolo
h2. Trackers calibration
57
58
https://micewww.pp.rl.ac.uk/projects/operations/wiki/Trackers
59
60 56 Nebrensky, Henry
h1. What to do when something happens on shift
61
62
Shifter information for various problems that may be encountered on shift
63 12 Boyd, Steven
64 51 Nebrensky, Henry
h2. Target and Beamline: What to do when...
65 12 Boyd, Steven
66 51 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the RATS daemon crashes]]
67 59 Franchini, Paolo
[[BeamlineProcsTargetFail|... a BPS error is encountered]]
68 32 Nebrensky, Henry
[[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]]
69 34 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the target throws an error]]
70 36 Nebrensky, Henry
... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished)
71 37 Nebrensky, Henry
[[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]]
72 13 Boyd, Steven
73 46 Boyd, Steven
h2. What to do when you are requested by the BLOC to reset one of the conventional magnets
74
75
* Press the Controls Menu desktop GUI
76
* under BeamLine Elements, select BeamLine Summary
77
* press the third option, control option on the right hand side of the Beamline summary GUI
78
* the Danfysik MPS 8000 - MICE Beamline Magnets window opens
79
* press the Reset option in the second box, control box of this window.
80
81 52 Nebrensky, Henry
h2. Computing
82 1 Boyd, Steven
83 55 Franchini, Paolo
h3. What if the Heartbeat alarm goes off?
84 1 Boyd, Steven
85 55 Franchini, Paolo
* Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed
86
* Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or
87
* Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/  (u/p = mice/c****)
88 52 Nebrensky, Henry
89
h3. What if one of the MICE thin clients crashes?
90
91 62 Franchini, Paolo
Very rarely one the thin clients can crash like this http://elog.mice.rl.ac.uk/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG
92 1 Boyd, Steven
93 18 Boyd, Steven
The current response to this is :
94
95
If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email
96
should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run
97
in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online
98 1 Boyd, Steven
expert.
99 25 Boyd, Steven
100 52 Nebrensky, Henry
h3. What if an error from the DataMover is reported from Run Control
101 25 Boyd, Steven
102
If an error is reported via Run Control then the shifters don't NEED to do anything - they can
103
carry on with the next run; all that will happen is that the data distribution will be delayed. 
104
105
Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual
106
script. If it still doesn't work, eLog the error and escalate to (for now) Henry.
107 27 Boyd, Steven
108 1 Boyd, Steven
Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10
109 49 Franchini, Paolo
110
h2. Alarm Handler
111
112 60 Franchini, Paolo
[[ALH|Instructions for the Alarm Handler]]
113
114 50 Franchini, Paolo
---