Project

General

Profile

MICE Shifter Guides » History » Version 70

Franchini, Paolo, 13 October 2017 17:34

1 1 Boyd, Steven
h1. MICE Shifter Guides
2
3 57 Nebrensky, Henry
{{>toc}}
4
5 64 Franchini, Paolo
* [[Shifterreminders | Shifter reminders ]]
6 1 Boyd, Steven
* [[First shift]] guide
7
* [[UnofficialShifterGuide|The Unofficial Guide to being a Shifter]]
8
* [[ShifterRostering|Shifter scheduling]]
9
* [[Shifter Training]]
10 40 Boyd, Steven
* [[Shifter Rules and Checklists]]
11 6 Boyd, Steven
* "Where to find the CDB Viewer":http://cdb.mice.rl.ac.uk/cdbviewer/
12 21 Boyd, Steven
* [[Suggestions to streamline/enhance shiftes|Shift Streamlining Suggestions]]
13 65 Boyd, Steven
* "Current Expert List (14/6/2016)":http://micewww.pp.rl.ac.uk/documents/178  
14 66 Boyd, Steven
* "MICE Reconstructed data store":http://reco.mice.rl.ac.uk/
15 69 Franchini, Paolo
* "Hydrogen Shifter Instructions":http://micewww.pp.rl.ac.uk/attachments/download/9156/2017_MICE_Shifter_Instructions.docx (and checklist)
16 11 Boyd, Steven
17 58 Franchini, Paolo
h2. Solenoid and FC Shifter guides
18 47 Boyd, Steven
19 48 Boyd, Steven
These documents are provided by the magnet group. The instructions are at somewhat of a higher level 
20
than required by shifters. The basic instruction for shifters is:
21
22
If you see something out of the ordinary with the superconducting magnets (Alarm, Anything red on the display)
23
call the magnet expert.
24
25 47 Boyd, Steven
"Solenoid Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/181
26
"Focus coil Shifter Instructions : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/183
27
28 12 Boyd, Steven
h2. Shifter Instructions or What to Do on Shift
29
30
"What to do on-shift : MICE Shifter Training":http://micewww.pp.rl.ac.uk/documents/144
31
32 22 Boyd, Steven
As part of your shift you should keep a record of people present, the main parameters of the
33
run and incidents that occurred during the run. A good example is shown in the 
34
35 23 Boyd, Steven
Guide to using the eLog for shift : attachment:Shifter_Elog_Guide.pdf
36
37
Note that in the example given in this guide, the shifters were explicitly asked to check the temperature differentials
38
in the conventional magnets every half hour. 
39 22 Boyd, Steven
40 12 Boyd, Steven
h2. How to launch and work with the Run Control
41
42
"Using the Run Control GUI [2015]":http://micewww.pp.rl.ac.uk/documents/135
43
44
h2. Shifter checklist : How to start a run
45
46 1 Boyd, Steven
[[Shifter checklist to start a MICE run]]
47 58 Franchini, Paolo
48
h2. Online monitoring and online reconstruction
49
50
* [[OnlineReconstruction|Online Reconstruction Instructions]]
51
* document#22
52 1 Boyd, Steven
53
h2. Where to find the CDB Viewer
54
55
The CDB Viewer can be found at http://cdb.mice.rl.ac.uk (http://heplnv152.pp.rl.ac.uk:4443/cdbviewer)
56 56 Nebrensky, Henry
57 70 Franchini, Paolo
h2. Trackers calibration and other issues
58 63 Franchini, Paolo
59
https://micewww.pp.rl.ac.uk/projects/operations/wiki/Trackers
60
61 56 Nebrensky, Henry
h1. What to do when something happens on shift
62
63
Shifter information for various problems that may be encountered on shift
64 12 Boyd, Steven
65 51 Nebrensky, Henry
h2. Target and Beamline: What to do when...
66 12 Boyd, Steven
67 51 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the RATS daemon crashes]]
68 59 Franchini, Paolo
[[BeamlineProcsTargetFail|... a BPS error is encountered]]
69 32 Nebrensky, Henry
[[BeamlineProcsEarthLeakTrip|... a conventional magnet trips off]]
70 34 Nebrensky, Henry
[[BeamlineProcsTargetFail|... the target throws an error]]
71 36 Nebrensky, Henry
... beamline polarity sensors misbehave: [[BeamlineProcsTestPOMPOMs|check voltages]] (until the proper user guide is finished)
72 37 Nebrensky, Henry
[[BeamlineProcsDSThermalTrip|... Decay Solenoid PSU trips off]]
73 13 Boyd, Steven
74 46 Boyd, Steven
h2. What to do when you are requested by the BLOC to reset one of the conventional magnets
75
76
* Press the Controls Menu desktop GUI
77
* under BeamLine Elements, select BeamLine Summary
78
* press the third option, control option on the right hand side of the Beamline summary GUI
79
* the Danfysik MPS 8000 - MICE Beamline Magnets window opens
80
* press the Reset option in the second box, control box of this window.
81
82 52 Nebrensky, Henry
h2. Computing
83 1 Boyd, Steven
84 55 Franchini, Paolo
h3. What if the Heartbeat alarm goes off?
85 1 Boyd, Steven
86 55 Franchini, Paolo
* Click on the "P" near the broken (red) machine in the GUI: it will show you the Nagios services that have failed
87
* Double-check with "Nagios":http://nagios.micenet.rl.ac.uk/nagios/ (u/p = mice/t8******), or
88
* Double-check with "Nagios":http://micewww.pp.rl.ac.uk/nagios/  (u/p = mice/c****)
89 52 Nebrensky, Henry
90
h3. What if one of the MICE thin clients crashes?
91
92 62 Franchini, Paolo
Very rarely one the thin clients can crash like this http://elog.mice.rl.ac.uk/Shift+summary/150623_043853/MICETHIN02_error_230615.JPG
93 1 Boyd, Steven
94 18 Boyd, Steven
The current response to this is :
95
96
If the applications that had been running on the machine can just be opened elsewhere, then they should be, and an email
97
should be sent to the online expert (Paolo). If the process hasn't been released by the machine, and can't be run
98
in multiple instances (i.e. RunControl) then the SOC should be called, who will in turn probably call the online
99 1 Boyd, Steven
expert.
100 25 Boyd, Steven
101 52 Nebrensky, Henry
h3. What if an error from the DataMover is reported from Run Control
102 25 Boyd, Steven
103
If an error is reported via Run Control then the shifters don't NEED to do anything - they can
104
carry on with the next run; all that will happen is that the data distribution will be delayed. 
105
106
Make an eLog entry, then wait until a suitable time when DAQ is stopped (e.g a shift change) and run the manual
107
script. If it still doesn't work, eLog the error and escalate to (for now) Henry.
108 27 Boyd, Steven
109 1 Boyd, Steven
Instructions to run the datamover manually can be found in the Red Binder and in the latest version of "the datamover instructions":http://micewww.pp.rl.ac.uk/documents/10
110 49 Franchini, Paolo
111
h2. Alarm Handler
112
113 60 Franchini, Paolo
[[ALH|Instructions for the Alarm Handler]]
114
115 50 Franchini, Paolo
---