Difference between revisions of "Run Planning Meeting Notes, July 07 - July 14, 2022"

From GlueXWiki
Jump to: navigation, search
(Shift reports)
(Reports)
 
(64 intermediate revisions by 2 users not shown)
Line 9: Line 9:
 
[https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs]
 
[https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs]
  
= Wednesday July 7 =
+
 
 +
= Wednesday July 13 =
  
 
=== Past 24 hours ===
 
=== Past 24 hours ===
 +
* Production on lead (~2.7B events)
 +
* trigger changed around 10 pm, first run with the updated trigger 101033
  
 +
=== Shift Reports ===
 +
* [https://logbooks.jlab.org/entry/4014366 Day shift summary]
 +
* [https://logbooks.jlab.org/entry/4014514 Swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4014653 Owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4014735 Early Riser shift summary]
  
* Malte and Mark worked on FCAL modules replacement [https://logbooks.jlab.org/entry/4011757]
+
=== Reports ===
* One of the RF crates had been disconnected, Beni fixed it [https://logbooks.jlab.org/entry/4011767]
+
* Trigger has been modified [https://logbooks.jlab.org/entry/4014639]
* Bobby and others worked in the tagger hall during the day
+
* Scans (7.30 pm [https://logbooks.jlab.org/entry/4014607], 9 pm [https://logbooks.jlab.org/entry/4014628])
 +
* Collimator scan (Hovanes)[https://logbooks.jlab.org/entry/4014610] (result [https://logbooks.jlab.org/entry/4014619], xtrapolation [https://logbooks.jlab.org/entry/4014657]); MWPC was tripping(?)
 +
* Beam asym. monitor. fixed [https://logbooks.jlab.org/entry/4014793]
 +
* Slight improvement in Y-position stability [logentry from Matt Mock https://logbooks.jlab.org/entry/4014665]
 +
* Night beam strip chart [https://logbooks.jlab.org/entry/4014730]
  
* production data taking continued on Pb
+
=== Issues ===
* established operating field of solenoid. First regular production run on Pb ?
+
 
* DAQ issues early afternoon. Sergey worked hard to fix. Started initially with rocFDC11 busy causing DAQ to hang. after necessary reboot of roctrig1 the trig_client process on gluon100 stopped communicating with roctrig1 so no trigger rate data went to EPICS anymore. see [https://logbooks.jlab.org/entry/4011604 logbook]
+
=== Plans ===
 +
* Switch to empty target this afternoon
 +
* RF Recovery Thursday (beam down 8.15 till ~5pm)
 +
 
 +
= Tuesday July 12 =
 +
 
 +
=== Past 24 hours ===
 +
* David Lawrence acting RC for 24hr (hand back to Ilya late this afternoon)
 +
* >2.5B events
 +
* mostly production running with some trigger work
 +
 
 +
=== Shift Reports ===
 +
* [https://logbooks.jlab.org/entry/4013902 Day shift summary]
 +
* [https://logbooks.jlab.org/entry/4014061 Swing Shift Summary 07-11-22], [https://logbooks.jlab.org/entry/4014071 Remote Shift Worker Swing 7/11/22]
 +
* [https://logbooks.jlab.org/entry/4014180 Owl Shift Summary, July 11]
 +
* [https://logbooks.jlab.org/entry/4014251 Shift Summary - Early riser shift 07/12/2022], [https://logbooks.jlab.org/entry/4014250 Remote shift worker Riser]
 +
 
 +
=== Reports ===
 +
* [https://logbooks.jlab.org/entry/4013899 Follow-up Re: Rho polarization as a function of beam energy]
 +
* [https://logbooks.jlab.org/entry/4014028 Asymmetries for JD70-105 0/90 PERP]
 +
* [https://logbooks.jlab.org/entry/4013946 direct correlation between ebeam Y position and currents in FMWPC]
 +
* [https://logbooks.jlab.org/entry/4014137 CPP trigger rate, mask one FCAL ring]
 +
* [https://logbooks.jlab.org/entry/4014167 Extrapolations of today's wire scans]
 +
* [https://logbooks.jlab.org/entry/4014297 Beam RMS at AC July 1 to 11]
 +
* [https://logbooks.jlab.org/entry/4014304 FMWPC hit time distributions look ok]
 +
 
 +
=== Issues ===
 +
* Beam stability in Y - MCC informed and will address
 +
* BCAL/FCAL LED trigger found off
 +
* [https://logbooks.jlab.org/entry/4013856 CPP Chamber gas flow]
 +
** [https://logbooks.jlab.org/entry/4013926 FMWPC currents are back up]
 +
* [https://logbooks.jlab.org/entry/4013859 Pressure on DIRC north barbox corrected]
 +
 
 +
=== Plans ===
 +
* Continue production on lead
 +
* Hold off changing target until after 4pm
 +
* RF Recovery Thursday (beam down)
 +
 
 +
= Friday July 8 - Sunday July 10 =
 +
 
 +
=== Past 72 hours ===
 +
 
 +
* 6B events on lead have been collected
 +
* FMWPC 1 noise level increased yesterday evening [https://logbooks.jlab.org/entry/4013708],
 +
** Beni noticed the chamber HV might be OFF [https://logbooks.jlab.org/entry/4013790]
 +
** Gas supply logentry [https://logbooks.jlab.org/entry/4013766]
 +
** MWPC1/4 noise level time progress [https://userweb.jlab.org/~ilarin/cpp/mwpc_occ_degradation.pdf]
 +
 
 +
* DAQ livetime looks much better after switching to writing data in two files simultaneously
 +
* Friday evening harp scan [https://logbooks.jlab.org/entry/4012897] [https://logbooks.jlab.org/entry/4012901] [https://gryphn.phys.uconn.edu/halld/cobrems/harptool_2d.cgi?harp5C11_xsigma=1.293&harp5C11_xsigma_err=0.03&harp5C11_usigma=0.997&harp5C11_usigma_err=0.03&harp5C11_ysigma=1.015&harp5C11_ysigma_err=0.03&harp5C11B_xsigma=1.076&harp5C11B_xsigma_err=0.05&harp5C11B_usigma=0.8206&harp5C11B_usigma_err=0.05&harp5C11B_ysigma=0.931&harp5C11B_ysigma_err=0.15&radHarp_xsigma=1.039&radHarp_xsigma_err=0.02&radHarp_usigma=1.087&radHarp_usigma_err=0.02&radHarp_ysigma=0.8327&radHarp_ysigma_err=0.02&harp5C11_spos=102.97&harp5C11B_spos=115.11&emittance_x=0.0041&radHarp_spos=119.7&emittance_y=0.00233&collimator_spos=194.92&fit=fit+and+plot extrapolation]
 +
* Sunday morning harp scan [https://logbooks.jlab.org/entry/4013474 5C11] [https://logbooks.jlab.org/entry/4013475 5C11B] [https://logbooks.jlab.org/entry/4013479] [https://gryphn.phys.uconn.edu/halld/cobrems/harptool_2d.cgi?harp5C11_xsigma=1.51&harp5C11_xsigma_err=0.03&harp5C11_usigma=1.04&harp5C11_usigma_err=0.03&harp5C11_ysigma=1.181&harp5C11_ysigma_err=0.03&harp5C11B_xsigma=1.165&harp5C11B_xsigma_err=0.05&harp5C11B_usigma=0.8986&harp5C11B_usigma_err=0.05&harp5C11B_ysigma=1.028&harp5C11B_ysigma_err=0.15&radHarp_xsigma=1.141&radHarp_xsigma_err=0.02&radHarp_usigma=1.171&radHarp_usigma_err=0.02&radHarp_ysigma=0.8437&radHarp_ysigma_err=0.02&harp5C11_spos=102.97&harp5C11B_spos=115.11&emittance_x=0.0041&radHarp_spos=119.7&emittance_y=0.00233&collimator_spos=194.92&fit=fit+and+plot extrapolation]
 +
* Hall-D strip charts
 +
** Friday [https://logbooks.jlab.org/entry/4013160 Beni]
 +
** Saturday [https://logbooks.jlab.org/entry/4013403 Simon]
 +
** Sunday [https://logbooks.jlab.org/entry/4013591 Arshak]
 +
 
 +
=== Shift reports ===
 +
* [https://logbooks.jlab.org/entry/4012676 Friday day shift summary]
 +
* [https://logbooks.jlab.org/entry/4012861 Friday swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4012952 Friday owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4013044 Saturday early riser shift summary]
 +
* [https://logbooks.jlab.org/entry/4013166 Saturday day shift summary]
 +
* [https://logbooks.jlab.org/entry/4013264 Saturday swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4013337 Saturday owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4013408 Sunday early riser shift summary]
 +
* [https://logbooks.jlab.org/entry/4013486 Sunday day shift summary]
 +
* [https://logbooks.jlab.org/entry/4013580 Sunday swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4013649 Sunday owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4013717 Monday early riser shift summary]
 +
 
 +
=== Reports ===
 +
* New high voltages were loaded for FCAL [https://logbooks.jlab.org/entry/4012655]
 +
* Hovanes has updated AMO radiator position [https://logbooks.jlab.org/entry/4012808]
 +
 
 +
=== Issues ===
 +
* Tagger NMR communication will be worked out this week (Tim) [https://logbooks.jlab.org/entry/4012702]
 +
* Beam instability in y [https://logbooks.jlab.org/entry/4013571 Beni]
 +
 
 +
=== Plans ===
 +
* Continue production on lead
 +
* unmask FCAL modules in the trigger
 +
 
 +
 
 +
= Thursday July 7 =
 +
 
 +
=== Past 24 hours ===
 +
 
 +
* harp scans were done during short beam on period during day-time, some distributions show 1/100 peak/shoulders ratio others 1/10,000 [https://logbooks.jlab.org/entry/4012157] [https://logbooks.jlab.org/entry/4012169]
 +
* Dominion Power's work required a voltage reduction so we had tagger, PS and sweep magnets off for a couple of hours
 +
* collected cosmics and LED runs during daytime, and production on lead (about 8 hrs) during night time
 +
* Beni: beam was quite stable overnight [https://logbooks.jlab.org/entry/4012625]
 +
 
 +
=== Shift reports ===
 +
* [https://logbooks.jlab.org/entry/4012170 day shift summary]
 +
* [https://logbooks.jlab.org/entry/4012365 swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4012468 owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4012564 early riser shift summary]
 +
 
 +
=== Reports ===
 +
* Sasha checked FCAL trigger rate without masking inner layers. Preliminary result for the rate was  14kHz [https://logbooks.jlab.org/entry/4012436]
 +
* Hovanes pointed out, that we don't observe 60Hz oscillations now [https://logbooks.jlab.org/entry/4012466]
 +
 
 +
=== Issues ===
 +
* Problems with running at 30nA on AMO, radiator thickness was reduced to 3*10^-4 this night,
 +
as 4.5*10^-4 was causing IOC trips [https://logbooks.jlab.org/entry/4012504] [https://logbooks.jlab.org/entry/4012514]
 +
* Alexandre just noticed that  Tagger magnet NMR communication is down again [https://logbooks.jlab.org/entry/4012611]
 +
* DIRC major alarm has been acknowledged [https://logbooks.jlab.org/entry/4012485], Mark may need to investigate this issue more
 +
* Dave has noticed we have a higher radiation level values now, about factor of 1.5 [https://logbooks.jlab.org/entry/4012423], [https://logbooks.jlab.org/entry/4012426]
 +
* Hydra alarm on fa125_itrig [https://logbooks.jlab.org/entry/4012288]
 +
* daq livetime is uneven from time to time [https://logbooks.jlab.org/entry/4012631]
 +
 
 +
=== Plans ===
 +
* Continue production on lead
 +
* find out the way to unmask FCAL modules
 +
 
 +
= Wednesday, July 6 =
 +
 
 +
=== Past 24 hours ===
 +
 
 +
 
 +
* Malte and Mark worked on FCAL bases replacement [https://logbooks.jlab.org/entry/4011757]
 +
* One of the RF crates had been disconnected, Beni fixed it [https://logbooks.jlab.org/entry/4011767]
 +
* Bobby and others worked in the tagger hall during the day. At 3:30 pm Bobby noticed that the IOC for the NMR was not responding properly. MCC rebooted the IOC crate. Afterward, it was still locked on zero and there was still a Comm Status error [https://logbooks.jlab.org/entry/4011870]
 +
* Beni found that the solenoid controls hung, and restarted the ramping, which was helpful.
 +
* Had minor issues with DAQ at 7.00 pm: ROCFDC11 error: timeout error on FA125, every 3 seconds. (fADC125 in fdc11 slot 3 was replaced during daytime [https://logbooks.jlab.org/entry/4011797]) Sergei worked out the DAQ issue at 7.50 pm
 +
* Established operating field of the solenoid at 8:30 pm.
 +
* harp scans are ongoing now
  
 
=== Shift reports ===
 
=== Shift reports ===
 
* [https://logbooks.jlab.org/entry/4011688 day shift summary]
 
* [https://logbooks.jlab.org/entry/4011688 day shift summary]
 
* [https://logbooks.jlab.org/entry/4011901 swing shift summary]
 
* [https://logbooks.jlab.org/entry/4011901 swing shift summary]
* [ owl shift summary]
+
* [https://logbooks.jlab.org/entry/4011988 owl shift summary]
* [ early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4012045 early riser shift summary]
  
 
=== Reports ===
 
=== Reports ===
*
+
 
 +
* Sergey and Lubomir worked in the Hall this night from 10 pm to 11:30 pm [https://logbooks.jlab.org/entry/4011999]
 +
* Hovanes reported his study of the coherent peak position drifts observed on the 4th of July [https://logbooks.jlab.org/entry/4011805]
 +
* Still have 60Hz structure [https://logbooks.jlab.org/entry/4012003]. The situation is improved according to MCC experts.
 +
* CDC HV and TAGM alarms are more frequent now
 +
* CDC gas flow increased [https://logbooks.jlab.org/entry/4012075]
  
 
=== Issues ===
 
=== Issues ===
* Sean found that the TOF RF signal is mssing since run 100477: see [https://logbooks.jlab.org/entry/4011333 logbook] Our check procedures are clearly not vigilant enough anymore. RF signals are NOT in online monitoring anymore and Hydra is not doing its job as intended.
+
* Hovanes pointed out that something strange happened during solenoid ramping up [https://logbooks.jlab.org/entry/4011909] [https://logbooks.jlab.org/entry/4012078]
* switching back from AMO to Diamond the cross hair on the camera does not match the position with the Diamond. However beam seems to be in the right spot as there is a coeherent peak in the tagger microscope with the expected rates as well as the DAQ rates make sese. see [https://logbooks.jlab.org/entry/4011571 lobook]
+
  
 
=== Plans ===
 
=== Plans ===
* maintenance day: beam will go away 7:30am, 8 hours maintenance, followed by beam restoration and high current beam tuning for HallC
+
* Continue production on lead
** please access hall after 9am: other halls have priority
+
* Unmasking FCAL central modules from the trigger needs to be done unless it increases rate too high
** ramp solenoid to 800A for cyro comprssor swtch
+
** FCAL base replacement
+
** Tagger NMR inspection
+
** Fix TOF RF signal
+

Latest revision as of 08:33, 13 July 2022

Back to Run Coordination Meetings:Summer2022

Meeting are via ZoomGov: connect (Meeting ID: 160 199 0060 / Passcode 8394)

MCC whiteboard

Hall D counting room white board

Spreadsheet with list of runs


Wednesday July 13

Past 24 hours

  • Production on lead (~2.7B events)
  • trigger changed around 10 pm, first run with the updated trigger 101033

Shift Reports

Reports

Issues

Plans

  • Switch to empty target this afternoon
  • RF Recovery Thursday (beam down 8.15 till ~5pm)

Tuesday July 12

Past 24 hours

  • David Lawrence acting RC for 24hr (hand back to Ilya late this afternoon)
  • >2.5B events
  • mostly production running with some trigger work

Shift Reports

Reports

Issues

Plans

  • Continue production on lead
  • Hold off changing target until after 4pm
  • RF Recovery Thursday (beam down)

Friday July 8 - Sunday July 10

Past 72 hours

  • 6B events on lead have been collected
  • FMWPC 1 noise level increased yesterday evening [9],
    • Beni noticed the chamber HV might be OFF [10]
    • Gas supply logentry [11]
    • MWPC1/4 noise level time progress [12]

Shift reports

Reports

  • New high voltages were loaded for FCAL [16]
  • Hovanes has updated AMO radiator position [17]

Issues

  • Tagger NMR communication will be worked out this week (Tim) [18]
  • Beam instability in y Beni

Plans

  • Continue production on lead
  • unmask FCAL modules in the trigger


Thursday July 7

Past 24 hours

  • harp scans were done during short beam on period during day-time, some distributions show 1/100 peak/shoulders ratio others 1/10,000 [19] [20]
  • Dominion Power's work required a voltage reduction so we had tagger, PS and sweep magnets off for a couple of hours
  • collected cosmics and LED runs during daytime, and production on lead (about 8 hrs) during night time
  • Beni: beam was quite stable overnight [21]

Shift reports

Reports

  • Sasha checked FCAL trigger rate without masking inner layers. Preliminary result for the rate was 14kHz [22]
  • Hovanes pointed out, that we don't observe 60Hz oscillations now [23]

Issues

  • Problems with running at 30nA on AMO, radiator thickness was reduced to 3*10^-4 this night,

as 4.5*10^-4 was causing IOC trips [24] [25]

  • Alexandre just noticed that Tagger magnet NMR communication is down again [26]
  • DIRC major alarm has been acknowledged [27], Mark may need to investigate this issue more
  • Dave has noticed we have a higher radiation level values now, about factor of 1.5 [28], [29]
  • Hydra alarm on fa125_itrig [30]
  • daq livetime is uneven from time to time [31]

Plans

  • Continue production on lead
  • find out the way to unmask FCAL modules

Wednesday, July 6

Past 24 hours

  • Malte and Mark worked on FCAL bases replacement [32]
  • One of the RF crates had been disconnected, Beni fixed it [33]
  • Bobby and others worked in the tagger hall during the day. At 3:30 pm Bobby noticed that the IOC for the NMR was not responding properly. MCC rebooted the IOC crate. Afterward, it was still locked on zero and there was still a Comm Status error [34]
  • Beni found that the solenoid controls hung, and restarted the ramping, which was helpful.
  • Had minor issues with DAQ at 7.00 pm: ROCFDC11 error: timeout error on FA125, every 3 seconds. (fADC125 in fdc11 slot 3 was replaced during daytime [35]) Sergei worked out the DAQ issue at 7.50 pm
  • Established operating field of the solenoid at 8:30 pm.
  • harp scans are ongoing now

Shift reports

Reports

  • Sergey and Lubomir worked in the Hall this night from 10 pm to 11:30 pm [36]
  • Hovanes reported his study of the coherent peak position drifts observed on the 4th of July [37]
  • Still have 60Hz structure [38]. The situation is improved according to MCC experts.
  • CDC HV and TAGM alarms are more frequent now
  • CDC gas flow increased [39]

Issues

  • Hovanes pointed out that something strange happened during solenoid ramping up [40] [41]

Plans

  • Continue production on lead
  • Unmasking FCAL central modules from the trigger needs to be done unless it increases rate too high