Difference between revisions of "SRC/CT Good Run Selection"

From GlueXWiki
Jump to: navigation, search
(Approved runs)
 
(38 intermediate revisions by the same user not shown)
Line 1: Line 1:
=RCDB=
+
==RCDB==
*The run condition parameters are stored in the Run Conditions DataBase (RCDB).
+
*The run condition parameters are stored in the Run Conditions DataBase (RCDB). It is part of the Hall D software package.
 
*Connection to the database
 
*Connection to the database
 
**Main MySQL database: mysql://rcdb@hallddb/rcdb
 
**Main MySQL database: mysql://rcdb@hallddb/rcdb
 
**Local SQLite database: sqlite:///path.to.file.db
 
**Local SQLite database: sqlite:///path.to.file.db
 
*Different interfaces we can use.
 
*Different interfaces we can use.
**Job submission
 
 
**Python interface
 
**Python interface
  
Line 14: Line 13:
 
good_runs = db.select_runs(RCDB_QUERY, MINRUN, MAXRUN)
 
good_runs = db.select_runs(RCDB_QUERY, MINRUN, MAXRUN)
  
 +
#Get the list of selected runs
 
for run in good_runs:
 
for run in good_runs:
 
     print(run.number)
 
     print(run.number)
 +
 +
#Check whether one specific run is in the selected list
 +
run = db.get_run(NUMBER)
 +
if run not in good_runs:
 +
    continue
 
</syntaxhighlight>
 
</syntaxhighlight>
  
**C++ interface
 
 
**Command line interface
 
**Command line interface
 +
 +
<syntaxhighlight lang="bash">
 +
# Connected to the main RCDB by default
 +
rcnd  # list all the conditions
 +
rcnd NUMBER  # list all the condition values of one specific run
 +
rcnd NUMBER CONDITION # return the value of some condition of one specific run
 +
</syntaxhighlight>
 +
 
**Web interface
 
**Web interface
 +
***[https://halldweb.jlab.org/rcdb/ Link to the website]
 +
***The runs can be selected with RCDB_QUERY, MINRUN and MAXRUN. But the @is_src_production alias can not be used for now. The full query needs to be filled in (See the monitoring runs section below).
 +
***The "Conditions" tab lists all the conditions available in RCDB.
 +
**Job submission
 +
***Run [https://github.com/JeffersonLab/hd_utilities/blob/master/launch_scripts/launch/launch.py python launch script] with the command 'python launch.py MINRUN MAXRUN'
 +
***Specify the RCDB_QUERY in the configuration file (.config)
 
*More detailed documentation can be found here: [https://halldweb.jlab.org/wiki/index.php/RCDB_conditions_python#Command_line_tools wiki], [https://github.com/JeffersonLab/rcdb/wiki GitHub]
 
*More detailed documentation can be found here: [https://halldweb.jlab.org/wiki/index.php/RCDB_conditions_python#Command_line_tools wiki], [https://github.com/JeffersonLab/rcdb/wiki GitHub]
*Contact Sean Dobbs if we want to edit the information in RCDB.
+
*Contact Sean Dobbs if the information needs to be edited in RCDB.
  
=All runs=
+
==All runs==
 
*90001 to 90662 in Run Period 2021-11
 
*90001 to 90662 in Run Period 2021-11
*Liquid deuterium: 90207 to 90253, 90548 to 90602
+
*[https://docs.google.com/spreadsheets/d/19QWkjAPEiSd2scvAllYvgvB_puxKjFiSlh3z6EBfFck/edit?usp=sharing Run sheet filled by shift takers]
*Liquid He-4: 90001 to 90206, 90603 to 90662
+
*Multi-foil C-12: 90254 to 90547
+
  
=Monitoring runs=
+
==Monitoring runs==
*Runs that are used in the monitoring launches. These runs are calibrated. Relatively loose selection is used so that some test runs and junk runs are also included.
+
*Runs included in the monitoring and reconstruction launches. These runs are calibrated. Relatively loose selection is used so that some test runs and junk runs are also included.
 
*RCDB query: "@is_src_production" (alias of "daq_run=='PHYSICS_SRC' and beam_current > 2. and event_count > 5000000 and solenoid_current > 100 and collimator_diameter != 'Blocking'")
 
*RCDB query: "@is_src_production" (alias of "daq_run=='PHYSICS_SRC' and beam_current > 2. and event_count > 5000000 and solenoid_current > 100 and collimator_diameter != 'Blocking'")
 
*[[SRC/CT monitoring runs | List of monitoring runs]]
 
*[[SRC/CT monitoring runs | List of monitoring runs]]
*[https://docs.google.com/spreadsheets/d/1M3v9vpBmoHbHk0gjJHNsgAjq5bQL2UxcaRrUPeM4EaQ/edit#gid=1665922131 Calibration quality spreadsheet: monitoring ver 05]
 
*[https://docs.google.com/spreadsheets/d/1xLmNGh-CiAD_ETUqL8kRnG2ZTuaKGLvymY2JdJ47w0Y/edit#gid=1665922131 Calibration quality spreadsheet: monitoring ver 06]
 
  
=Approved runs=
+
==Approved runs==
*Runs that are used in the reconstruction and analysis launches. Approved to be used in analysis after checking the calibration and data quality
+
*Runs included in the analysis launches. Approved to be used in analysis after checking the calibration and data quality
 
*RCDB query: "@is_src_production and @status_approved"
 
*RCDB query: "@is_src_production and @status_approved"
 
*[[SRC/CT approved runs | List of approved runs]]
 
*[[SRC/CT approved runs | List of approved runs]]
 
*[[SRC/CT excluded runs | List of excluded runs]]
 
*[[SRC/CT excluded runs | List of excluded runs]]
  
=More selections=
+
==Selection queries==
 +
*Target used
 +
**Liquid deuterium: "target_type=='FULL & Ready Deuterium'"
 +
**Liquid He-4: "target_type=='FULL & Ready Helium'"
 +
**Multi-foil C-12: "target_type=='FULL & Ready Carbon'"
 +
**Empty target: "(target_type=='EMPTY & Ready' or target_type=='OFF')"
 +
 
 
*Run conditions
 
*Run conditions
**Raw mode: daq_config=='FCAL_BCAL_PS_SRC_m10.conf'
+
**Raw mode: "run_config=='FCAL_BCAL_PS_SRC_m10.conf'"
**Compton trigger: daq_config=='CCAL_FCAL_PS_m9.conf'
+
**Compton trigger: "run_config=='CCAL_FCAL_PS_m9.conf'"
**Low intensity: daq_config == 'FCAL_BCAL_PS_SRC_m9.conf' and beam_on_current < 55.0 (90246 needs to be edited)
+
**Low intensity: "run_config == 'FCAL_BCAL_PS_SRC_m9.conf' and beam_on_current < 55.0"
**Empty target: target_type == 'EMPTY & Ready' (all carbon runs and 90602 need to be edited)
+
**Normal production: "run_config == 'FCAL_BCAL_PS_SRC_m9.conf' and beam_on_current > 55.0"
**Production:
+
 
 
*Photon polarization
 
*Photon polarization
**0/90 PARA
+
**Amorphous: "polarization_angle == -1.0"
**0/90 PERP
+
**Diamond: "polarization_angle >= 0.0"
**45/135 PARA
+
***0/90 PARA: "polarization_angle == 0.0"
**45/135 PERP
+
***0/90 PERP: "polarization_angle == 90.0"
 
+
***45/135 PARA: "polarization_angle == 135.0"
= Full REST Production =
+
***45/135 PERP: "polarization_angle == 45.0"
 
+
* Software stack: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
+
* Calibration time stamp: <pre> variation=default calibtime=TBD </pre>
+
* Configuration: <pre> /group/halld/data_monitoring/run_conditions/RunPeriod-[RUNPERIOD]/ </pre>
+
* Output: <pre> /cache/halld/RunPeriod-[RUNPERIOD]/recon/ver[VERSION]/ </pre>
+
* Launches:
+
{| class="wikitable"
+
|-
+
! Runperiod
+
! Version
+
! Batch
+
! Min Run
+
! Max Run
+
! # Runs
+
! # REST Files (succeeded)
+
! Total Size of REST Files
+
! Site
+
! Priority
+
! Details
+
|-
+
| 2021-11
+
| 01
+
| 01
+
| 90001
+
| 90206
+
| 133
+
| ()
+
| TB
+
|
+
| 3
+
| He4
+
|-
+
| 2021-11
+
| 01
+
| 02
+
| 90207
+
| 90253
+
| 38
+
| ()
+
| TB
+
|
+
| 2
+
| D
+
|-
+
| 2021-11
+
| 01
+
| 03
+
| 90254
+
| 90547
+
| 232
+
| ()
+
| TB
+
|
+
| 1
+
| C
+
|-
+
| 2021-11
+
| 01
+
| 04
+
| 90548
+
| 90602
+
| 43
+
| ()
+
| TB
+
|
+
| 2
+
| D
+
|-
+
| 2021-11
+
| 01
+
| 05
+
| 90603
+
| 90662
+
| 34
+
| ()
+
| TB
+
|
+
| 3
+
| He4
+
|-
+
|}
+

Latest revision as of 15:21, 19 November 2022

RCDB

  • The run condition parameters are stored in the Run Conditions DataBase (RCDB). It is part of the Hall D software package.
  • Connection to the database
    • Main MySQL database: mysql://rcdb@hallddb/rcdb
    • Local SQLite database: sqlite:///path.to.file.db
  • Different interfaces we can use.
    • Python interface
import rcdb
 
db = rcdb.RCDBProvider("mysql://rcdb@hallddb/rcdb")
good_runs = db.select_runs(RCDB_QUERY, MINRUN, MAXRUN)
 
#Get the list of selected runs
for run in good_runs:
    print(run.number)
 
#Check whether one specific run is in the selected list
run = db.get_run(NUMBER)
if run not in good_runs:
    continue
    • Command line interface
# Connected to the main RCDB by default
rcnd  # list all the conditions
rcnd NUMBER  # list all the condition values of one specific run
rcnd NUMBER CONDITION # return the value of some condition of one specific run
    • Web interface
      • Link to the website
      • The runs can be selected with RCDB_QUERY, MINRUN and MAXRUN. But the @is_src_production alias can not be used for now. The full query needs to be filled in (See the monitoring runs section below).
      • The "Conditions" tab lists all the conditions available in RCDB.
    • Job submission
      • Run python launch script with the command 'python launch.py MINRUN MAXRUN'
      • Specify the RCDB_QUERY in the configuration file (.config)
  • More detailed documentation can be found here: wiki, GitHub
  • Contact Sean Dobbs if the information needs to be edited in RCDB.

All runs

Monitoring runs

  • Runs included in the monitoring and reconstruction launches. These runs are calibrated. Relatively loose selection is used so that some test runs and junk runs are also included.
  • RCDB query: "@is_src_production" (alias of "daq_run=='PHYSICS_SRC' and beam_current > 2. and event_count > 5000000 and solenoid_current > 100 and collimator_diameter != 'Blocking'")
  • List of monitoring runs

Approved runs

Selection queries

  • Target used
    • Liquid deuterium: "target_type=='FULL & Ready Deuterium'"
    • Liquid He-4: "target_type=='FULL & Ready Helium'"
    • Multi-foil C-12: "target_type=='FULL & Ready Carbon'"
    • Empty target: "(target_type=='EMPTY & Ready' or target_type=='OFF')"
  • Run conditions
    • Raw mode: "run_config=='FCAL_BCAL_PS_SRC_m10.conf'"
    • Compton trigger: "run_config=='CCAL_FCAL_PS_m9.conf'"
    • Low intensity: "run_config == 'FCAL_BCAL_PS_SRC_m9.conf' and beam_on_current < 55.0"
    • Normal production: "run_config == 'FCAL_BCAL_PS_SRC_m9.conf' and beam_on_current > 55.0"
  • Photon polarization
    • Amorphous: "polarization_angle == -1.0"
    • Diamond: "polarization_angle >= 0.0"
      • 0/90 PARA: "polarization_angle == 0.0"
      • 0/90 PERP: "polarization_angle == 90.0"
      • 45/135 PARA: "polarization_angle == 135.0"
      • 45/135 PERP: "polarization_angle == 45.0"