Difference between revisions of "GlueX-2023-01 data reconstruction"

From GlueXWiki
Jump to: navigation, search
(Created page with "[https://halldweb.jlab.org/wiki/index.php/Eta_Decay_Width_Measurements_via_Primakoff_Effect Back to the analysis page] == Reconstruction launch overview== *Reconstruction of t...")
 
(→‎Version)
 
(36 intermediate revisions by the same user not shown)
Line 10: Line 10:
  
 
==Version ==
 
==Version ==
−
* Software stack: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
+
* Software stack:
 +
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], circular/linear polarization proposal
 +
** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml], cost of rendering per hour using NERSC cpu test
 +
** ver03: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], high-intensity studies
 
* Calibration time stamp:  
 
* Calibration time stamp:  
−
** 2023-01 - variation=default calibtime=2023-12-07-00-00-01
+
** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
 +
** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
 +
** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
 
* Started on
 
* Started on
−
** 2023-01 - 07/12/2023. Finished on
+
** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
−
* Summary:
+
** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
 +
** ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
 +
* Summary:  
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
Line 30: Line 37:
 
! Details
 
! Details
 
|-
 
|-
−
| 2019-01
+
| 2023-01
−
| 07
+
 
| 01
 
| 01
−
| 61321
+
| 01
−
| 61951
+
| 120395
−
| 631 (503)
+
| 120438
−
| 12433 (11010)
+
| 30
−
| TB
+
| 5850 (5657)
−
| NERSC/PERLMUTTER (*)
+
| 28 TB
 +
| NERSC*
 
| 1
 
| 1
−
| Be/He [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2019-01_ver01-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2019-01_ver01-perl_batchNERSC-multi]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver01-perl_batchNERSC-multi/]
 
|-
 
|-
−
| 2021-08
+
| 2023-01
 
| 02
 
| 02
 
| 01
 
| 01
−
| 81113
+
| 120437
−
| 81716
+
| 120438
−
| 372 (301)
+
| 2
−
| 7196 (6504)
+
| 520 (500)
−
| TB
+
| 2.5 TB
−
| NERSC/CORI/PERLMUTTER (*)
+
| NERSC*
 
| 1
 
| 1
−
| Be/He [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2021-08_ver01-cori_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2021-08_ver01-cori_batchNERSC-multi][https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2021-08_ver02-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2021-08_ver02-perl_batchNERSC-multi]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/]
 
|-
 
|-
−
| 2022-08
+
| 2023-01
−
| 01
+
| 03
−
| N/A
+
| 02
−
| 110469
+
| 120582
−
| 112001
+
| 120602
−
| 1145
+
| 11
−
| 77788
+
| 856 (850)
−
| TB
+
| 4.1TB
−
| N/A
+
| NERSC*
 
| 1
 
| 1
−
| Be/He
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/]
 
|-
 
|-
−
 
 
|}
 
|}
−
 
+
* Comparison between [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml]
 +
** Success rate:
 +
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs
 +
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs.
 +
*** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs
 +
** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Latest revision as of 15:19, 23 January 2024

Back to the analysis page

Reconstruction launch overview

  • Reconstruction of the physics objects from raw data using the danarest plugin
  • Configuration of the launches:
    • /group/halld/data_monitoring/run_conditions/RunPeriod-2023-01
  • Input raw data (.evio):
    • /mss/halld/RunPeriod-2023-01/rawdata
  • Output reconstructed files (.hddm):
    • /mss/halld/RunPeriod-2023-01/recon

Version

  • Software stack:
  • Calibration time stamp:
    • ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
    • ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
    • ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
  • Started on
    • ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
    • ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
    • ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
  • Summary:
Runperiod Version Batch Min Run Max Run # Runs # REST Files (succeeded) Total Size of REST Files Site Priority Details
2023-01 01 01 120395 120438 30 5850 (5657) 28 TB NERSC* 1 [1]
2023-01 02 01 120437 120438 2 520 (500) 2.5 TB NERSC* 1 [2]
2023-01 03 02 120582 120602 11 856 (850) 4.1TB NERSC* 1 [3]

(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Retrieved from "https://halldweb1.jlab.org/wiki/index.php?title=GlueX-2023-01_data_reconstruction&oldid=124424"