Difference between revisions of "GlueX-2023-01 data reconstruction"

From GlueXWiki
Jump to: navigation, search
(→‎Version)
(→‎Version)
 
(28 intermediate revisions by the same user not shown)
Line 11: Line 11:
 
==Version ==
 
==Version ==
 
* Software stack:  
 
* Software stack:  
−
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
+
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], circular/linear polarization proposal
−
** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] for testing purposes
+
** ver02: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml], cost of rendering per hour using NERSC cpu test
 +
** ver03: [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml], high-intensity studies
 
* Calibration time stamp:  
 
* Calibration time stamp:  
−
** circular test - variation=default calibtime=2023-12-07-00-00-01
+
** ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
 +
** ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
 +
** ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
 
* Started on
 
* Started on
−
** circular test - 07/12/2023. Finished on
+
** ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
−
* Summary:
+
** ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
 +
** ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
 +
* Summary:  
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
Line 38: Line 43:
 
| 120438
 
| 120438
 
| 30
 
| 30
−
| 5850
+
| 5850 (5657)
−
| TB
+
| 28 TB
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
Line 50: Line 55:
 
| 120438
 
| 120438
 
| 2
 
| 2
−
| 520
+
| 520 (500)
−
| TB
+
| 2.5 TB
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
 
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/]
 
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/]
 
|-
 
|-
−
 
+
| 2023-01
 +
| 03
 +
| 02
 +
| 120582
 +
| 120602
 +
| 11
 +
| 856 (850)
 +
| 4.1TB
 +
| NERSC*
 +
| 1
 +
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/]
 +
|-
 
|}
 
|}
−
 
+
* Comparison between [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml]
 +
** Success rate:
 +
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs
 +
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs.
 +
*** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs
 +
** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Latest revision as of 15:19, 23 January 2024

Back to the analysis page

Reconstruction launch overview

  • Reconstruction of the physics objects from raw data using the danarest plugin
  • Configuration of the launches:
    • /group/halld/data_monitoring/run_conditions/RunPeriod-2023-01
  • Input raw data (.evio):
    • /mss/halld/RunPeriod-2023-01/rawdata
  • Output reconstructed files (.hddm):
    • /mss/halld/RunPeriod-2023-01/recon

Version

  • Software stack:
  • Calibration time stamp:
    • ver01: circular/linear polarization proposal - variation=default calibtime=2023-12-07-00-00-01
    • ver02: cost of rendering per hour using NERSC's cpu test - variation=default calibtime=2023-12-07-00-00-01
    • ver03: high-intensity studies - variation=default calibtime=2024-01-09-12-00-01 and 2024-01-21-16-00-001
  • Started on
    • ver01: circular/linear polarization proposal - 07/12/2023. Finished on 22/12/2023.
    • ver02: cost of rendering test - 24/12/2023. Finished on 26/12/2023.
    • ver03: high-intensity studies - 09/01/2024. Finished on 23/01/2024.
  • Summary:
Runperiod Version Batch Min Run Max Run # Runs # REST Files (succeeded) Total Size of REST Files Site Priority Details
2023-01 01 01 120395 120438 30 5850 (5657) 28 TB NERSC* 1 [1]
2023-01 02 01 120437 120438 2 520 (500) 2.5 TB NERSC* 1 [2]
2023-01 03 02 120582 120602 11 856 (850) 4.1TB NERSC* 1 [3]

(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Retrieved from "https://halldweb1.jlab.org/wiki/index.php?title=GlueX-2023-01_data_reconstruction&oldid=124424"