Difference between revisions of "GlueX-2022-05 data reconstruction"

From GlueXWiki
Jump to: navigation, search
(Version)
(Version)
 
(10 intermediate revisions by the same user not shown)
Line 11: Line 11:
 
==Version ==
 
==Version ==
 
* Software stack:  
 
* Software stack:  
** ver99: [https://halldweb.jlab.org/halld_versions/version_5.18.0.xml version_5.18.0.xml], test run
+
** ver99: [https://halldweb.jlab.org/halld_versions/version_5.18.0.xml version_5.18.0.xml], test
 +
** ver88: [https://halldweb.jlab.org/halld_versions/version_5.18.2.xml version_5.18.2.xml], test
 +
** ver01: [https://halldweb.jlab.org/halld_versions/version_5.18.2.xml version_5.18.2.xml], production
 
* Calibration time stamp:  
 
* Calibration time stamp:  
** ver99: test run - variation=default calibtime=2024-06-24-00-00-01
+
** ver99: test - variation=default calibtime=2024-06-24-00-00-01
 +
** ver88: test - variation=default calibtime=2024-06-30-00-00-01
 +
** ver01: production - variation=default calibtime=2024-06-30-00-00-01
 
* Started on
 
* Started on
** ver99: test run - 24/06/2024. Finished on ??/??/2024.
+
** ver99: test - 24/06/2024. Finished on 26/06/2024.
 +
** ver88: test - 30/06/2024. Finished on 02/07/2024.
 +
** ver01: production - 02/07/2024. Finished on ??/??/2024.
 
* Summary:  
 
* Summary:  
 
{| class="wikitable"
 
{| class="wikitable"
Line 31: Line 37:
 
! Details
 
! Details
 
|-
 
|-
| 2023-01
+
| 2022-05
 +
| 99
 
| 01
 
| 01
| 01
+
| 101586
| 120395
+
| 101586
| 120438
+
| 1
| 30
+
| 126 (125)
| 5850 (5657)
+
| ? TB
| 28 TB
+
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver01-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver99-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver99-perl_batchNERSC-multi]
 
|-
 
|-
| 2023-01
+
| 2022-05
| 02
+
| 88
 
| 01
 
| 01
| 120437
+
| 101586
| 120438
+
| 101586
| 2
+
| 1
| 520 (500)
+
| 126 (125)
| 2.5 TB
+
| ? TB
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver02-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver88-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver88-perl_batchNERSC-multi]
 
|-
 
|-
| 2023-01
+
| 2022-05
| 03
+
| 01
| 02
+
| 01
| 120582
+
| 100000
| 120602
+
| 109999
| 11
+
| 627+93
| 856 (850)
+
| 40536+4653 (?????)
| 4.1TB
+
| ? TB
 
| NERSC*
 
| NERSC*
 
| 1
 
| 1
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2023-01_ver03-perl_batchNERSC-multi/]
+
| [https://halldweb.jlab.org/data_monitoring/recon/summary_swif2_output_recon_2022-05_ver01-perl_batchNERSC-multi/][https://scicomp.jlab.org/scicomp/swif/summary?user=gxproj4&workflow=recon_2022-05_ver01-perl_batchNERSC-multi]
 
|-
 
|-
 
|}
 
|}
* Comparison between [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml]
 
** Success rate:
 
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 30 runs
 
*** 96% for [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] and 2 runs. Both [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] fail for the same evio files for these 2 runs.
 
*** 99% for ver03 & [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml] and 11 runs
 
** Cost of rendering per hour using NERSC cpu test results: [https://halldweb.jlab.org/halld_versions/version_5.13.0.xml version_5.13.0.xml] equal to [https://halldweb.jlab.org/halld_versions/version_5.8.0.xml version_5.8.0.xml]
 
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."
 
(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."

Latest revision as of 13:33, 3 July 2024

Back to the analysis page

Reconstruction launch overview

  • Reconstruction of the physics objects from raw data using the danarest plugin
  • Configuration of the launches:
    • /group/halld/data_monitoring/run_conditions/RunPeriod-2022-05
  • Input raw data (.evio):
    • /mss/halld/RunPeriod-2022-05/rawdata
  • Output reconstructed files (.hddm):
    • /mss/halld/RunPeriod-2022-05/recon

Version

  • Software stack:
  • Calibration time stamp:
    • ver99: test - variation=default calibtime=2024-06-24-00-00-01
    • ver88: test - variation=default calibtime=2024-06-30-00-00-01
    • ver01: production - variation=default calibtime=2024-06-30-00-00-01
  • Started on
    • ver99: test - 24/06/2024. Finished on 26/06/2024.
    • ver88: test - 30/06/2024. Finished on 02/07/2024.
    • ver01: production - 02/07/2024. Finished on ??/??/2024.
  • Summary:
Runperiod Version Batch Min Run Max Run # Runs # REST Files (succeeded) Total Size of REST Files Site Priority Details
2022-05 99 01 101586 101586 1 126 (125)  ? TB NERSC* 1 [1][2]
2022-05 88 01 101586 101586 1 126 (125)  ? TB NERSC* 1 [3][4]
2022-05 01 01 100000 109999 627+93 40536+4653 (?????)  ? TB NERSC* 1 [5][6]

(*) Acknowledgement: "This research used resources of the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231."