Difference between revisions of "Mattione Update 02112013"

From GlueXWiki
Jump to: navigation, search
 
Line 3: Line 3:
 
* I have created a factory for skimming data into different output REST files.  It will be available soon.  
 
* I have created a factory for skimming data into different output REST files.  It will be available soon.  
 
* Below are some statistics on the data challenge data for various potential topologies/skims.   
 
* Below are some statistics on the data challenge data for various potential topologies/skims.   
* Data challenge data-set size: ~6.5 billion events, 50k events per file: ~130k files, ~100 MB per file: 13 TB total.
+
* Data challenge data-set size: ~5 billion events, 50k events per file: ~100k files, ~100 MB per file: 10 TB total.
  
 
== 2+ 1- ==
 
== 2+ 1- ==
Line 15: Line 15:
 
|-
 
|-
 
! >= 2+, >= 1-
 
! >= 2+, >= 1-
| 71.68% || ~9.3 TB
+
| 71.68% || ~7.2 TB
 
|-
 
|-
 
! >= 2+, >= 1-, >= 2n
 
! >= 2+, >= 1-, >= 2n
| 62.32% || ~8.1 TB
+
| 62.32% || ~6.2 TB
 
|-
 
|-
 
! >= 2+, >= 1-, >= 1 &pi;<sup>0</sup>
 
! >= 2+, >= 1-, >= 1 &pi;<sup>0</sup>
| 58.36% || ~7.6 TB
+
| 58.36% || ~5.8 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 1-
 
! Tracking FOM > 0.1%, >= 2+, >= 1-
| 56.56% || ~7.3 TB
+
| 56.56% || ~5.7 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 1-, >= 2n
 
! Tracking FOM > 0.1%, >= 2+, >= 1-, >= 2n
| 47.21% || ~6.1 TB
+
| 47.21% || ~4.7 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 1-, >= 1 &pi;<sup>0</sup>
 
! Tracking FOM > 0.1%, >= 2+, >= 1-, >= 1 &pi;<sup>0</sup>
| 45.33% || ~5.9 TB
+
| 45.33% || ~4.5 TB
 
|}
 
|}
 
<br style="clear:both;"/>
 
<br style="clear:both;"/>
Line 44: Line 44:
 
|-
 
|-
 
! >= 2+, >= 2-
 
! >= 2+, >= 2-
| 37.95% || ~4.9 TB
+
| 37.95% || ~3.8 TB
 
|-
 
|-
 
! >= 2+, >= 2-, >= 2n
 
! >= 2+, >= 2-, >= 2n
| 34.07% || ~4.4 TB
+
| 34.07% || ~3.4 TB
 
|-
 
|-
 
! >= 2+, >= 2-, >= 1 &pi;<sup>0</sup>
 
! >= 2+, >= 2-, >= 1 &pi;<sup>0</sup>
| 31.52% || ~4.1 TB
+
| 31.52% || ~3.2 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 2-
 
! Tracking FOM > 0.1%, >= 2+, >= 2-
| 23.02% || ~3.0 TB
+
| 23.02% || ~2.3 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 2-, >= 2n
 
! Tracking FOM > 0.1%, >= 2+, >= 2-, >= 2n
| 20.34% || ~2.6 TB
+
| 20.34% || ~2.0 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 2+, >= 2-, >= 1 &pi;<sup>0</sup>
 
! Tracking FOM > 0.1%, >= 2+, >= 2-, >= 1 &pi;<sup>0</sup>
| 18.70% || ~2.4 TB
+
| 18.70% || ~1.9 TB
 
|}
 
|}
 
<br style="clear:both;"/>
 
<br style="clear:both;"/>
Line 73: Line 73:
 
|-
 
|-
 
! >= 3+, >= 2-
 
! >= 3+, >= 2-
| 24.15% || ~3.1 TB
+
| 24.15% || ~2.4 TB
 
|-
 
|-
 
! >= 3+, >= 2-, >= 2n
 
! >= 3+, >= 2-, >= 2n
| 21.57% || ~2.8 TB
+
| 21.57% || ~2.2 TB
 
|-
 
|-
 
! >= 3+, >= 2-, >= 1 &pi;<sup>0</sup>
 
! >= 3+, >= 2-, >= 1 &pi;<sup>0</sup>
| 19.88% || ~2.6 TB
+
| 19.88% || ~2.0 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 3+, >= 2-
 
! Tracking FOM > 0.1%, >= 3+, >= 2-
| 11.31% || ~1.5 TB
+
| 11.31% || ~1.1 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 3+, >= 2-, >= 2n
 
! Tracking FOM > 0.1%, >= 3+, >= 2-, >= 2n
| 9.90% || ~1.3 TB
+
| 9.90% || ~1.0 TB
 
|-
 
|-
 
! Tracking FOM > 0.1%, >= 3+, >= 2-, >= 1 &pi;<sup>0</sup>
 
! Tracking FOM > 0.1%, >= 3+, >= 2-, >= 1 &pi;<sup>0</sup>
| 9.05% || ~1.2 TB
+
| 9.05% || ~0.9 TB
 
|}
 
|}
 
<br style="clear:both;"/>
 
<br style="clear:both;"/>

Latest revision as of 15:09, 11 February 2013

Skimming REST Data Challenge Data

  • I have created a factory for skimming data into different output REST files. It will be available soon.
  • Below are some statistics on the data challenge data for various potential topologies/skims.
  • Data challenge data-set size: ~5 billion events, 50k events per file: ~100k files, ~100 MB per file: 10 TB total.

2+ 1-

  • Note: For a charged particle to be valid, it must have 45.0 < Vertex-Z < 85.0.
  • Note: π0 means: 0.1 < γγ Invariant Mass < 0.17 (Loose Cut).
Skim Type  % of File Size Remaining Projected Total Skim Size
>= 2+, >= 1- 71.68% ~7.2 TB
>= 2+, >= 1-, >= 2n 62.32% ~6.2 TB
>= 2+, >= 1-, >= 1 π0 58.36% ~5.8 TB
Tracking FOM > 0.1%, >= 2+, >= 1- 56.56% ~5.7 TB
Tracking FOM > 0.1%, >= 2+, >= 1-, >= 2n 47.21% ~4.7 TB
Tracking FOM > 0.1%, >= 2+, >= 1-, >= 1 π0 45.33% ~4.5 TB


2+ 2-

  • Note: For a charged particle to be valid, it must have 45.0 < Vertex-Z < 85.0.
  • Note: π0 means: 0.1 < γγ Invariant Mass < 0.17 (Loose Cut).
Skim Type  % of File Size Remaining Projected Total Skim Size
>= 2+, >= 2- 37.95% ~3.8 TB
>= 2+, >= 2-, >= 2n 34.07% ~3.4 TB
>= 2+, >= 2-, >= 1 π0 31.52% ~3.2 TB
Tracking FOM > 0.1%, >= 2+, >= 2- 23.02% ~2.3 TB
Tracking FOM > 0.1%, >= 2+, >= 2-, >= 2n 20.34% ~2.0 TB
Tracking FOM > 0.1%, >= 2+, >= 2-, >= 1 π0 18.70% ~1.9 TB


3+ 2-

  • Note: For a charged particle to be valid, it must have 45.0 < Vertex-Z < 85.0.
  • Note: π0 means: 0.1 < γγ Invariant Mass < 0.17 (Loose Cut).
Skim Type  % of File Size Remaining Projected Total Skim Size
>= 3+, >= 2- 24.15% ~2.4 TB
>= 3+, >= 2-, >= 2n 21.57% ~2.2 TB
>= 3+, >= 2-, >= 1 π0 19.88% ~2.0 TB
Tracking FOM > 0.1%, >= 3+, >= 2- 11.31% ~1.1 TB
Tracking FOM > 0.1%, >= 3+, >= 2-, >= 2n 9.90% ~1.0 TB
Tracking FOM > 0.1%, >= 3+, >= 2-, >= 1 π0 9.05% ~0.9 TB