Difference between revisions of "Data Challenge 2: Ideas"
From GlueXWiki
(→System Improvements) |
|||
Line 11: | Line 11: | ||
=System Improvements= | =System Improvements= | ||
+ | * improve job success efficiency | ||
* farm management system at JLab | * farm management system at JLab | ||
** crude set of perl scripts now, full of kludges | ** crude set of perl scripts now, full of kludges |
Revision as of 10:36, 15 May 2013
Thoughts on what goals we might have for the next data challenge.
New software
- BCAL reconstruction
- CCDB
- latest tracking
- ROOT trees?
- improved REST?
System Improvements
- improve job success efficiency
- farm management system at JLab
- crude set of perl scripts now, full of kludges
- needs generalization, perhaps re-write
- input and output data cataloging and management
- database application?
- grid-based meta-data catalog?
Raw Data Paradigm
- produce simulated data as a completely separate step
- write to tape library
- inefficient but realistic
- "raw data" sources:
- JLab farm
- online cluster
- grid
- stresses different data paths
- tape to farm at JLab
- Grid to JLab
- JLab to Grid
--marki 13:09, 1 May 2013 (EDT)