Difference between revisions of "Topics for the 2015 Software Review"
From GlueXWiki
| Line 11: | Line 11: | ||
#** Full DAQ chain to local raid disk, transfer to tape, and automatic processing from tape. | #** Full DAQ chain to local raid disk, transfer to tape, and automatic processing from tape. | ||
#** ~500 million events. | #** ~500 million events. | ||
| + | #** 7000 files, 120TB of data | ||
| + | #** Most data were taken in full pulse mode of the Flash ADCs | ||
#* DC3 - January/February 2015 | #* DC3 - January/February 2015 | ||
#** Read data in raw-event format from tape and produce to DST (REST) files. | #** Read data in raw-event format from tape and produce to DST (REST) files. | ||
#** Load up as many JLab cores as possible. | #** Load up as many JLab cores as possible. | ||
#** Run Multi-threaded jobs | #** Run Multi-threaded jobs | ||
| + | #** Already doing full reprocessing of the Fall 2014 data from tape every two weeks. | ||
* data acquisitions successes | * data acquisitions successes | ||
** transfer bandwidth | ** transfer bandwidth | ||
Revision as of 13:11, 17 January 2015
- Report on Successful Data Challenges
- DC1 - December 2012/ January 2013
- 5 billion Events - OSG, JLab, CMU
- 1200 Concurrent Jobs at JLab.
- DC2 - March/April 2014
- 10 billion events with EM backgrounds included - OSG, JLab, MIT, CMU, FSU
- 4500 Concurrent Jobs at JLab
- Well under 0.1% failure rate
- Stealth Online Data Challenge
- Running in Fall 2014
- Full DAQ chain to local raid disk, transfer to tape, and automatic processing from tape.
- ~500 million events.
- 7000 files, 120TB of data
- Most data were taken in full pulse mode of the Flash ADCs
- DC3 - January/February 2015
- Read data in raw-event format from tape and produce to DST (REST) files.
- Load up as many JLab cores as possible.
- Run Multi-threaded jobs
- Already doing full reprocessing of the Fall 2014 data from tape every two weeks.
- DC1 - December 2012/ January 2013
- data acquisitions successes
- transfer bandwidth
- Event rates, how to improve
- Event sizes, how to improve
- rosbustness of system
- Handle corrupted evio data
- Revist data spreadsheet from a year ago
- offline monitoring
- browser
- analyze data as it appears on the silo
- reconstruction results
- calibration committee
- bi-weekly meeting
- preliminary list of constants compiled
- calibration still needs to be regularized
- calibration database training
- CCDB successes
- command line interface
- SQLite form of database
- analysis results
- electron identification in the FCAL.
- pi0 peak
- proton id with tof
- rho meson in pi+ pi-
- omega meson in pi+ pi- pi0
- data transfer to CMU via globus Online
- data management: event store, etc.
- stealth data challenge on real data
