Difference between revisions of "Data Challenge 2: Ideas"

From GlueXWiki
Jump to: navigation, search
(Raw Data Paradigm)
(Raw Data Paradigm)
Line 20: Line 20:
 
* produce simulated data as a completely separate step
 
* produce simulated data as a completely separate step
 
* write to tape library
 
* write to tape library
 +
* inefficient but realistic
 
* "raw data" sources:
 
* "raw data" sources:
 
*# JLab farm
 
*# JLab farm

Revision as of 13:11, 1 May 2013

New software

  • BCAL reconstruction
  • CCDB
  • latest tracking
  • ROOT trees?
  • improved REST?

System Improvements

  • farm management system at JLab
    • crude set of perl scripts now, full of kludges
    • needs generalization, perhaps re-write
  • input and output data cataloging and management
    • database application?
    • grid-based meta-data catalog?

Raw Data Paradigm

  • produce simulated data as a completely separate step
  • write to tape library
  • inefficient but realistic
  • "raw data" sources:
    1. JLab farm
    2. online cluster
    3. grid
  • stresses different data paths
    • tape to farm at JLab
    • Grid to JLab
    • JLab to Grid




--marki 13:09, 1 May 2013 (EDT)