Difference between revisions of "Topics for the 2015 Software Review"

From GlueXWiki
Jump to: navigation, search
Line 12: Line 12:
 
#** Run Multi-threaded jobs
 
#** Run Multi-threaded jobs
 
#** Already doing full reprocessing of the Fall 2014 data from tape every two weeks.
 
#** Already doing full reprocessing of the Fall 2014 data from tape every two weeks.
−
# Data Acquisition Successes - Running Fall 2014
+
# Data Acquisition Successes - Running Fall 2014 (stealth data challenge).
 
#* Exceeded the 300MB/s transfer to tape bandwidth of experiment.
 
#* Exceeded the 300MB/s transfer to tape bandwidth of experiment.
 
#** ~500 million events.
 
#** ~500 million events.
Line 27: Line 27:
 
#** Problems with some FADCs getting out of sync.
 
#** Problems with some FADCs getting out of sync.
 
#* Stealth Online Data Challenge
 
#* Stealth Online Data Challenge
−
* Revist data spreadsheet from a year ago
+
# Revisit data and computing spreadsheets
−
* offline monitoring
+
#* Update based on current software performance.
−
** browser
+
#* Update with best estimates of raw data footprint.
−
** analyze data as it appears on the silo
+
# offline monitoring
−
** reconstruction results
+
#* browser
−
* calibration committee
+
#* analyze data as it appears on the silo
−
** bi-weekly meeting
+
#* reconstruction results
−
** preliminary list of constants compiled
+
# calibration committee
−
** calibration still needs to be regularized
+
#* bi-weekly meeting
−
** calibration database training
+
#* preliminary list of constants compiled
−
* CCDB successes
+
#* calibration still needs to be regularized
−
** command line interface
+
#* calibration database training
−
** SQLite form of database
+
# CCDB successes
−
* analysis results
+
#* command line interface
−
** electron identification in the FCAL.
+
#* SQLite form of database
−
** pi0 peak
+
# analysis results
−
** proton id with tof
+
#* electron identification in the FCAL.
−
** rho meson in pi+ pi-
+
#* pi0 peak
−
** omega meson in pi+ pi- pi0
+
#* proton id with tof
−
* data transfer to CMU via globus Online
+
#* proton id with dE/dx
−
* data management: event store, etc.
+
#* rho meson in pi+ pi-
−
* stealth data challenge on real data
+
#* omega meson in pi+ pi- pi0
 +
# data transfer to CMU via globus Online
 +
# data management: event store, etc.

Revision as of 13:24, 17 January 2015

  1. Report on Successful Data Challenges
    • DC1 - December 2012/ January 2013
      • 5 billion Events - OSG, JLab, CMU
      • 1200 Concurrent Jobs at JLab.
    • DC2 - March/April 2014
      • 10 billion events with EM backgrounds included - OSG, JLab, MIT, CMU, FSU
      • 4500 Concurrent Jobs at JLab
      • Well under 0.1% failure rate
    • DC3 - January/February 2015
      • Read data in raw-event format from tape and produce to DST (REST) files.
      • Load up as many JLab cores as possible.
      • Run Multi-threaded jobs
      • Already doing full reprocessing of the Fall 2014 data from tape every two weeks.
  2. Data Acquisition Successes - Running Fall 2014 (stealth data challenge).
    • Exceeded the 300MB/s transfer to tape bandwidth of experiment.
      • ~500 million events.
      • 7000 files, 120TB of data
    • Most data were taken in full pulse mode of the Flash ADCs
      • Need to get final processing algorithms on the FPGAs in the FADCs
      • Need to clean raw data of massive unused headers.
    • Event Rates of 2KHz for full experiment, much higher for individual components.
      • Need to move to block mode.
      • Need to move to FPGA processing to compress data.
    • Full DAQ chain to local raid disk, transfer to tape, and automatic processing from tape.
    • Robustness issues with the system
      • Handle corrupted evio data
      • Problems with some FADCs getting out of sync.
    • Stealth Online Data Challenge
  3. Revisit data and computing spreadsheets
    • Update based on current software performance.
    • Update with best estimates of raw data footprint.
  4. offline monitoring
    • browser
    • analyze data as it appears on the silo
    • reconstruction results
  5. calibration committee
    • bi-weekly meeting
    • preliminary list of constants compiled
    • calibration still needs to be regularized
    • calibration database training
  6. CCDB successes
    • command line interface
    • SQLite form of database
  7. analysis results
    • electron identification in the FCAL.
    • pi0 peak
    • proton id with tof
    • proton id with dE/dx
    • rho meson in pi+ pi-
    • omega meson in pi+ pi- pi0
  8. data transfer to CMU via globus Online
  9. data management: event store, etc.
Retrieved from "https://halldweb1.jlab.org/wiki/index.php?title=Topics_for_the_2015_Software_Review&oldid=62763"