Spring 2016 Tape Notes

From GlueXWiki
Revision as of 14:53, 3 March 2016 by Sdobbs (Talk | contribs) (Created page with "2016/3/3 We are seeing the following behavior from the first two calibration runs over "production" data: - If we cache all files from tape beforehand using jcache, we get re...")

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

2016/3/3

We are seeing the following behavior from the first two calibration runs over "production" data: - If we cache all files from tape beforehand using jcache, we get reasonable performance. We have to be sure to only cache enough data that will fit on the disk - If we only cache the first file from each run, then processing is much slower, and we get hit by a "long tail" of jobs which seem to take forever to load the files from tape (multiple days).

Note that we are also running monitoring jobs over the data as it comes in.