GlueX Offline Meeting, November 13, 2013

From GlueXWiki
Jump to: navigation, search

GlueX Offline Software Meeting
Wednesday, November 13, 2013
1:30 pm EDT
JLab: CEBAF Center F326/327


  1. Announcements
    1. Data Management Plan posted (Mark)
    2. New release: sim-recon-2013-10-17 (Mark)
    3. New storage type at JLab: pass-through cache (Mark)
    4. Requirements document for Data Flow Tools (Mark)
  2. Review of minutes from the last meeting: all
  3. Software Review Planning
    1. GlueX/Hall-D Computing
  4. bggen failures (Kei)
  5. An SCons System for GlueX (David)
  6. Mantis Bug Tracker Review
  7. Review of recent repository activity: all

Communication Information

Video Conferencing

Desktop Sharing

You can view the computer desktop in the meeting room at JLab via the web.

  1. Go to
  2. In the "join a meeting" box enter the Hall D code: 1833622
  3. Fill in the participant registration form.


To connect by telephone:

  1. dial:
  2. enter access code followed by the # sign: 1833622#


Talks can be deposited in the directory /group/halld/www/halldweb/html/talks/2013-4Q on the JLab CUE. This directory is accessible from the web at .



  • CMU: Will Levine, Curtis Meyer
  • IU: Kei Moriya, Matt Shepherd
  • JLab: Mark Dalton, Mark Ito (chair), David Lawrence, Yi Qiang, Dmitry Romanov, Sascha Somov, Nathan Sparks, Simon Taylor, Elliott Wolin, Beni Zihlmann
  • MIT: Justin Stevens


  • The Hall D Data Management Plan has been posted on the wiki here.
  • There is a new release of sim-recon, sim-recon-2013-10-17. Justin pointed out that this release has the disease of missing tracks in the backward direction. The precise plan to get out of this situation will be discussed in the coming days, offline.
  • New storage type at JLab: pass-through cache
    • This is writable disk space that is automatically backed up to the tape library. As the disk fills up, the oldest files (by access date) will be deleted, but those files are not lost forever. The user can request that any file be restored from the tape library. This restoration may displace other long-unaccessed files get the idea.
  • Requirements document for Data Flow Tools
    • The committee charged to come up with these requirements has done so. The next step is to write specifications from which coding can proceed. A working committee has been formed to do this: Jie Chen (chair), Johann Goetz, Vardan Guryjan, Mark Ito, Chris Larrieu, and Dennis Weygand. These requirements have been added as an appendix to the computing document to be given to the Software Review II committee.

Software Review Planning

Mark I. gave the report. Most of this information is collected in the Software Review Planning wiki page.

  • We have a final agenda from Rolf Ent.
  • We have a mostly complete written document for the reviewers.
    • I contains various appendices covering workflow tools, the data management plan, and an analysis plan the Curtis wrote recently.
    • The draft would benefit from review from the working groups, especially the section on calibrations for the various detectors.
  • Drafts of all talks exist.
  • Last Monday we had a meeting with Rolf. Talks from all of the Halls were reviewed.

Simulation and Reconstruction Job Failures

Kei have a detailed look at studies he has done to isolate failures in our simulation and reconstruction. See his slides for details.

He classified failures of reconstruction into two classes:

  1. stopped: job did not run to completion
  2. unusable: output REST file either small or not readable

He tried a variety of scenarios: isolating smeared, un-reconstructed events, with and without the preceding events in the file, isolating generated events (bggen output). He tried reproducing results in various configuration. Failures of all kinds occur indicating more than one problem is afflicting us.

He provided links to some of the problem event samples and to scripts he used in his studies.

An SCons System for GlueX

David presented his recent development of an SCons-based build system for sim-recon, calld SBMS. See his slides for details.

This is replacement for the GNU Make system we have using up to now. SCons is a Python-based system and as such allows scripting within its framework more naturally than for Make. The system is checked in on the trunk and lives side-by-side with the makefiles. Either scheme can be used.

Some slide titles:

  • Build System Features
  • Make vs. SCons
  • Why switch?
  • Common Makefile/SConscript
  • Directory-level (dispatchers)
  • Times to compile and install all of sim-recon (and clean) on gluon4
  • How to use
  • Output
  • Telling scons to show you what it's doing
  • Change to installation directory Structure
  • Documentation