2012 Software Review
Contents
Scope
The review is intended to assess the overall ability of the software to analyze the data at the time data taking begins. This was a goal that was largely considered to have been sought and achieved by the LHC experiments at CERN. This has not been done previously at JLab while commissioning a new experimental hall.
Original e-mails sent by Rolf and Eugene initially describing the scope can be found here:
- Initial description of purpose of 2012 Software Review.
- e-mail sent by Eugene to HallD-Offline on Jan. 18, 2012
- e-mail sent by Rolf summarizing Jan. 26, 2012 brainstorming session
- January 26 IT Committee Meeting (See the last slide on the review.)
Charge and Final Report
Software Review Charge v3(PDF)
Final Report From Review Committee(PDF)
Agenda
Preparations
Multi-Hall Preparations
General Info.
- Chip Watson E-mail from April 11,2012 (requesting updated computing requirements)
----- Meetings ------
SRP Meeting on May 14, 2012
- There is a special meeting page set up for this meeting.
SRP Meeting on May 1, 2012
- Schedule
- DAQ
- Hall-A
- Hall-C
- Hall-D
- Morning Slides Outline
- Afternoon Slides Outline
- Charge v3 (annotated to indicate which slides address each charge item)
- Milestones
SRP Meeting on April 10, 2012
- IT Division Procurement Plans (shown by Chip)
- Hall Computing Requirements:
- First draft agenda for the review
- Management Structure + Tight Spots & Weakness
- Notes taken at April 10,2012 meeting by Dave
Brainstorming Follow-up Meeting on March 14, 2012
- Summary statements shown at March 14th follow-up meeting
- Hall A/C report at followup meeting
- Grahams Discussion Topics
- Summary of March 14, 2012 meeting from Rolf
- Notes taken at March 14,2012 meeting by Dave
Results of meetings involving Hall-D:
Brainstorming meeting on Jan. 26, 2012
- This was an initiative by Rolf to try and ensure the halls are not needlessly duplicating effort when it comes to software development.
- The initial meeting was summarized in an e-mail Rolf sent on Jan. 26, 2012.
- Several sub-meetings with topics were suggested. The intent was to have
the sub-meetings and then meet again as a group to discuss the results.
Hall-D Preparations
Specific plans for Hall-D's preparations for the review are gathered in this section.
Planning Meetings
- June 1, 2012
- May 30, 2012 Dry Runs (Offline Software Meeting)
- May 23, 2012 Dry Runs (Collaboration Meeting)
- May 11, 2012
- May 4, 2012
- Apr. 27, 2012
- Apr. 20, 2012
- Apr. 13, 2012
- Apr. 6, 2012
- Mar. 23, 2012
- Mar. 16, 2012
- Mar. 9, 2012
- Mar. 2, 2012
- Feb. 24, 2012
- Feb. 10, 2012
- Feb. 3, 2012
- Jan. 27, 2012
- Jan. 20, 2012
Schedules and Resources
Here are links to some pages dedicated to schedules and resource lists put together for the review.
Presentations
Here are links to the presentations and documents being prepared for the review. The format was described in an email sent out on April 13th,2012.
Hall-C
- Morning Session
- Introductory Talk (Steve Wood)
- Hall-C Software Status (Mark Jones)
- Afternoon parallel session
- Hall-C Software Details (Gabriel Niculescu)
- Additional documentation
- The Research Management Plan: https://userweb.jlab.org/~jones/RMP_HallC_software.docx
Hall-D
- Morning session (Morning Slides Outline)
- Overview Talk (Curtis Meyer)
- Software Planning and Numbers Talk (Mark Ito)
- Afternoon parallel session (Afternoon Slides Outline)
- Technical Details Talk (David Lawrence)
Material
From 2011 mini-Review
In Spring of 2011 an internal software review was conducted partially as preparation for the external review planned in 2012. Below are links to some of the relevant material from that review.
- Hall-D and IT: Mark Ito's slides for Hall-D
- Spreadsheet used for estimates in Mark's talk. Cells shaded blue indicate input data. Other cells are derived from these.
- IT in the 12-GeV Era: Chip Watsons's close-out slides
- Unpublished Committee Report
- Mark's response to first draft committee report
From 6GeV BIA Schedule
The 6GeV BIA (Baseline Improvement Schedule) was made to allow development on certain projects that while critical to 12GeV, could be used by the 6GeV program were it to continue and the upgrade never happen. Thus, these items were to be paid for by the 6GeV operations budget and not out of the 12GeV project budget.
The Offline Computing schedule was placed in the BIA and the intention was to track it there. At some point (2009?) the BIA tracking was dropped and the Offline Computing has not maintained tracking of it since. It does, however, serve as the most recent detailed project plan for the offline computing. The most recent version (extracted by Phil Kessler on Jan. 17, 2012) can be found here:
BIA_Last_Baseline_with_Offline_Computing_17_January_12_PMK.pdf
From 12GeV Project Schedule
The 12 GeV Project schedule contains only the Online Computing activities. Primarily DAQ system and Control Systems software. There is some overlap between the offline and online and where the reviewers will draw the boundary. Nonetheless, a recent (Oct. 2011) extraction of the Computing part of the project schedule can be found here:
12GeVProject_OnlineComputing_Oct2011.pdf
BNL Review and Hall-A Research Management Plan
The following attachments were sent with the e-mail below regarding a 2006 BNL review that this may be similar to:
- Cap_charge_dec06.pdf
- CAP-Review-Agenda-18-19-December-2006.pdf
- RMP-draft.pdf
- 12_GeV_Review_Planning_Halls_Jan2012.pdf (same document circulated earlier by Rolf)
Live links to those referred to under a), b), c) below are here:
- a) http://www.bnl.gov/npp/docs/doehep07/raja_BNL-DOE.pdf
- b) http://science.energy.gov/~/media/hep/pdf/files/pdfs/lhcops_hepap_1.pdf
- c) http://gate.hep.anl.gov/lprice/USLHC_Operations_2009-final.doc
---------- Forwarded message ----------
Date: Tue, 17 Jan 2012 14:50:04 -0500 (EST)
From: Rolf Ent <ent@jlab.org>
To: Robert Michaels <rom@jlab.org>, John LeRose <lerose@jlab.org>, Volker Burkert <burkert@jlab.org>, Latifa Elouadrhiri <latifa@jlab.org>,
Stephen A. Wood <saw@jlab.org>, Howard Fenker <hcf@jlab.org>, Eugene Chudakov <gen@jlab.org>, Elton Smith <elton@jlab.org>,
Glenn Young <gyoung@jlab.org>, Graham Heyes <heyes@jlab.org>, Javier Gomez <gomez@jlab.org>, Chip Watson <watson@jlab.org>
Cc: Robert McKeown <bmck@jlab.org>, Roy Whitney <whitney@jlab.org>
Subject: Re: 12 GeV Software review planning - electronic
Dear all,
Apologies for the delay, but here a few attachments with:
1) charge and agenda for an internal BNL Atlas review in December of
2006, that Chip chaired and had a fairly large emphasis upon software and computing, as opposed to construction.
2) for completeness, the document on what to expect/prepare for a
review, from the earlier meeting.
3) the research management plan for the SBS.
Also, FYI here a few sites with presentations/further info that
may be useful, per Chip:
a) a link to a software talk from a DOE review
http://www.bnl.gov/npp/docs/doehep07/raja_BNL-DOE.pdf
with a pretty broad scope, and lots of details. Should be useful.
b) a DOE talk of 1 1/2 years old:
http://science.energy.gov/~/media/hep/pdf/files/pdfs/lhcops_hepap_1.pdf
c) the annual review report from 2009 for US LHC:
http://gate.hep.anl.gov/lprice/USLHC_Operations_2009-final.doc
(where Operations includes software and computing).
Best regards, Rolf
Other Potentially Useful Information
Some Documentation from CLEO
- On Demand Data Analysis (proceedings)
- CLEO Analysis Framework Design Summary (proceedings)
- DChain: A tool for combinatorics in reconstruction (proceedings)
- CLEO Tracking Overview (webpage)
- Alan Weinstein's Tracking Page (some old and broken links)
- CLEO Event Store for Data Storage and Access (proceedings)
- Managing Dependencies Amongst Objects (proceedings)
- Format Independent Data Storage (proceedings)
- Rapid Development of Suez (proceedings)
- Chris Jones' web page at Cornell (contains many of the above files)
Miscellaneous
Contact Info
Hall-D preparations for the review are being organized by:
