Difference between revisions of "GlueX Software Meeting, December 20, 2021"

From GlueXWiki
Jump to: navigation, search
(first draft)
 
(added the minutes)
 
(5 intermediate revisions by the same user not shown)
Line 7: Line 7:
  
 
# Announcements
 
# Announcements
−
# Review of [[GlueX Software Meeting, October 25, 2021#Minutes|Minutes from the Last Software Meeting]] (all)
+
## [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008722.html New version set: 5.2.0]
−
# Review of [[HDGeant4_Meeting,_November_29,_2021#Minutes|minutes from the last HDGeant4 meeting]] (all)
+
## [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008727.html new recon-launch-compatible version sets]
 +
## [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008731.html group disk cleaned up, old releases deleted]
 +
# Review of [[GlueX Software Meeting, December 6, 2021#Minutes|Minutes from the Last Software Meeting]] (all)
 +
<!-- # Review of [[HDGeant4_Meeting,_November_29,_2021#Minutes|minutes from the last HDGeant4 meeting]] (all) -->
 
# FAQ of the Fortnight: [[GlueX_Offline_FAQ#What_do_I_need_to_specify_to_get_the_correct_constants_from_the_CCDB.3F|What do I need to specify to get the correct constants from the CCDB?]]
 
# FAQ of the Fortnight: [[GlueX_Offline_FAQ#What_do_I_need_to_specify_to_get_the_correct_constants_from_the_CCDB.3F|What do I need to specify to get the correct constants from the CCDB?]]
−
# [[Software_and_Computing_Review_6|Upcoming Computing Review]] (Mark)
+
# [[Software_and_Computing_Review_6|Last Week's Computing Review]] (Mark)
 
# Review of recent issues and pull requests:
 
# Review of recent issues and pull requests:
 
## halld_recon
 
## halld_recon
Line 31: Line 34:
 
##* [https://github.com/JeffersonLab/gluex_root_analysis/pulls?q=is%3Apr pull requests]
 
##* [https://github.com/JeffersonLab/gluex_root_analysis/pulls?q=is%3Apr pull requests]
 
# Review of [https://groups.google.com/forum/#!forum/gluex-software recent discussion on the GlueX Software Help List] (all)
 
# Review of [https://groups.google.com/forum/#!forum/gluex-software recent discussion on the GlueX Software Help List] (all)
 +
# Meeting Time in January (all)
 
# Action Item Review (all)
 
# Action Item Review (all)
  
 
== Minutes ==
 
== Minutes ==
  
−
Present: Alex Austregesilo, Edmundo Barriga, Thomas Britton, Sean Dobbs, Sergey Furletov, Mark Ito (chair), Igal Jaegle, Richard Jones, Simon Taylor, Jon Zarling, Beni Zihlmann
+
Present: Alex Austregesilo, Edmundo Barriga, Mark Ito (chair), Igal Jaegle, Naomi Jarvis
  
−
There is a [https://bluejeans.com/s/iHsrd3ouohh recording of this meeting]. Log into the [https://jlab.bluejeans.com BlueJeans site] first to gain access (use your JLab credentials).
+
There is a [https://bluejeans.com/s/qxTLU3FPpVx recording of this meeting]. Log into the [https://jlab.bluejeans.com BlueJeans site] first to gain access (use your JLab credentials).
  
 
=== Announcements ===
 
=== Announcements ===
  
−
# [https://mailman.jlab.org/pipermail/halld-offline/2021-October/008671.html New version set: 5.1.0] This version set was released on October 29. Mark is preparing a new version set and now that [https://github.com/JeffersonLab/halld_recon/pull/605 Pull Request #605], "Remove incorrect logic in TRUTH photon construction," submitted by Sean, has been merged by Alex, a new tag of halld_recon can be applied and added to the new set.
+
# [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008722.html New version set: 5.2.0] New production release from December 8.
−
# [https://mailman.jlab.org/pipermail/halld-offline/2021-November/008681.html first step toward a global filesystem for Gluex]. Richard led a discussion of how we can use [https://opensciencegrid.org/docs/data/stashcache/overview/ StashCache] to create, maintain, and analyze a global file system. See [https://mailman.jlab.org/pipermail/halld-offline/2021-November/008681.html his email] for details.
+
# [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008727.html new recon-launch-compatible version sets] These correspond to version set 5.2.0.
−
#* The OSG is moving away from user X509 certificates and towards tokens for user authentication. This (and other issues) have caused a stoppage in job submission to the OSG over the past few weeks
+
# [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008731.html group disk cleaned up, old releases deleted] 500 GB deleted of 3.0 TB total.
−
#** The stoppage was confirmed by Thomas. "We are on the cutting edge of OSG use," he reports.
+
−
#* We should leverage efforts from the larger community on data management. StashCache is an example of an opportunity to do so.
+
−
#* Igal is interested in using this for PrimEx and SRC/CT.
+
−
#* One leading candidate for using this is for doing analysis launches on the OSG. This requires having our REST data out there on StashCache.
+
−
#* Mark: We (aka he) need education on StashCache. Perhaps Richard can give a pedagogically oriented presentation at some point.
+
−
#* [https://mailman.jlab.org/pipermail/halld/2021-December/000943.html Transitioning to Zoom] Mark put a wiki page together on the topic and invited us to contribute content.
+
−
#* [https://mailman.jlab.org/pipermail/halld-offline/2021-November/008710.html New version set for simulating 2019-11 data] There will be a new version sets coming out soon to pick up the fix from Sean mentioned above (Pull Request #605) as applied to the recon-launch compatible builds (2017-01, 2018-01, 2018-08, and 2019-11).
+
  
 
=== Review of Minutes from the Last Software Meeting ===
 
=== Review of Minutes from the Last Software Meeting ===
  
−
We went over the [[GlueX Software Meeting, October 25, 2021#Minutes|minutes from the meeting on October 25th]].
+
We went over the [[GlueX Software Meeting, December 6, 2021#Minutes|minutes from the meeting on December 6]].
  
−
* Thomas reported that the node formerly known as scosg16 is being rebuilt as scosg16-dev and will serve as a test platform for changes to OSG-related software. This avoids bringing in changes, untested, on the production Submit Host (now scosg20).
+
==== StashCache ====
−
* CentOS Stream looks to be the choice (not yet final) for a future upgrade of the JLab Farm.
+
−
* On '''Package Structure''', Mark has concluded that the project to render halld_sim and hdgeant4 independent of halld_recon by splitting out the pieces of code used by all three is not easily done and will require coding of interface routines, i.e., a significant refactoring effort. He has succeeded in doing the split in on a technical basis, but the extracted code represents an unacceptably large fraction of the various detector reconstruction packages. The split code, though not suitable for general use, may guide us if we want to pursue this change in the future.
+
  
−
=== Review of Minutes from the Last HDGeant4 Meeting ===
+
* Alex has loaded all of the 2017-01 REST files onto the cache disk. Naomi is copying them to CMU and Richard Jones is copying them to UConn.
 +
* Igal has uploaded PrimEx calibration data, but is having problems accessing them. He will post a description of the problem to the Software Help List.
  
−
We went over the [[HDGeant4_Meeting,_November_29,_2021#Minutes|minutes from the meeting on November 29]].
+
==== Documentation Upgrade ====
  
−
Hao Li has marked [https://github.com/JeffersonLab/HDGeant4/issues/195 Issue #195], "Crash adding daughters on RHEL/CentOS 8" as resolved.
+
Beni Zihlmann called a meeting of the Documentation Task Force on December 9. Naomi reported that a [[Software|wiki page]] has been created to give an overview of GlueX software at a beginner's level. It is linked from the [[Main Page|main wiki page]] under "Overview" in the "Software" section of the column on the right. Writing assignments for subsidiary pages were made and many have been fulfilled.
  
−
=== Report from the November 4th SciComp Meeting ===
+
=== FAQ of the Fortnight: What do I need to specify to get the correct constants from the CCDB? ===
  
−
Mark promised a report soon. He knows y'all can't wait. ;-)
+
Mark went over the details of [[GlueX_Offline_FAQ#What_do_I_need_to_specify_to_get_the_correct_constants_from_the_CCDB.3F|what is needed to fully specify]] the set of calibration constants to be used.
  
−
=== FAQ of the Fortnight: How do I get notified of changes in a repository on GitHub? ===
+
=== Last Week's Computing Review ===
  
−
We took a quick look at the link provided in the [[GlueX_Offline_FAQ#How_do_I_get_notified_of_changes_in_a_repository_on_GitHub.3F|answer to this FAQ]].
+
Mark reported that the Review went well for us. He thanked all those that contributed. See [https://mailman.jlab.org/pipermail/halld-offline/2021-December/008728.html his email from last Friday].
  
−
=== Upcoming Computing Review ===
+
=== Review of recent issues and pull requests ===
  
−
We went over a few items linked from the [[Software_and_Computing_Review_6|Computing Review wiki page]].
+
We went over [https://github.com/JeffersonLab/gluex_root_analysis/issues/156 gluex_root_analysis Issue #156]: Crashes with minimal DSelector upon writing output trees, probably memory leak.
  
−
* There will be a meeting to show slides this afternoon. All presenters in the review will present what they have.
+
Naomi told us that Paul Mattione had reported that when cloning ROOT forgets branch addresses when it uses PROOF or when it operates on a TChain[?] and so he had to write his own routine, which does not seem to work on CentOS 8. To debug the problem further she needs to go the main branch of ROOT to make sure that all recent changes have been incorporated. Mark said that he would look into adding that capability to the ROOT makefile in Build Scripts.
−
* A few of the slides that Mark prepared were flashed.
+
−
* The pre-review handout document now runs to about 16 pages.
+
  
−
=== Documentation Upgrade ===
+
For now Naomi is using a two-part workaround:
  
−
Beni presented his thought on how we should improve software documentation. See [https://halldweb.jlab.org/talks/2021/usedoxy.pdf his slides] for all of the details. Some points (for emphasis):
+
# process one file at a time
 +
# do not use PROOF
  
−
* User's are well-positioned to comment on the documentation and should be encouraged to do so.
+
=== Meeting Time in January ===
−
* An overview presentation of the data analysis flow, from reconstruction to analysis to ROOT analysis is lacking.
+
 
−
* Richard: there are additional valuable resources for software information:
+
After the Holidays, we will go back to meeting on Tuesdays at 3:00 pm for both the Software and HDGeant4 meetings.
−
** The HOWTO wiki page.
+
−
** Recordings of past Tutorials/Workfests
+
−
* Beni proposed forming a task force
+
−
** Those present unanimously agreed that Beni should be the chair.
+
−
*** Richard remarked that "we are all 100% behind you, Beni."
+
−
** Mark volunteered to provide advice to the new chair.
+
−
** Beni will call an organizational meeting.
+

Latest revision as of 14:47, 20 December 2021

GlueX Software Meeting
Monday, December 20, 2021
9:30 am EST
BlueJeans: 968 592 007

Agenda

  1. Announcements
    1. New version set: 5.2.0
    2. new recon-launch-compatible version sets
    3. group disk cleaned up, old releases deleted
  2. Review of Minutes from the Last Software Meeting (all)
  3. FAQ of the Fortnight: What do I need to specify to get the correct constants from the CCDB?
  4. Last Week's Computing Review (Mark)
  5. Review of recent issues and pull requests:
    1. halld_recon
    2. halld_sim
    3. CCDB
    4. RCDB
    5. MCwrapper
    6. gluex_root_analysis
  6. Review of recent discussion on the GlueX Software Help List (all)
  7. Meeting Time in January (all)
  8. Action Item Review (all)

Minutes

Present: Alex Austregesilo, Edmundo Barriga, Mark Ito (chair), Igal Jaegle, Naomi Jarvis

There is a recording of this meeting. Log into the BlueJeans site first to gain access (use your JLab credentials).

Announcements

  1. New version set: 5.2.0 New production release from December 8.
  2. new recon-launch-compatible version sets These correspond to version set 5.2.0.
  3. group disk cleaned up, old releases deleted 500 GB deleted of 3.0 TB total.

Review of Minutes from the Last Software Meeting

We went over the minutes from the meeting on December 6.

StashCache

  • Alex has loaded all of the 2017-01 REST files onto the cache disk. Naomi is copying them to CMU and Richard Jones is copying them to UConn.
  • Igal has uploaded PrimEx calibration data, but is having problems accessing them. He will post a description of the problem to the Software Help List.

Documentation Upgrade

Beni Zihlmann called a meeting of the Documentation Task Force on December 9. Naomi reported that a wiki page has been created to give an overview of GlueX software at a beginner's level. It is linked from the main wiki page under "Overview" in the "Software" section of the column on the right. Writing assignments for subsidiary pages were made and many have been fulfilled.

FAQ of the Fortnight: What do I need to specify to get the correct constants from the CCDB?

Mark went over the details of what is needed to fully specify the set of calibration constants to be used.

Last Week's Computing Review

Mark reported that the Review went well for us. He thanked all those that contributed. See his email from last Friday.

Review of recent issues and pull requests

We went over gluex_root_analysis Issue #156: Crashes with minimal DSelector upon writing output trees, probably memory leak.

Naomi told us that Paul Mattione had reported that when cloning ROOT forgets branch addresses when it uses PROOF or when it operates on a TChain[?] and so he had to write his own routine, which does not seem to work on CentOS 8. To debug the problem further she needs to go the main branch of ROOT to make sure that all recent changes have been incorporated. Mark said that he would look into adding that capability to the ROOT makefile in Build Scripts.

For now Naomi is using a two-part workaround:

  1. process one file at a time
  2. do not use PROOF

Meeting Time in January

After the Holidays, we will go back to meeting on Tuesdays at 3:00 pm for both the Software and HDGeant4 meetings.

Retrieved from "https://halldweb1.jlab.org/wiki/index.php?title=GlueX_Software_Meeting,_December_20,_2021&oldid=109918"