Difference between revisions of "GlueX Software Meeting, October 13, 2020"

From GlueXWiki
Jump to: navigation, search
(added minutes)
m (→‎Recent Workshops)
 
(One intermediate revision by the same user not shown)
Line 31: Line 31:
  
 
== Minutes ==
 
== Minutes ==
−
 
−
The meeting was called to order at 3:00.
 
  
 
Present: Alex Austregesilo, Nathan Brei, Thomas Britton, Sean Dobbs, Mark Ito (chair), Igal Jaegle, Naomi Jarvis, David Lawrence, Susan Schadmand, Simon Taylor, Beni Zihlmann
 
Present: Alex Austregesilo, Nathan Brei, Thomas Britton, Sean Dobbs, Mark Ito (chair), Igal Jaegle, Naomi Jarvis, David Lawrence, Susan Schadmand, Simon Taylor, Beni Zihlmann
Line 55: Line 53:
 
#* Richard had good things to say about the ML for beginners sessions given by Thomas Stibor.
 
#* Richard had good things to say about the ML for beginners sessions given by Thomas Stibor.
 
#* Naomi lamented the lack of time, both during and after the workshop, to work through the practical exercises provided.
 
#* Naomi lamented the lack of time, both during and after the workshop, to work through the practical exercises provided.
−
* [https://indico.bnl.gov/event/9023/ Future Trends in Nuclear Physics Computing]
+
# [https://indico.bnl.gov/event/9023/ Future Trends in Nuclear Physics Computing]
−
*# Thomas comment that some of the topics (shared software, career paths for scientists working on software) are becoming a common feature of many workshops.
+
#* Thomas commented that some of the topics (shared software, career paths for scientists working on software) are becoming a common feature of many workshops.
−
*# Mark mentioned (as he did last week) [https://rucio.cern.ch/ Rucio] as a product that has promise for use by GlueX. It does scientific data management, that is, a system for keeping track of files and their various instances across multiple storage sites.
+
#* Mark mentioned (as he did last week) [https://rucio.cern.ch/ Rucio] as a product that has promise for use by GlueX. It does scientific data management, that is, a system for keeping track of files and their various instances across multiple storage sites.
  
 
=== HDF5 Support for HDDM ===
 
=== HDF5 Support for HDDM ===
  
−
Richard gave a presentation on work he has been doing with using as the underlying I/O system and associated record format for HDDM. Please see [[https://docs.google.com/presentation/d/1DvXUrgsvzUCSa8cRON4G_QeX9hsiySqnrYrEGmgnfW0/edit?usp=sharing his slides] for the details. His slides addressed:
+
Richard gave a presentation on work he has been doing with using HDF5 as the underlying I/O system and associated record format for HDDM. Please see [[https://docs.google.com/presentation/d/1DvXUrgsvzUCSa8cRON4G_QeX9hsiySqnrYrEGmgnfW0/edit?usp=sharing his slides] for the details. His slide titles:
 
* What is HDF5?
 
* What is HDF5?
 
* How does HDF5 relate to HDDM?
 
* How does HDF5 relate to HDDM?
Line 67: Line 65:
 
* How does HDF5 support get built?
 
* How does HDF5 support get built?
 
I/O using HDF5 will likely be better optimized than the code used by HDDM currently. It also provides a mechanism for random access. The C++ interface is done and Richard is working on Python support.
 
I/O using HDF5 will likely be better optimized than the code used by HDDM currently. It also provides a mechanism for random access. The C++ interface is done and Richard is working on Python support.
−
 
  
 
=== Port of halld_recon to JANA 2 ===
 
=== Port of halld_recon to JANA 2 ===

Latest revision as of 13:15, 16 October 2020

GlueX Software Meeting
Tuesday, October 13, 2020
3:00 pm EDT
BlueJeans: 968 592 007

Agenda

  1. Announcements
  2. Review of Minutes from the Last Software Meeting (all)
  3. Recent workshops:
  4. HDF5 and GlueX (Richard)
  5. Review of recent issues and pull requests:
    1. halld_recon
    2. halld_sim
    3. CCDB
    4. RCDB
  6. Review of recent discussion on the GlueX Software Help List (all)
  7. Action Item Review (all)

Minutes

Present: Alex Austregesilo, Nathan Brei, Thomas Britton, Sean Dobbs, Mark Ito (chair), Igal Jaegle, Naomi Jarvis, David Lawrence, Susan Schadmand, Simon Taylor, Beni Zihlmann

There is a recording of his meeting on the BlueJeans site. Use your JLab credentials to authenticate.

Announcements

  • Alex called our attention to the recently announced upgrade of the Tape Library and the associated down time, scheduled for November 2-4. See Bryan Hess's message to the SciComp Briefs mailing list.
  • Sean pointed out that we did not have a plan for the software/analysis talk on Saturday morning of next week's Collaboration Meeting, so we made one. Alex will give an update on processing. Mark may contribute a slide or two on software issues.

Review of Minutes from the Last Software Meeting

We went over the minutes from September 29 without significant comment.

Recent Workshops

We discussed two workshops, sponsored in part by the Lab, held in recent weeks.

  1. Joint GlueX-EIC-PANDA Machine Learning
    • David was one of the organizers and he reported that the workshop was generally well received and another one is planned for next year.
    • Richard had good things to say about the ML for beginners sessions given by Thomas Stibor.
    • Naomi lamented the lack of time, both during and after the workshop, to work through the practical exercises provided.
  2. Future Trends in Nuclear Physics Computing
    • Thomas commented that some of the topics (shared software, career paths for scientists working on software) are becoming a common feature of many workshops.
    • Mark mentioned (as he did last week) Rucio as a product that has promise for use by GlueX. It does scientific data management, that is, a system for keeping track of files and their various instances across multiple storage sites.

HDF5 Support for HDDM

Richard gave a presentation on work he has been doing with using HDF5 as the underlying I/O system and associated record format for HDDM. Please see [his slides for the details. His slide titles:

  • What is HDF5?
  • How does HDF5 relate to HDDM?
  • How does HDF5 support get included?
  • How does HDF5 support get built?

I/O using HDF5 will likely be better optimized than the code used by HDDM currently. It also provides a mechanism for random access. The C++ interface is done and Richard is working on Python support.

Port of halld_recon to JANA 2

Nathan gave us an update. All of the JEventSources have been completed and he is on the plugins and then to testing.

Unit Testing

Mark raised the issue of trying to incorporate unit testing into our software stack. Here the first problem is to define what we mean by unit testing. Nathan was in favor of implementing some sort of system and has thought about the issue a bit. Although he thinks that it would be a great thing to have, he is worried about a particular feature of our code: configurable operation of software components. For each configuration or option for a factory, for example, different testing code may be called for, at least in detail, and as data is passed from stage to stage, the number of configuration combinations may make for a large number of cases to test. We need to think about and discuss the problem further.

Action Items

Copied from the last meeting:

  1. Ask the Computer Center about staging the start of jobs in time. (Mark)
  2. Make sure that the automatic tests of HDGeant4 pull requests have been fully implemented. (Mark, Sean)
  3. Finish conversion of halld_recon to use JANA2. (Nathan)
  4. Ping Dmitry on CCDB Issue #68. (Mark)
  5. Remind folks about their problematic cache files. (Alex)
  6. Finish CentOS 8 compatibility project. (Mark)
Retrieved from "https://halldweb1.jlab.org/wiki/index.php?title=GlueX_Software_Meeting,_October_13,_2020&oldid=102543"