Difference between revisions of "GlueX Offline Software"
From GlueXWiki
(add link to missing tape files to quick links section) |
(update the news) |
||
| (15 intermediate revisions by 2 users not shown) | |||
| Line 3: | Line 3: | ||
| | | | ||
'''News:''' | '''News:''' | ||
| − | * | + | * January 21, 2022: [https://mailman.jlab.org/pipermail/halld-offline/2022-January/008751.html Transition from swif to swif2] |
| − | * | + | * January 21, 2022: [https://mailman.jlab.org/pipermail/halld-offline/2022-January/008749.html New version set: 5.2.2] |
| − | * | + | * January 18, 2022: [[GlueX_Software_Meeting,_January_18,_2022#Minutes|Minutes of the January 18th Software Meeting]] are available. |
| − | * | + | * January 11, 2022: [[HDGeant4_Meeting,_January_11,_2022#Minutes|Minutes of the January 11 HDGeant4 meeting]] are available. |
| − | + | ||
* [[Offline Software News Archive|Previous news items...]] | * [[Offline Software News Archive|Previous news items...]] | ||
| | | | ||
| Line 52: | Line 51: | ||
Documentation for software packages specific to GlueX or to JLab. | Documentation for software packages specific to GlueX or to JLab. | ||
| + | |||
| + | *[[Documentation Initiative]] | ||
====Software Packages==== | ====Software Packages==== | ||
| Line 141: | Line 142: | ||
* [[Computing Services and Servers|Hall D and JLab Servers]]: Web servers, database servers, etc. | * [[Computing Services and Servers|Hall D and JLab Servers]]: Web servers, database servers, etc. | ||
* [https://cc.jlab.org/ Computer Center] | * [https://cc.jlab.org/ Computer Center] | ||
| − | * [https:// | + | * [https://scicomptest.jlab.org/scicomp/ Scientific Computing] |
** [https://scicomp.jlab.org/scicomp/#/auger/jobs Farm Job Status] Auger job status from SciComp | ** [https://scicomp.jlab.org/scicomp/#/auger/jobs Farm Job Status] Auger job status from SciComp | ||
*** [https://halldweb.jlab.org/cgi-bin/jproj_status.pl jproj Job Status] Status of jobs using the jproj system | *** [https://halldweb.jlab.org/cgi-bin/jproj_status.pl jproj Job Status] Status of jobs using the jproj system | ||
| Line 154: | Line 155: | ||
** [https://scicomp.jlab.org/scicomp/#/disk/work Work] | ** [https://scicomp.jlab.org/scicomp/#/disk/work Work] | ||
*** [https://halldweb.jlab.org/disk_management/work_report.html /work/halld leader board] | *** [https://halldweb.jlab.org/disk_management/work_report.html /work/halld leader board] | ||
| − | |||
* [[GlueX-related shared accounts on the JLab CUE]] | * [[GlueX-related shared accounts on the JLab CUE]] | ||
* [[Hall D MySQL/MariaDB Servers and Replication Relationship]]: a list of database servers | * [[Hall D MySQL/MariaDB Servers and Replication Relationship]]: a list of database servers | ||
| Line 163: | Line 163: | ||
** [https://mailman.jlab.org/pipermail/halld-offline/2017-June/002827.html Using the Grid with Containers] | ** [https://mailman.jlab.org/pipermail/halld-offline/2017-June/002827.html Using the Grid with Containers] | ||
** [[Using the Grid]] | ** [[Using the Grid]] | ||
| + | ** [[Updating Oasis for the GlueX VO]] | ||
** [https://halldweb.jlab.org/talks/2011-2Q/gridmake-6-2011.ppt Gridmake] | ** [https://halldweb.jlab.org/talks/2011-2Q/gridmake-6-2011.ppt Gridmake] | ||
Revision as of 19:14, 21 January 2022
|
News:
|
Quick Links: |
The legacy version of this page is here.
Contents
General Information
Build Scripts: A Version Management System for GlueX describes a standard directory structure for GlueX software, how to create complete or partial builds, and how to specify versions of individual packages, both for building and for use. It is also available as GlueX Note 2793.
See below for other helpful links.
Shell Environment Set-Up
Building GlueX Software
- Building private versions of GlueX software at JLab
- Scripts for Installing GlueX Software: Do a complete build of all standard components of GlueX software or add new versions to an existing build tree.
- hdpm - Hall D Package Manager: A package manager for Hall-D software, which provides an alternative method for installing GlueX software.
- Legacy Build Instructions: Guides to various aspects of the build process. Up-to-date-ness may vary.
- Version Sets Files
GlueX and Containers
Software Documentation
Packages used in the GlueX software stack with links to package-specific documentation.
GlueX Software
Documentation for software packages specific to GlueX or to JLab.
Software Packages
- AmpTools: Amplitude analysis package (aka partial wave analysis)
- CCDB: Calibration Database
- EventStore: a package for managing and deploying data files and event lists
- EVIO: The CODA event format.
- halld_recon
- halld_sim
- HDDM: The Hall D Data Model, a compact xml-based format for event-based data.
- HDDS: Detector geometry specification
- HDDS Schema: Includes description of the HDDS mark-up language.
- Geometry Specification for Hall D: General Description and Philosophy, September 2003
- Detector Models for GlueX Monte Carlo Simulation: A Status Report, June 2006
- Detector Models for GlueX Monte Carlo Simulation: the CD2 Baseline, January 2007
- HDDS Tagged Releases
- HDGeant4: Geant4-based simulation of the GlueX Detector and Hall D beamline
- JANA
- MCwrapper
- PyPWA
- RCDB: Run Conditions Database
- sim-recon (deprecated, July 2018)
- Doxygen Documentation: Descriptions of sim-recon C++ classes and their relationships.
- Sim-Recon Tagged Releases
- Analysis Software in sim-recon
- SCons Build System (SBMS)
Special Topics
- Offline HOWTO List: Guides to performing various specific tasks.
- Beam Simulations: Geant simulations of the Hall D Tagger Hall
- Magnetic Field Maps for Solenoid
- Sensitivity to Magnetic Field Strength
- How HDGeant defines time-zero for physics events
- Guide to Monte Carlo event timing and detached vertices in HDGeant/4
- Guide to roll-your-own python hddm transforms
- Geometry
- Reconstruction Software
- Kinematic Fitting
Documentation for External Software Packages
Documentation on additional software packages used by GlueX. Development and maintenance of these are not directly related to GlueX.
Data Sets
- Simulations: a guide to simulated data sets.
Offline Data Monitoring
- Data_Monitoring_Procedures: Information on offline monitoring of recently-taken data
Computing Facilities
JLab
- Hall D Offline System Status Plots
- Hall D and JLab Servers: Web servers, database servers, etc.
- Computer Center
- Scientific Computing
- Farm Job Status Auger job status from SciComp
- jproj Job Status Status of jobs using the jproj system
- Tape Request Status
- Farm Job Status Auger job status from SciComp
- Disk space usage
- GlueX-related shared accounts on the JLab CUE
- Hall D MySQL/MariaDB Servers and Replication Relationship: a list of database servers
Grid
Off-Site Computing Resources
- Off-site Computing Resources: Status of applications, current and past allocations
Software Management
Source Code Management
- Git
- GlueX Git Repositories
- Instructions for Working with GlueX Git Repositories. Workflow description.
- Instructions for joining the GlueX team on GitHub
- Git Help Resources, July 14
- Guide to Using Git. General usage tips.
- Git questions and answers in the Offline FAQ
- Splitting sim-recon
- Conversion from Subversion to Git (Summer 2015)
- Subversion
Testing and Debugging
- Automatic Builds of GlueX Software: nightly build, pull-request-initiated test build, scan-build
- Automatic Tests of GlueX Software
- Diagnosing segmentation faults in reconstruction software
Governance, Conventions, Standard Practices
- Offline Issue Tracking using GitHub Issue Tracking
- Offline Issue Tracking using the Mantis Bug Tracker
- GlueX Coding Standards
- Version Management
- GlueX Cron Jobs
- Data Challenges: Large-scale tests of computing infrastructure
- Data Management Plan for Hall D: Long-term preservation of data and data-analysis tools
- JLab Offline Computing Plan, FY2010
- Role of the Software Coordinator
Meetings and Reviews
- GlueX Offline Software Meetings: Agendas and minutes
- HDGeant4 Meetings
- GlueX Containers Meetings
- Software and Computing Reviews
- Geometries for 2008 DC Review
Communication and Help
- Offline Software Email List: announcements and discussion
- Send email to the list
- Message archive
- Google search of archive
- Information page (subscribe, unsubscribe, list members, etc.)
- Google Group for GlueX Software
- Slack
- Chat application using the workspace jlab12gev
- Click here to join. You must use your JLab email address.
- Simple Email Lists: get notifications from automated tests
- Communication Instructions: Guides to communication systems used by GlueX
FAQ
Legacy Links
- Offline Computing Project Management
- Versioning of Calibration Constants
- Releases of GlueX Software
- Reconstruction Tasks and Topics for Further Development
- Running jobs on the grid
- Calibration Constants, Tagged Versions
- Action Items Archive (May 4, 2010 and before)
- Software Task List
- Tracking resolution estimator (REZEST)
- ded
