Back to Volume
Paper: HST/JWST Data Processing Performance Under HTCondor/OWL
Volume: 521, Astronomical Data Analysis Software and Systems XXVI
Page: 624
Authors: Swam, M.; Romelfanger, M.
Abstract: The workflow management system in use by the science data processing pipelines for the Hubble Space Telescope (HST) and the James Webb Space Telescope (JWST) is called HTCondor/OWL, and consists of the widely-used HTCondor batch processing software, and the Open Workflow Layer (OWL), developed at the Space Telescope Science Institute (STScI). This paper will describe early performance results obtained under the new HTCondor/OWL system when processing large subsets of the HST archive collection, and JWST ground test data. Description of the computer hardware configurations and data, the performance metrics gathered, and analysis of the overheads and efficiency measures for the system will be presented, along with a summary of current issues and future development plans.
Back to Volume