Preprints
https://doi.org/10.5194/egusphere-2024-2986
https://doi.org/10.5194/egusphere-2024-2986
27 Sep 2024
 | 27 Sep 2024
Status: this preprint is open for discussion.

Enhancing Single-Precision with Quasi Double-Precision: Achieving Double-Precision Accuracy in the Model for Prediction Across Scales-Atmosphere (MPAS-A) version 8.2.1

Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang

Abstract. The development of numerical models are constrained by the limitations of high performance computing (HPC). Low precision computations can significantly reduce computational costs, but inevitably introduce rounding errors, which affect computational accuracy. Quasi double-precision algorithm can compensate for rounding errors by keeping corrections, thereby achieving the low numerical precision while maintaining result accuracy. This paper applies the algorithm to the Model for Prediction Across Scales-Atmosphere (MPAS-A) and evaluate its performance across four test cases. The results demonstrate that, after reducing numerical precision to single precision (from 64 bits to 32 bits), the application of quasi double-precision algorithm can achieve results comparable to double-precision computations. The round-off error of surface pressure is reduced by 68 %, 75 %, 97 %, 96 % in cases, the memory has been reduced by almost half, while the computation increases only 2 %, significantly reducing computational cost. The work substantiates both effectiveness and inexpensive computation in numerical models by using quasi double-precision algorithm.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang

Status: open (until 22 Nov 2024)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2024-2986', Anonymous Referee #1, 04 Oct 2024 reply
Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang
Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang

Viewed

Total article views: 97 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
84 9 4 97 9 0 1
  • HTML: 84
  • PDF: 9
  • XML: 4
  • Total: 97
  • Supplement: 9
  • BibTeX: 0
  • EndNote: 1
Views and downloads (calculated since 27 Sep 2024)
Cumulative views and downloads (calculated since 27 Sep 2024)

Viewed (geographical distribution)

Total article views: 97 (including HTML, PDF, and XML) Thereof 97 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 05 Oct 2024
Download
Short summary
In this study, we applied the quasi double-precision algorithm to MPAS-A. Found that, the algorithm can effectively reduce the errors introduced by using low precision through the iterative process of time integration. The error of surface pressure of 4 cases are reduced by 68%, 75%, 97%, 96%. When applied the quasi double-precision algorithm in MPAS-A, we achieved to reduce all double precision to single precision, memory has been reduced by almost half, while the computation increases only 2%.