Preprints
https://doi.org/10.5194/egusphere-2023-2613
https://doi.org/10.5194/egusphere-2023-2613
18 Dec 2023
 | 18 Dec 2023

A General Comprehensive Evaluation Method for Cross-Scale Precipitation Forecasts

Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou

Abstract. With the development of refined numerical forecasts, the problems such as the score distortion due to the division of precipitation thresholds in both traditional and improved scoring methods for precipitation forecast and the increasing subjective risk arisen from the scale setting of the neighbourhood spatial verification method have become increasingly prominent. To solve this issue, a general comprehensive evaluation method (GCEM) has been developed for cross-scale precipitation forecasts by directly analysing the proximity of precipitation forecasts and observations in this study. In addition to the core element of the precipitation forecast accuracy score (PAS) index, the GCEM system also includes score indices for insufficient precipitation forecasts, excessive precipitation forecasts, precipitation forecast biases and clear/rainy forecasts. The PAS does not distinguish the magnitude of precipitation and delimit the area of influence, it constitutes a fair scoring formula with objective performance and can be suitable for evaluating the rainfall events such as general and extreme precipitation. The PAS can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts, enabling the quantitative evaluation of the comprehensive capability of various refined precipitation forecasting products. Based on the GCEM, comparative experiments between the PAS and TS are conducted for two typical precipitation weather processes. The results show that relative to TS, the PAS aligns with subjective expectations much more, indicating that the PAS is more reasonable than the TS. In addition, other indices of the GCEM are utilized to analyse the range and extent of both insufficient and excessive forecasts of precipitation, as well as the precipitation forecast ability in two weather processes. These indices not only provide overall scores for individual cases similar to the TS but also offer two-dimensional score distribution plots, which can comprehensively reflect the performance and characteristics of precipitation forecasts. Both theoretical and practical applications demonstrate that the GCEM exhibits distinct advantages and potential promotion and application value compared to the various mainstream precipitation forecast verification methods.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.

Journal article(s) based on this preprint

10 Jun 2024
A general comprehensive evaluation method for cross-scale precipitation forecasts
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou
Geosci. Model Dev., 17, 4579–4601, https://doi.org/10.5194/gmd-17-4579-2024,https://doi.org/10.5194/gmd-17-4579-2024, 2024
Short summary
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-2613', Anonymous Referee #1, 03 Jan 2024
  • RC2: 'Comment on egusphere-2023-2613', Anonymous Referee #2, 06 Jan 2024

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-2613', Anonymous Referee #1, 03 Jan 2024
  • RC2: 'Comment on egusphere-2023-2613', Anonymous Referee #2, 06 Jan 2024

Peer review completion

AR: Author's response | RR: Referee report | ED: Editor decision | EF: Editorial file upload
AR by Anning Huang on behalf of the Authors (14 Mar 2024)  Author's response   Author's tracked changes   Manuscript 
ED: Referee Nomination & Report Request started (16 Mar 2024) by Lele Shu
RR by Anonymous Referee #1 (24 Mar 2024)
RR by Zhongfeng XU (03 Apr 2024)
ED: Publish subject to minor revisions (review by editor) (03 Apr 2024) by Lele Shu
AR by Anning Huang on behalf of the Authors (11 Apr 2024)  Author's response   Author's tracked changes   Manuscript 
ED: Publish as is (18 Apr 2024) by Lele Shu
AR by Anning Huang on behalf of the Authors (24 Apr 2024)  Manuscript 

Journal article(s) based on this preprint

10 Jun 2024
A general comprehensive evaluation method for cross-scale precipitation forecasts
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou
Geosci. Model Dev., 17, 4579–4601, https://doi.org/10.5194/gmd-17-4579-2024,https://doi.org/10.5194/gmd-17-4579-2024, 2024
Short summary
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou

Viewed

Total article views: 377 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
276 79 22 377 36 16 16
  • HTML: 276
  • PDF: 79
  • XML: 22
  • Total: 377
  • Supplement: 36
  • BibTeX: 16
  • EndNote: 16
Views and downloads (calculated since 18 Dec 2023)
Cumulative views and downloads (calculated since 18 Dec 2023)

Viewed (geographical distribution)

Total article views: 379 (including HTML, PDF, and XML) Thereof 379 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 

Cited

Latest update: 03 Sep 2024
Download

The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.

Short summary
By directly analysing the proximity of precipitation forecasts and observations, a precipitation forecast accuracy score (PAS) method was constructed. This method does not utilize the traditional contingency table-based classification verification, can replace the threat score (TS), equitable threat score (ETS) and other skill score methods, and can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts.