the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
| 23 Feb 2026
A Self-Supervised Precipitation Forecast Verification Based on Contrastive Learning
Abstract. Accurate precipitation forecast verification (PFV) is essential for improving forecasting models and supporting disaster management. However, current PFV methods remain limited, point-to-point methods are overly sensitive to minor errors, while spatial verification methods commonly require setting parameter and rule comprehensively, which constrains their availability. To tackle these issues, we are inspired by the success of deep learning in image verification through extracting high-level features, and thus propose a self-supervised contrastive learning-based PFV method (CLPFV). First, CLPFV uses precipitations augmentation (displacement, intensity, area size) to simulate actual forecast errors and construct positive and negative training sample pairs. Subsequently, with a novel loss function proportionally penalizing forecast errors, a backbone network is trained in CLPFV to extract high-level precipitation features. Finally, the cosine similarity of features is calculated as CLPFV’s verification score. Experiments demonstrate that CLPFV outperforms traditional (POD, FAR, TS) and spatial (FSS, SAL) verifications in different degrees of forecast errors and aligns better with expert assessments. In general, CLPFV offers an efficient deep learning solution for PFV tasks.
- Preprint
(1381 KB) - Metadata XML
-
Supplement
(1688 KB) - BibTeX
- EndNote
Status: open (until 20 Apr 2026)
- RC1: 'Comment on egusphere-2025-5746', Anonymous Referee #1, 15 Mar 2026 reply
Viewed
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 104 | 44 | 7 | 155 | 15 | 3 | 6 |
- HTML: 104
- PDF: 44
- XML: 7
- Total: 155
- Supplement: 15
- BibTeX: 3
- EndNote: 6
Viewed (geographical distribution)
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
This manuscript proposes a novel precipitation forecast verification (PFV) method, CLPFV, based on self-supervised contrastive learning. The study addresses a meaningful methodological issue, namely, how to develop a comprehensive verification method that is more tolerant of minor forecast errors, more sensitive to substantial errors, and better able to reflect different degrees of error. The basic idea of using data augmentations (displacement, intensity, and area size), together with an improved contrastive loss function, to train a neural network to learn the gradient of forecast errors is both scientifically sound and methodologically elegant. Overall, I find this manuscript valuable and potentially suitable for publication in GMD after minor revision.
Major Comments:
1. In the Introduction, there is a logical gap between the discussion of the limitations of spatial methods and the introduction of deep-learning-based image verification. Please explain more explicitly how the extraction of “high-level abstract features” directly helps address the spatial “double penalty” issue.
2. I suggest adding a short subsection, for example, “2.1 Basic Idea,” to explicitly present the core logic behind the proposed solution to the scientific gap. Part of the second-to-last paragraph of the Introduction already seems to contain this basic idea.
3. In Section 2, the conceptual framework is somewhat mixed with specific technical implementations (e.g., ResNet-18). In my view, the proposed verification framework does not strictly depend on ResNet-18 or InfoNCE. A brief discussion of the portability of this framework in the Discussion section, such as its applicability to other spatial modeling tasks, would further strengthen the methodological contribution of the paper.
4. The simplification of forecast errors into displacement, intensity, and area size is reasonable and useful. However, “area size” may not fully capture all structural errors in real precipitation forecasts. A brief acknowledgement of this limitation would improve the manuscript.
5. The rationale for the quadratic penalty in the improved loss function could be explained more clearly. The current explanation is understandable but somewhat brief. One or two additional sentences on why a quadratic penalty is appropriate here would make the design more transparent.
Minor Comments:
Several acronyms are used in the Abstract (POD, FAR, TS, FSS, SAL) without prior definition. Please ensure that all abbreviations are spelled out at their first occurrence.