the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Forecasting threshold exceedance of atmospheric variables at a specific location
Abstract. Accurate short-term forecasting of extreme weather events is essential for early warning systems and disaster mitigation. This study compares two methodological approaches for predicting, at some given site, threshold exceedances of atmospheric variables such as temperature and wind speed: (i) direct probabilistic methods, which treat exceedance as a binary classification problem and (ii) full distribution probabilistic methods, which model the complete conditional probability law of the target variable. Using theoretical analysis and numerical simulations on a toy model, alongside real-world data from the MeteoNet dataset (2016–2018) for southeastern France, we demonstrate that the full distribution approach consistently outperforms the direct method for rare, extreme events.
This advantage arises because the full distribution approach can effectively learn the parameters of the conditional distribution even from moderate and mild intensity events, thus achieving better calibration and discrimination in the tails. We find that the specific parametric shape of the chosen distribution plays a secondary role compared to accurately capturing predictable shifts in its bulk properties (i.e., mean and variance). This suggests that extreme exceedances are primarily driven by significant conditional
displacements of the entire distribution, rather than by unpredictable, fat-tailed anomalies within a static climatology. Our results are validated for both strong surface wind speeds and intense hourly rainfall, with performance evaluated using proper scoring rules (Brier Score, logarithmic score) and deterministic skill scores (Peirce Skill Score, Critical Success Index, Heidke Skill Score).
These findings highlight the critical importance of modeling the full probability distribution for rare-event forecasting and provide practical guidance for improving extreme weather prediction in operational meteorology.
- Preprint
(2363 KB) - Metadata XML
- BibTeX
- EndNote
Status: final response (author comments only)
-
RC1: 'Comment on egusphere-2026-3111', Anonymous Referee #1, 21 Jul 2026
-
AC1: 'Reply on RC1', Roberta Baggio, 22 Aug 2026
We thank the Reviewer for the careful reading of our manuscript and for the constructive comments. We agree that the scope and novelty of the work were not sufficiently clearly stated in the original version.
As a first revision, we have revised the Introduction to better position our study with respect to the existing literature. In particular, we now discuss previous studies comparing approaches that model threshold-exceedance probabilities directly with methods that first estimate a full conditional predictive distribution and subsequently derive exceedance probabilities from it. We also make clearer that neither of these forecasting paradigms, nor their empirical comparison, are the main scope of the present work.
The main contribution of our study is instead to isolate, in a controlled and analytically tractable setting, the information loss associated with thresholding a continuous predictand and to quantify how its consequences evolve as the event becomes increasingly rare. The chosen toy model yields explicit expressions for the relative prediction errors and for the associated score differences. We agree with the Reviewer that these analytical results apply only under the specific assumptions of the model, and we will make these assumptions and the corresponding scope of the conclusions much more explicit in the revised manuscript.
We nevertheless believe that our approach can be viewed as a first step toward extensions to more complex and realistic settings. At the same time, despite its simplicity, the model may capture relevant features of real-world situations in which conditional fluctuations are driven primarily by variations in the conditional mean, while changes in other characteristics of the conditional distribution, such as its variance, play a secondary role. In this respect, the meteorological applications are intended not as a direct validation of the analytical model, but as an assessment of whether the qualitative mechanism that it isolates persists under more realistic distributional conditions. Their purpose is therefore to examine whether the qualitative rarity-dependent behavior identified in the controlled model remains visible for non-Gaussian atmospheric variables and substantially more flexible predictive distributions. We find the partial but generally consistent agreement across several exceedance-based metrics very interesting, since it suggests that the information-loss mechanism isolated by the toy model may remain relevant beyond the setting in which the analytical results are derived.
Roberta Baggio and Jean-François Muzy
Citation: https://doi.org/10.5194/egusphere-2026-3111-AC1
-
AC1: 'Reply on RC1', Roberta Baggio, 22 Aug 2026
-
RC2: 'Comment on egusphere-2026-3111', Anonymous Referee #2, 21 Aug 2026
Review of “Forecasting threshold exceedance of atmospheric variables at a specific location”, submitted to NHESS, manuscript egusphere-2026-3111
- Major comments
The manuscript by Baggio and Muzy contributes to the important field of building tools for the forecast of severe weather, which is relevant for disasters anticipation and mitigation. They evaluated direct binary classification and full-distribution parametric modeling, and validate their methods in a Mediterranean region of southeastern France for strong near-surface winds and heavy rainfall using ground-station data from Météo-France.
In my view, the manuscript is well organized, uses a correct technical terminology, and presents a research topic that is relevant. However, I found the text difficult to read and understand by a wide and general audience. Although correct, dense mathematical notation and frequent specific terminology makes it complex and difficult to follow. For example, in the results section, despite of the use of ground-based variables that are commonly used for describing meteorological conditions (hourly wind speed and accumulated rainfall), it is somewhat confusing to interpret and connect the Brier and Peirce skill scores to natural weather likelihood.
The manuscript is valuable, but in the current format it is dense and hard to follow, even for researchers in Meteorology and Climate science with good mathematical and statistical training. Without a review in its overall style, I believe the manuscript is more suitable for academic journals in Applied Mathematics or Machine Learning.- Minor comment
. Line 505: Please correct the word “Applicaton” in “4.4 Applicaton results”, which I believe is “Application”.Citation: https://doi.org/10.5194/egusphere-2026-3111-RC2 -
AC2: 'Reply on RC2', Roberta Baggio, 22 Aug 2026
We thank the Reviewer for this valuable and constructive comment. In the revised manuscript, we have strengthened the introduction to make the main message and the scope of our contribution more explicit, which we believe will improve the overall readability of the paper. We acknowledge the Reviewer’s observation that the mathematical notation is cumbersome and that the discussion of the models can be difficult to follow. We will carefully revise these sections to make the presentation more fluid and accessible, notably by streamlining the notation where possible and providing clearer explanations of the main concepts and results. Concerning the evaluation metrics, in particular the Peirce Skill Score and the Brier Skill Score, we consider these measures well suited to the evaluation of threshold-exceedance forecasts, especially for rare events. Nevertheless, we agree that their interpretation, their connection to the climatological frequency of the events considered, and the implications of the reported results should be explained more clearly. We will revise the corresponding discussion accordingly.
Roberta Baggio and Jean-François Muzy
Citation: https://doi.org/10.5194/egusphere-2026-3111-AC2
-
AC2: 'Reply on RC2', Roberta Baggio, 22 Aug 2026
Viewed
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 121 | 67 | 12 | 200 | 12 | 12 |
- HTML: 121
- PDF: 67
- XML: 12
- Total: 200
- BibTeX: 12
- EndNote: 12
Viewed (geographical distribution)
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
Please find my comments in the attached pdf.