Preprints
https://doi.org/10.5194/egusphere-2023-1100
https://doi.org/10.5194/egusphere-2023-1100
05 Jun 2023
 | 05 Jun 2023

DEUCE v1.0: A neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties

Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen

Abstract. Precipitation nowcasting (forecasting locally for 0–6 h) serves both public security and industries, facilitating the mitigation of losses incurred due to e.g. flash floods, and is usually done by predicting weather radar echoes, which provides better performance than NWP at that scale. Probabilistic nowcasts are especially useful as they provide a desirable framework for operational decision-making. Many extrapolation-based statistical nowcasting methods exist, but they all suffer from a limited ability to capture the nonlinear growth and decay of precipitation, leading to a recent paradigm shift towards deep learning methods, more capable of representing these patterns.

Despite of its potential advantages, the application of deep learning in probabilistic nowcasting has only recently started to be explored. Here we develop a novel probabilistic precipitation nowcasting method, based on Bayesian neural networks with variational inference and the U-Net architecture, named DEUCE. The method estimates the total predictive uncertainty of precipitation by combining estimates of the epistemic (knowledge-related, reducible) and heteroscedastic aleatoric (data-dependent, irreducible) uncertainties, and produces an ensemble of development scenarios for the following 60 minutes.

DEUCE is trained and verified using Finnish Meteorological Institute radar composites against established classical models. Our model is found to produce both skillful and reliable probabilistic nowcasts based on various evaluation criteria. It improves ROC Area Under the Curve scores 1–5 % over STEPS and LINDA-P baselines, and comes close to the best-performer STEPS on a CRPS metric. The reliability of DEUCE is demonstrated with, e.g., having the lowest Expected Calibration Error at 20 and 25 dBZ reflectivity thresholds, and coming second at 35 dBZ. On the other hand, deterministic performance of ensemble means is found to be worse than that of extrapolation and LINDA-D baselines. Lastly, the composition of the predictive uncertainty is analysed and described, with the conclusion that aleatoric uncertainty is more significant and informative than epistemic uncertainty in the DEUCE model.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.

Journal article(s) based on this preprint

14 May 2024
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024,https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-1100', Anonymous Referee #1, 25 Sep 2023
    • AC1: 'Reply on RC1', Bent Harnist, 06 Nov 2023
  • RC2: 'Comment on egusphere-2023-1100', Anonymous Referee #2, 09 Oct 2023
    • AC2: 'Reply on RC2', Bent Harnist, 06 Nov 2023
    • AC3: 'Supplement for the reply on RC2', Bent Harnist, 07 Nov 2023

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-1100', Anonymous Referee #1, 25 Sep 2023
    • AC1: 'Reply on RC1', Bent Harnist, 06 Nov 2023
  • RC2: 'Comment on egusphere-2023-1100', Anonymous Referee #2, 09 Oct 2023
    • AC2: 'Reply on RC2', Bent Harnist, 06 Nov 2023
    • AC3: 'Supplement for the reply on RC2', Bent Harnist, 07 Nov 2023

Peer review completion

AR: Author's response | RR: Referee report | ED: Editor decision | EF: Editorial file upload
AR by Bent Harnist on behalf of the Authors (13 Nov 2023)  Author's response   Author's tracked changes   Manuscript 
ED: Referee Nomination & Report Request started (09 Jan 2024) by Shu-Chih Yang
RR by Jatan Buch (16 Jan 2024)
ED: Publish subject to minor revisions (review by editor) (27 Feb 2024) by Shu-Chih Yang
AR by Bent Harnist on behalf of the Authors (08 Mar 2024)  Author's response   Author's tracked changes   Manuscript 
ED: Publish as is (24 Mar 2024) by Shu-Chih Yang
AR by Bent Harnist on behalf of the Authors (26 Mar 2024)

Post-review adjustments

AA: Author's adjustment | EA: Editor approval
AA by Bent Harnist on behalf of the Authors (03 May 2024)   Author's adjustment   Manuscript
EA: Adjustments approved (09 May 2024) by Shu-Chih Yang

Journal article(s) based on this preprint

14 May 2024
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024,https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen

Data sets

Data for the manuscript "DEUCE v1.0: A neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties" by Harnist et al. (2023) Bent Harnist, Seppo Pulkkinen, Terhi Mäkinen https://doi.org/10.23728/fmi-b2share.3efcfc9080fe4871bd756c45373e7c11

Model code and software

fmidev/deuce-nowcasting: Initial release of the source code for the manuscript Bent Harnist https://doi.org/10.5281/zenodo.7961955

Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen

Viewed

Total article views: 688 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
403 249 36 688 22 18
  • HTML: 403
  • PDF: 249
  • XML: 36
  • Total: 688
  • BibTeX: 22
  • EndNote: 18
Views and downloads (calculated since 05 Jun 2023)
Cumulative views and downloads (calculated since 05 Jun 2023)

Viewed (geographical distribution)

Total article views: 676 (including HTML, PDF, and XML) Thereof 676 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 14 May 2024
Download

The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.

Short summary
Probabilistic precipitation nowcasting (local forecasting for 0–6 hours) is crucial for reducing damage from events like flash floods. For this goal, we propose the DEUCE neural network-based model, which uses data and model uncertainties to generate an ensemble of potential precipitation development scenarios for the next hour. Trained and evaluated with Finnish precipitation composites, DEUCE was found to produce more skillful and reliable nowcasts than established models.