Preprints
https://doi.org/10.5194/egusphere-2026-3142
https://doi.org/10.5194/egusphere-2026-3142
31 Jul 2026
 | 31 Jul 2026
Status: this preprint is open for discussion and under review for Geoscientific Model Development (GMD).

Topology-Preserving State Space Representation for Diagnosing Weather Forecast Models

Hyoungnyoun Kim and Jeong Hoon Cho

Abstract. The evaluation of AI-based medium-range weather forecast models commonly relies on pointwise error metrics such as the root-mean-square error (RMSE), which provide useful quantitative summaries but do not directly show how multivariate forecast states evolve in relation to the observed atmospheric state. This study proposes a trajectory-based diagnostic framework built on a topology-preserving state space for visually and quantitatively comparing forecast behavior across different AI weather forecast models. Multivariate atmospheric states are represented using 850 hPa temperature, geopotential height, zonal wind, and meridional wind fields, and a shared state space is constructed through image-based feature extraction, contrastive learning, and manifold embedding. The framework is applied to forecasts from FourCastNet2, GraphCast, and Pangu-Weather under different initial-condition settings, with forecast sequences represented as trajectories in the learned state space. The results show that the proposed representation provides an intuitive way to compare model-dependent forecast evolution, identify regions of relatively good or poor trajectory behavior, and examine state- or season-dependent differences that are not readily summarized by variable-wise RMSE curves alone. The proposed framework is therefore intended as a complementary diagnostic tool for interpreting AI-based weather forecast models, rather than as a replacement for conventional verification metrics.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
Share
Hyoungnyoun Kim and Jeong Hoon Cho

Status: open (until 25 Sep 2026)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Hyoungnyoun Kim and Jeong Hoon Cho

Data sets

Topology-Preserving State Space Representation for Diagnosing Weather Forecast Models: Code and Reproduction Package Hyoungnyoun Kim https://doi.org/10.5281/zenodo.20483795

Model code and software

Topology-Preserving State Space Representation for Diagnosing Weather Forecast Models: Code and Reproduction Package Hyoungnyoun Kim https://doi.org/10.5281/zenodo.20483795

Hyoungnyoun Kim and Jeong Hoon Cho
Metrics will be available soon.
Latest update: 31 Jul 2026
Download
Short summary
Weather forecast models are usually compared using numerical error scores such as RMSE, but these scores do not clearly show how predicted weather patterns evolve over time. This study places multivariate atmospheric states into a shared two-dimensional space and represents each AI forecast as a trajectory. This allows different forecast models to be compared visually and helps identify model-dependent and season-dependent behavior that is difficult to see from conventional error curves alone.
Share