Preprints
https://doi.org/10.5194/egusphere-2026-4605
https://doi.org/10.5194/egusphere-2026-4605
04 Nov 2026
 | 04 Nov 2026
Status: this preprint is open for discussion and under review for Geoscientific Model Development (GMD).

A scale-invariant evaluation framework for geoscientific scalar time-series models: demonstration with wave model validation

Fayun Wang

Abstract. In the validation of geoscientific scalar time-series models, the selection of evaluation metrics is often based on experience and conventions, lacking a systematic design framework. Moreover, commonly used metrics are predominantly dimensional error measures whose values are inherently tied to the magnitude of the variable being assessed, making fair comparisons across different stations or datasets difficult. To address these issues, this study proposes a scale-invariant evaluation framework termed the "Golden Triangle", consisting of the range-normalized root mean square error (NRMSE), the range-normalized mean absolute error (NMAE), and the Pearson correlation coefficient (PCC). It is mathematically proven that all three metrics possess scale invariance, meaning their evaluation results are unaffected by the absolute magnitude of the variable, thereby enabling direct cross-station and cross-dataset comparisons. The three metrics capture extreme error sensitivity, average error level, and trend consistency, respectively, complementing one another to form a multi-dimensional diagnostic capability and providing a systematic design framework for metric selection. An empirical case study using data from four global deep-sea buoys and two wave reanalysis models demonstrates that the "Golden Triangle" framework effectively eliminates the influence of wave height magnitude differences among stations, overcomes the cross-station ranking distortion caused by dimensional dependence, and yields reasonable performance rankings. Furthermore, in the comparison between the full dataset and the high-energy-state dataset, the framework exhibits excellent consistency, confirming its reliability and sensitivity to extreme events. The "Golden Triangle" framework offers a logically coherent and generalizable evaluation tool for the validation of geoscientific scalar time-series models.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
Share
Fayun Wang

Status: open (until 30 Dec 2026)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Fayun Wang
Metrics will be available soon.
Latest update: 04 Nov 2026
Download
Short summary
Geoscientific scalar models for waves, temperature and precipitation are usually assessed using error metrics. However, these metrics are affected by data magnitude, making fair cross-station comparisons difficult. This study proposes a "Golden Triangle" evaluation framework. Supported by mathematical proof and case validation, it offers a unified, fair and generalizable tool to help standardize model validation practices.
Share