Preprints
https://doi.org/10.5194/egusphere-2026-958
https://doi.org/10.5194/egusphere-2026-958
04 Mar 2026
 | 04 Mar 2026
Status: this preprint is open for discussion and under review for Geoscientific Model Development (GMD).

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Jung Choi, Jiwoo Lee, Kristin Chang, Paul A. Ullrich, Peter J. Gleckler, and Sang-Yoon Jun

Abstract. Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

Competing interests: At least one of the (co-)authors is a member of the editorial board of Geoscientific Model Development.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
Share
Jung Choi, Jiwoo Lee, Kristin Chang, Paul A. Ullrich, Peter J. Gleckler, and Sang-Yoon Jun

Status: open (until 29 Apr 2026)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Jung Choi, Jiwoo Lee, Kristin Chang, Paul A. Ullrich, Peter J. Gleckler, and Sang-Yoon Jun
Jung Choi, Jiwoo Lee, Kristin Chang, Paul A. Ullrich, Peter J. Gleckler, and Sang-Yoon Jun
Metrics will be available soon.
Latest update: 04 Mar 2026
Download
Short summary
As climate risks grow, society needs reliable predictions for the coming years and decades. We developed a framework to collectively compare climate prediction systems and examine their performances on global temperature, rainfall, and sea ice. As a complementary to traditional analyses, our new framework offers tracking evolution of model performance in simulation time, helping scientists and stakeholders better understand strengths and limits of decadal climate prediction.
Share