Preprints
https://doi.org/10.5194/egusphere-2023-3049
https://doi.org/10.5194/egusphere-2023-3049
05 Mar 2024
 | 05 Mar 2024
Status: this preprint is open for discussion.

Equifinality Contaminates the Sensitivity Analysis of Process-Based Snow Models

Tek Kshetri, Amir Khatibi, Yiwen Mok, Shahabul Alam, Hongli Liu, and Martyn P. Clark

Abstract. This study assesses the impact of different flux parameterizations and model parameters on simulations of snow depth. Through a sensitivity analysis in a process-based snow model based on the SUMMA framework, various options for parametrizing snow processes and adjusting parameter values were evaluated to identify optimal modeling approaches, understand sources of uncertainty, and determine reasons for model weaknesses. The study focused on model parameterizations of precipitation partitioning, liquid water flow, snow albedo, atmospheric stability, and thermal conductivity. In this study, sensitivity analysis (SA) is performed using the one-at-a-time (OAT) SA method as well as the Morris Method to estimate Elementary Effects, aiming to further explore the magnitudes and patterns of sensitivities. The sensitivity analyses in this study are used to evaluate process parameterizations, model parameter values, and model configurations. Performance metrics such as the Nash-Sutcliffe Efficiency (NSE), the Kling-Gupta Efficiency (KGE), the root mean squared log error (RMSLE), and mean are used to assess the similarity between simulated and observed data. Bootstrapping is employed to estimate the variability of mean Elementary Effects and establish confidence bounds. The key findings of this research indicate that sensitivity analysis of snow modelling parameters plays a crucial role in understanding their impact on decision outcomes. The study identified the most sensitive parameters, such as critical temperature and thermal conductivity of snow, as well as liquid water drainage parameters. It was observed that water balance fluxes exhibited higher sensitivity than energy balance fluxes in simulating snow processes. The analysis also highlighted the importance of accurately representing water balance processes in snow models for improved accuracy and reliability. A key finding in this study is that the sensitivity of performance metrics to model parameters is contaminated by equifinality (i.e., parameter perturbations lead to similar performance metrics for quite different snow depth time series), and hence many published parameter sensitivity studies may provide misleading results. These findings have implications for snow hydrology research and water resource management, providing valuable insights for optimizing snow modelling and enhancing decision-making.

Tek Kshetri, Amir Khatibi, Yiwen Mok, Shahabul Alam, Hongli Liu, and Martyn P. Clark

Status: open (until 16 May 2024)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Tek Kshetri, Amir Khatibi, Yiwen Mok, Shahabul Alam, Hongli Liu, and Martyn P. Clark
Tek Kshetri, Amir Khatibi, Yiwen Mok, Shahabul Alam, Hongli Liu, and Martyn P. Clark

Viewed

Total article views: 238 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
189 39 10 238 9 9
  • HTML: 189
  • PDF: 39
  • XML: 10
  • Total: 238
  • BibTeX: 9
  • EndNote: 9
Views and downloads (calculated since 05 Mar 2024)
Cumulative views and downloads (calculated since 05 Mar 2024)

Viewed (geographical distribution)

Total article views: 254 (including HTML, PDF, and XML) Thereof 254 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 26 Apr 2024
Download
Short summary
This study reveals a crucial discovery: when tweaking model parameters, similar performance metrics might mislead—different parameter settings can yield comparable results in snow depth predictions. This "equifinality" challenges past studies, suggesting that evaluating model tweaks based on performance alone might not reflect actual variations in snow depth forecasts.