Preprints
https://doi.org/10.5194/egusphere-2022-815
https://doi.org/10.5194/egusphere-2022-815
21 Oct 2022
 | 21 Oct 2022

A methodological framework for improving the performance of data-driven models, a case study for daily runoff prediction in the Maumee domain, U.S.

Yao Hu, Chirantan Ghosh, and Siamak Malakpour-Estalaki

Abstract. Geoscientific models are simplified representations of complex earth and environmental systems (EESs). Compared with physics-based numerical models, data-driven modeling has gained popularity due mainly to data proliferation in EESs and the ability to perform prediction without requiring explicit mathematical representation of complex biophysical processes. However, because of the black-box nature of data-driven models, their performance cannot be guaranteed. To address this issue, we developed a generalizable framework for the improvement of the efficiency and effectiveness of model training and the reduction of model overfitting. This framework consists of two parts: hyperparameter selection based on Sobol global sensitivity analysis, and hyperparameter tuning using a Bayesian optimization approach. We demonstrated the framework efficacy through a case study of daily edge-of-field (EOF) runoff predictions by a tree-based data-driven model using eXtreme Gradient Boosting (XGBoost) algorithm in the Maumee domain, U.S. This framework contributes towards improving the performance of a variety of data-driven models and can thus help promote their applications in EESs.

Yao Hu et al.

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2022-815', Anonymous Referee #1, 04 Dec 2022
    • AC1: 'Reply on RC1', Yao Hu, 02 Feb 2023
  • RC2: 'Comment on egusphere-2022-815', Anonymous Referee #2, 09 Jan 2023
    • AC2: 'Reply on RC2', Yao Hu, 02 Feb 2023
    • AC3: 'Reply on RC2', Yao Hu, 02 Feb 2023

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2022-815', Anonymous Referee #1, 04 Dec 2022
    • AC1: 'Reply on RC1', Yao Hu, 02 Feb 2023
  • RC2: 'Comment on egusphere-2022-815', Anonymous Referee #2, 09 Jan 2023
    • AC2: 'Reply on RC2', Yao Hu, 02 Feb 2023
    • AC3: 'Reply on RC2', Yao Hu, 02 Feb 2023

Yao Hu et al.

Yao Hu et al.

Viewed

Total article views: 307 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
223 71 13 307 3 3
  • HTML: 223
  • PDF: 71
  • XML: 13
  • Total: 307
  • BibTeX: 3
  • EndNote: 3
Views and downloads (calculated since 21 Oct 2022)
Cumulative views and downloads (calculated since 21 Oct 2022)

Viewed (geographical distribution)

Total article views: 301 (including HTML, PDF, and XML) Thereof 301 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 21 Mar 2023
Download
Short summary
Data-driven models (DDMs) gain popularity in earth and environmental systems due mainly to the advancements in data collection techniques and artificial intelligence (AI). The performance of such models is determined by the underlying machine learning (ML) algorithms. In this study, we develop a framework to improve the model performance by optimizing ML algorithms. We demonstrate the effectiveness of the framework using a DDM to predict edge-of-field runoff in the Maumee domain, U.S.