Preprints
https://doi.org/10.5194/egusphere-2023-666
https://doi.org/10.5194/egusphere-2023-666
20 Apr 2023
 | 20 Apr 2023

Towards Interpretable LSTM-based Modelling of Hydrological Systems

Luis Andres De la Fuente, Mohammad Reza Ehsani, Hoshin Vijai Gupta, and Laura E. Condon

Abstract. Several studies have demonstrated the ability of Long Short-Term Memory (LSTM) machine learning based modeling to outperform traditional spatially lumped process-based modeling approaches for streamflow prediction. However, due mainly to the structural complexity of the LSTM network (which includes gating operations and sequential processing of the data), difficulties can arise when interpreting the internal processes and weights in the model.

Here, we propose and test a modification of LSTM architecture that represents internal system processes in a manner that is analogous to a hydrological reservoir. Our architecture, called HydroLSTM, simulates behaviors inherent in a dynamic system, such as sequential updating of the Markovian storage. Specifically, we modify how data is fed to the new representation to facilitate simultaneous access to past lagged inputs, thereby explicitly acknowledging the importance of trends and patterns in the data.

We compare the performance of the HydroLSTM and LSTM architectures using data from 10 hydro-climatically varied catchments. We further examine how the new architecture exploits the information in lagged inputs, for 588 catchments across the USA. The HydroLSTM-based models require fewer cell states to obtain similar performance to their LSTM-based counterparts. Further, the weights patterns associated with lagged input variables are interpretable and consistent with regional hydroclimatic characteristics (snowmelt-dominated, recent rainfall-dominated, and historical rainfall-dominated). These findings illustrate how the hydrological interpretability of LSTM-based models can be enhanced by appropriate architectural modifications that are physically and conceptually consistent with our understanding of the system.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Luis Andres De la Fuente, Mohammad Reza Ehsani, Hoshin Vijai Gupta, and Laura E. Condon

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • CC1: 'Comment on egusphere-2023-666', Grey Nearing, 22 Apr 2023
    • AC1: 'Reply on CC1', Luis De La Fuente, 29 Apr 2023
  • RC1: 'Comment on egusphere-2023-666', Tadd Bindas, 30 May 2023
    • AC2: 'Reply on RC1', Luis De La Fuente, 15 Jun 2023
  • RC2: 'Comment on egusphere-2023-666', Anonymous Referee #2, 15 Jun 2023
    • AC3: 'Reply on RC2', Luis De La Fuente, 06 Jul 2023
  • RC3: 'Comment on egusphere-2023-666', Anonymous Referee #3, 18 Jul 2023
    • AC4: 'Reply on RC3', Luis De La Fuente, 31 Jul 2023

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • CC1: 'Comment on egusphere-2023-666', Grey Nearing, 22 Apr 2023
    • AC1: 'Reply on CC1', Luis De La Fuente, 29 Apr 2023
  • RC1: 'Comment on egusphere-2023-666', Tadd Bindas, 30 May 2023
    • AC2: 'Reply on RC1', Luis De La Fuente, 15 Jun 2023
  • RC2: 'Comment on egusphere-2023-666', Anonymous Referee #2, 15 Jun 2023
    • AC3: 'Reply on RC2', Luis De La Fuente, 06 Jul 2023
  • RC3: 'Comment on egusphere-2023-666', Anonymous Referee #3, 18 Jul 2023
    • AC4: 'Reply on RC3', Luis De La Fuente, 31 Jul 2023
Luis Andres De la Fuente, Mohammad Reza Ehsani, Hoshin Vijai Gupta, and Laura E. Condon
Luis Andres De la Fuente, Mohammad Reza Ehsani, Hoshin Vijai Gupta, and Laura E. Condon

Viewed

Total article views: 1,443 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
963 434 46 1,443 34 29
  • HTML: 963
  • PDF: 434
  • XML: 46
  • Total: 1,443
  • BibTeX: 34
  • EndNote: 29
Views and downloads (calculated since 20 Apr 2023)
Cumulative views and downloads (calculated since 20 Apr 2023)

Viewed (geographical distribution)

Total article views: 1,438 (including HTML, PDF, and XML) Thereof 1,438 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 07 Nov 2024
Download
Short summary
Long Short-Term Memory (LSTM) is a widely-used machine learning (ML) model in hydrology. However, it is difficult to extract knowledge from it. We propose HydroLSTM which represents processes analogous to a hydrological reservoir. Models using HydroLSTM perform similarly to LSTM but require fewer cell states. The learned parameters are informative about the dominant hydroclimatic characteristics of a catchment. Our results demonstrate how hydrological knowledge is encoded in the new structure.