the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell
Abstract. Long Short-Term Memory (LSTM) networks have demonstrated state-of-the-art performance for rainfall-runoff hydrological modeling. However, most studies focus on daily-scale predictions, limiting the benefits of sub-daily (e.g. hourly) predictions in applications like flood forecasting. Moreover, training an LSTM exclusively on sub-daily data is computationally expensive, and may lead to model-learning difficulties due to the extended sequence lengths. In this study, we introduce a new architecture, multi-frequency LSTM (MF-LSTM), designed to use input of various temporal frequencies to produce sub-daily (e.g. hourly) predictions at a moderate computational cost. Building on two existing methods previously proposed by coauthors of this study, the MF-LSTM processes older inputs at coarser temporal resolutions than more recent ones. The MF-LSTM gives the possibility to handle different temporal frequencies, with different number of input dimensions, in a single LSTM cell, enhancing generality and simplicity of use. Our experiments, conducted on 516 basins from the CAMELS-US dataset, demonstrate that MF-LSTM retains state-of-the-art performance while offering a simpler design. Moreover, the MF-LSTM architecture reported a 5x reduction in processing time, compared to models trained exclusively on hourly data.
- Preprint
(1345 KB) - Metadata XML
- BibTeX
- EndNote
Status: open (until 23 Jan 2025)
-
RC1: 'Comment on egusphere-2024-3355', Anonymous Referee #1, 06 Jan 2025
reply
The paper addresses the challenge of predicting sub-daily forecasts. In such cases, sub-daily inputs are utilized to achieve optimal performance. However, when longer dependencies are present, processing this data at a sub-daily resolution can be quite time-consuming, as both sub-daily and monthly information may be required.
The authors introduce a simple and innovative approach to handle both short and long dependencies using the same LSTM model. They demonstrate that LSTM can effectively manage data with different frequencies by incorporating a label that indicates the data frequency, without sacrificing performance. Additionally, they show that LSTM can accommodate varying numbers of inputs at different frequencies by including an embedding layer before the LSTM.
These findings apply to any forecasting problem involving multiple time dependencies, suggesting that the proposed approach could have widespread utility.
The paper is well-written, with clear results, and I believe it should be accepted with minor comments.
Minor comments:
Line 25-26: I believe that one year is insufficient to capture groundwater behavior due to the longer residence times in these systems. Even in snowmelt-dominated catchments, additional memory may be necessary if snow accumulates between years. If you wish to retain this sentence, you must include a reference to support this assertion or refrain from mentioning specific processes.
Line 98: It would be helpful to provide a brief explanation of the example before presenting any values. For example, Why are you using 351?
Line 106-107: This section indicates that the value of 351 is arbitrary and that any other value could be used. If this is the case, does it imply that this value is a hyperparameter? How should it be estimated? Additionally, how do you determine the duration when dealing with hourly, daily, and monthly periods?
Line 159: You mentioned that the median KGE was similar, but what about the entire distribution (CDF)? If there are no significant differences, you could include the figure in the appendix. Did you consider extending the sequence beyond one year, particularly since you can now process longer sequences with reduced computational costs?
Citation: https://doi.org/10.5194/egusphere-2024-3355-RC1 -
AC1: 'Reply on RC1', Eduardo Acuna, 15 Jan 2025
reply
We want to thank the referee for the detailed evaluation of our paper. In the attached document, we answer the questions, comments and suggestions given.
-
AC1: 'Reply on RC1', Eduardo Acuna, 15 Jan 2025
reply
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
198 | 62 | 4 | 264 | 2 | 3 |
- HTML: 198
- PDF: 62
- XML: 4
- Total: 264
- BibTeX: 2
- EndNote: 3
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1