A climate similarity-based transfer learning framework using global Caravan dataset for enhancing streamflow prediction in Ouémé River Basin (Benin, West Africa)
Abstract. Reliable streamflow forecasting is a fundamental component of flood risk management. However, the accuracy of such forecasts in data-scarce river basins remains one of the pressing challenges in most African catchments. While Long Short-Term Memory (LSTM) networks have demonstrated their effectiveness in rainfall-runoff modelling, their data-intensive requirements limit their direct applicability in poorly gauged catchments across sub-Saharan Africa. To address this issue, we propose a climate similarity-based transfer learning framework using the global Caravan hydrological dataset to improve local streamflow forecasting in Ouémé River Basin (ORB). Specifically, tropical-climate catchments are first identified from Caravan global dataset using the Köppen-Geiger climate classification. A composite climate similarity index (CI) is constructed from two normalized climate indices: annual mean precipitation and seasonality index. 200 basins were selected and ranked by CI. From the 200 ranked basins, a fixed subset of 50 basins was selected using stratified sampling across CI quartiles, including 30 basins for validation and 20 basins for independent testing. The remaining 150 basins were then used to define three cumulative pre-training subsets of increasing size (50, 100, and 150 basins), ranked by CI. Different LSTM models are pre-trained on each subset and fine-tuned on the ORB streamflow. The developed transfer learning models are evaluated against the LSTM model trained exclusively on local data as a baseline model. Pre-training improves prediction at all five stations, raising the median Kling–Gupta Efficiency from 0.65 for the local model to 0.75 for the best transfer configuration. The smallest, most climatically similar donor subset gives the best fine-tuning performance; adding less similar catchments does not help and slightly degrades it. The benefit is largest at stations with short or event-poor records and marginal at the well-gauged basin outlet, while peak flows remain underestimated across all configurations. These results show that, for data-scarce tropical basins, the climatic similarity of the transfer basins matters more than their number, and they point to similarity-guided donor selection combined with peak-weighted or hybrid formulations as a practical route to operational flood forecasting.
This manuscript presents a climate-similarity-based transfer learning framework using the Caravan dataset to improve LSTM-based streamflow prediction in the Ouémé River Basin. The study addresses a relevant problem and has potential practical value for data-scarce regions. However, the current experimental design does not adequately disentangle the effects of donor-set size and climatic similarity, leaving the central conclusion insufficiently supported. The construction and calibration of CI, the fine-tuning implementation, and several equations and references also require clarification or correction. I therefore recommend major revision, with particular attention to methodological reproducibility and the evidence supporting the claimed value of similarity-based donor selection. My specific comments are as follows.
1. The current experimental design cannot disentangle the effects of donor-set size and climatic similarity
The study constructs cumulative donor sets of 50, 100, and 150 catchments based on their CI rankings. As the number of donor catchments increases, the climatic similarity and other characteristics of the donor-set composition also change. Therefore, the current experiments can compare the performance of three specific donor sets but cannot independently attribute performance differences to donor-set size or climatic similarity. The conclusion that “similarity outweighs volume” is thus not sufficiently supported.
I recommend adding, at a minimum, repeated random-selection experiments with a fixed donor-set size. For example, 50 donor catchments could be randomly selected multiple times from the candidate pool after excluding the fixed validation and test catchments, and compared with the 50 catchments selected using CI. The target-basin data, training procedures, and evaluation conditions should remain consistent across these experiments. This comparison is essential for establishing the added value of CI-based selection. Uncertainty arising from donor sampling and random network initialization should be assessed separately, with station-level paired performance differences and performance distributions across repeated experiments reported.
As an additional comparison, the authors could consider donor selection based on predictive performance, as measured by KGE. However, they should clarify whether the selection metric is calculated for the donor catchments themselves or for the target basin, and ensure that the final test data are not used for donor selection.
The authors already acknowledge that the optimal donor-set size may be smaller than 50, and the abstract and conclusions should be consistent with this limitation. At present, the 50-catchment set should be described only as “the best overall configuration among those tested under the current training setup,” rather than as an established optimum or a universal threshold. Sensitivity experiments involving a few smaller donor sets could strengthen the analysis, but they cannot replace comparisons of selection strategies at a fixed donor-set size.
2. Key equations contain errors or inconsistencies in units
The streamflow conversion in Equation (1) is inconsistent with the stated units of catchment area. If SS is expressed in square metres, the conversion factor of 1000 should appear in the numerator when converting volumetric discharge to millimetres per day. If SS is expressed in square kilometres, the existing equation is correct, but the stated area unit must be revised. Please specify the area units used in the actual implementation and confirm that the target-basin and Caravan streamflow data are on a consistent scale.
The Spearman correlation formula in Equation (2) is missing the squared rank-difference term. The standard formula for observations without tied ranks uses d2, not d.
Please clarify whether these issues are limited to the written equations or also affect the actual calculations. If they affect the implementation, the relevant data, CI weights, and donor rankings should be recalculated, and the affected experiments should be repeated.
3. The output-layer fine-tuning strategy and implementation of the local baseline require further explanation
The manuscript states that the LSTM body is frozen during fine-tuning and that only the 256 weights and one bias of the output regression layer are updated. Thus, the approach involves output-layer adaptation rather than retraining the entire LSTM network. Please explain the rationale for this strategy and ensure that the discussion of local adaptation is consistent with the actual scope of parameter updates, distinguishing between “recombining pre-trained features” and “relearning the LSTM’s internal temporal representations.”
To ensure reproducibility and a clear baseline comparison, please specify in the main text or supplementary material whether the five target stations are fine-tuned separately or jointly; whether the local baseline uses the same multi-station training arrangement; the input sequence length; how static attributes are incorporated; how missing data are handled; how inputs and outputs are standardized and how this standardization is handled across training stages; and the rules used to select model checkpoints. Dynamic inputs should be clearly distinguished from prediction targets, particularly because Section 2.2.1 currently also lists “streamflow discharge” as forcing data.
Figure 7 already compares direct transfer, fine-tuned models, and the locally trained baseline. The discussion should distinguish between two types of improvement: gains relative to direct transfer reflect the benefits of local adaptation, whereas gains relative to training from scratch on local data more directly indicate the added value of pre-training.
If the authors intend to generalize the donor-ranking conclusions to fine-tuning strategies more broadly, I recommend a targeted comparison involving different extents of layer freezing. Otherwise, the conclusions should be explicitly limited to the current output-layer-only fine-tuning setup.
4. Several key in-text citations do not match the corresponding reference-list entries and require systematic checking
Based on the references currently listed in the manuscript, at least the following clear mismatches are present.
Song et al. (2025) is cited to support the limited performance of deep-learning hydrological models in reproducing extreme events, but the corresponding reference is a medical study on the diagnosis of cerebral edema.
Yao et al. (2022) is cited to support the reduced effectiveness of transfer learning in headwater catchments with strong groundwater contributions, but the corresponding reference is a review of transfer learning for machinery diagnostics and prognostics.
Yang et al. (2023) is described as a study of soil moisture estimation on the Qinghai–Tibet Plateau, whereas the corresponding reference concerns runoff prediction using a dynamic spatiotemporal graph neural network.
These issues concern the accuracy of the supporting evidence, not merely reference formatting. Please systematically check that the cited studies support the associated claims and revise both the main text and the reference list accordingly. The same paper by Frame et al. is also listed twice as 2022a and 2022b; these duplicate entries should be merged.
5. Remove the duplicated sentence
On page 8, line 210, “as the validation and test set throughout all experiments (Figure 3)” repeats the ending of the preceding sentence and should be deleted.
6. Shorten the general background in the Methods section
The opening of Section 2.4 mainly describes the general advantages and architecture of LSTMs, with limited relevance to the specific model setup used in this study. Please condense material that overlaps with the Introduction and use the space to clarify the model implementation, input organization, and training procedures.
7. Correct the figure references
In Section 3.1, the references to “Figure 5a” and “Figure 5b” in the descriptions of the climate-deviation distributions and weight calibration should be changed to “Figure 4a” and “Figure 4b,” respectively.
8. Use consistent model-stage terminology and clarify the samples represented in Figure 6
Section 2.4 defines LSTM1–3 as the three fine-tuned models, whereas Figure 6 uses the same labels for the pre-trained configurations. Using the same labels across stages is acceptable, but the pre-trained and fine-tuned model states should be clearly distinguished. Figure 6 should also specify that 50, 100, and 150 refer to the numbers of training donor catchments, whereas validation and testing use fixed sets of 30 and 20 catchments, respectively. This clarification is needed to avoid ambiguity about the samples represented by the different boxplots.