the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Infilling of Missing Rainfall Radar Data with a Memory-Assisted Deep Learning Approach
Abstract. Incomplete spatio-temporal meteorological observations can result in misinterpretations of the current climate state, uncertainties in early warning systems, or inaccuracies in nowcasting models and can thereby pose signficant challanges in hydrology research or similar applications. Traditional statistical methods for infilling missing precipitation data demand substantial computational resources and fail over large areas with sparse data – like temporary outages of weather radars. Although recent machine learning advancements have shown promise in addressing missing meteorological or satellite observations, they typically focus on spatial aspects, overlooking the complex spatio-temporal variability characteristic of precipitation, especially during extreme events. We propose a deep convolutional neural network enhanced with a temporal memory component to better account for temporal changes in precipitation fields. This approach can analyse arbitrary sequences from before and/or after the incomplete observation of interest. Our model is trained and evaluated on the hourly RADKLIM dataset, which features 1-km resolution precipitation derived from combined radar and weather station data across Germany. By infilling both synthetic and actual data gaps of RADKLIM, the study demonstrates the model's effectiveness, providing detailed insights into its capabilities during significant rainfall events, such as those in May 2012 and July 2021, including those responsible for the Ahrtal flood. This novel approach represents a step forward in hydrological applications, potentially improving the way we predict and manage water-related events by increasing the accuracy and reliability of precipitation data analysis.
- Preprint
(10857 KB) - Metadata XML
- BibTeX
- EndNote
Status: final response (author comments only)
-
RC1: 'Comment on egusphere-2024-1392', Anonymous Referee #1, 17 Dec 2024
The study of Meuer et al entitled “Infilling of Missing Rainfall Radar Data with a Memory-Assisted Deep Learning Approach” explores the use of machine learning for infilling of the RADOLAN precipitation product of the German Weather Service. The approach comprises a comparison with baseline and channel-based results. Although the proposed method is technically more demanding, it results in increased accuracy and in filled data gaps respecting the temporal and spatial pattern of the precipitation event.
The manuscript is written in a concise way, is well-structured and makes use of good English. However, to my impression, the actual discussion is missing and only few remarks could be interpreted as discussion. Therefore, please enlarge the discussion part and make use of more references to guide the interpretation. In this context, a broader discussion on the uncertainty of each infilling technique would also help to improve this section. Why were the events of May 2012 and July 2021 presented only?
To conclude, the manuscript requires further improvements my opinion before recommending it for publication in this journal.
Specific comments:
- 1, l. 2: “challenges”
p.2, l. 24: Please correct the figure number
- 3, l. 63: “depending” instead of “pending”
- 3, l. 70: Please add the specific product name (RADOLAN YW and RADOLAN RW)
- 4, l. 90: Please introduce the abbreviation
- 4, l. 95: this fact deserves a reference
- 5, l. 116: this reference is given twice, please remove one
- 9, l.189 – p.10, l. 191: please specify the hardware resources you used and give advice on some minimal requirement
- 10, l. 193: this may be the true final step, while “final” was already used on p. 7, l. 174. Please correct this.
Figure 1: Please add to the caption the data source and reference to the product.
Figure 7. The caption is the same as the one of Figure E1 although the maps are different. Please check the captions.
Citation: https://doi.org/10.5194/egusphere-2024-1392-RC1 -
RC2: 'Comment on egusphere-2024-1392', Anonymous Referee #2, 09 Jan 2025
## General comments
The authors propose and analyze a new approach to the interpolation of values for incomplete precipitation maps. The authors motivate their study by explaining that such interpolation is often necessary as result of various factors, such as radar outages. They explain the structure of their “channel-based” approach, combined with an LSTM module, and apply it to a dataset provided by Germany’s national meteorological service. Finally, they show via a range of metrics and modeling scenarios that their proposed approach may outperform more basic ones.
The overall quality of the writing, referencing, structure and experiments is good. There do not appear to be any notable and relevant works missing from the list of references. Although not providing ground-breaking contributions to the field, the results are nonetheless valuable in illustrating the feasibility of alternative approaches to the problem of precipitation map in-painting using temporal data. The description and review of the addressed problem is also good. The manuscript would be suitable for publication in the journal after minor revisions to address the following concerns and questions. Particularly notable insightful and clear parts of the manuscript are also noted below.
## Review ratings
Scientific significance: Good
Scientific quality: Good
Presentation quality: Fair
## Specific and technical comments
Line 24: Unclear if this is in fact referring to Figure 1.
Line 40: More detail should be provided to explain what is meant by “data-driven”. I assume such methods are machine learning adjacent ones which contrast to statistical methods driven by modeling assumptions, but additional clarity would be helpful here.
Line 47: Additional detail would be beneficial here. It appears unfair to state that data-driven methods only account for spatial relationships while statistical methods only account for temporal variability. Explanation of the caveats of this statement should be included. For example, why is spatial interpolation, a statistical method, unable to reconstruct spatial features?
Line 59: The explanation of the dataset is clear and well organized. However, it is unclear which exact time period is used for this study.
Line 85: Please provide a citation for this statement.
Equations 1: Please use \mathrm to format the text
Line 102: This paper seems to be a seminal work in the field, and the overall approach of the presented work appears rather similar. Since many readers would already have this particular paper in mind when reading through this manuscript, it would be ideal to mention this paper earlier in the introduction and explain its similarities and differences with this work.
Line 122: There should be a brief mention of the programming language and packages used to implement the model, hardware utilized, and run time here.
Line 125: The experiments and associated results in this section are highly yet appropriately detailed. However, it is difficult at times to follow what is going on. Some reorganization here could be beneficial to the reader’s understanding. For example, the results and discussion could be split into at least two different sections.
Line 137: Please use \mathrm to format the text
Figure 2: This is a good way to present the relevant metrics in a visually appealing and informative manner
Figure 7: The text in this figure is difficult to read as it is too small.
Line 198: The conclusion is clear and provides a high-level summary of the main findings. A very brief reiteration of the motivation for the study here would also be helpful.
Citation: https://doi.org/10.5194/egusphere-2024-1392-RC2
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
334 | 89 | 24 | 447 | 16 | 14 |
- HTML: 334
- PDF: 89
- XML: 24
- Total: 447
- BibTeX: 16
- EndNote: 14
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1