the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
| 18 Sep 2023
Evaluation of debris-flow building damage forecasts
Abstract. Reliable forecasts of building damage due to debris flows may provide situational awareness and guide land and emergency management decisions. Application of debris-flow runout models to generate such forecasts requires combining hazard intensity predictions with fragility functions that link hazard intensity with building damage. In this study, we evaluated the performance of building damage forecasts for the 9 January 2018 Montecito postfire debris-flow runout event, in which over 500 buildings were damaged. We constructed forecasts using either peak debris-flow depth or volume flux as the hazard intensity measure and applied each approach using three debris-flow runout models (RAMMS, FLO-2D, and D-Claw). Generated forecasts were based on combining multiple simulations that sampled a range of debris-flow volume and mobility, reflecting typical sources and magnitude of pre-event uncertainty. We found that only forecasts made with volume flux and the D-Claw model could correctly forecast the observed number of damaged buildings and the spatial patterns of building damage. However, the best forecast only predicted 50 % of the observed damaged buildings correctly and had coherent spatial patterns of incorrectly forecast building damage (i.e., false positives and false negatives). These results indicate that forecasts made at the building level reliably reflect the spatial pattern of damage, but do not support interpretation at the individual building level. We found the event size strongly influences the number of damaged buildings and the spatial pattern of debris-flow depth and velocity. Consequently, future research on the link between precipitation and the volume of sediment mobilized may have the greatest effect on reducing uncertainty in building damage forecasts. Finally, because we found that both depth and velocity are needed to forecast building damage, comparing debris flow models against spatially distributed observations of building damage is a more stringent test for model fidelity than comparison against the extent of debris-flow runout.
-
Notice on discussion status
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
-
Preprint
(10765 KB)
-
Supplement
(625 KB)
-
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(10765 KB) - Metadata XML
-
Supplement
(625 KB) - BibTeX
- EndNote
- Final revised paper
Journal article(s) based on this preprint
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2023-1892', Polina Lemenkova, 24 Jan 2024
Review of the manuscript No. egusphere-2023-1892 ‘Evaluation of debris-flow building damage forecasts’ submitted to NHESS.
Recommendation: ACCEPT
Focus of the paper is on reliable forecasts of building damage due to debris flows.
Relevance: The presented study is the original primary research within the scope of the journal. In this study, the authors evaluated the performance of building damage forecasts for the 9 January 2018 Montecito post-fire debris-flow runout event, in which over 500 buildings were damaged.
Abstract is well written and clearly describes the undertaken study.
Structure: The article is well organized with structured sections.
Introduction presents a background, defines research goals and provides a clear statement of research problem. It presents the purpose of the research investigation which is supported by the pertinent literature. Literature is well referenced and relevant.
Research questions and goal are identified: Application of debris-flow runout models to generate forecasts requires combining hazard intensity predictions with fragility functions that link hazard intensity with building damage.
Motivation is explained: reliable forecasts of building damage due to debris flows may provide situational awareness and guide land and emergency management decisions.
Methods: Methods described with sufficient information: The authors constructed forecasts using either peak debris-flow depth or volume flux as the hazard intensity measure and applied each approach using three debris-flow runout models (RAMMS, FLO-2D, and D-Claw).
Results are reported: The authors generated forecasts which were based on combining multiple simulations that sampled a range of debris-flow volume and mobility, reflecting typical sources and magnitude of pre-event uncertainty.
Discussion interpreted the major outcomes of this study: The authors found that only forecasts made with volume flux and the D-Claw model could correctly forecast the observed number of damaged buildings and spatial patterns of building damage. The authors also found found that both depth and velocity are needed to forecast building damage, comparing debris flow models against spatially distributed observations of building damage is a more stringent test for model fidelity than comparison against the extent of debris-flow runout.
Conclusion The authors concluded that the event size strongly influences the number of damaged buildings and the spatial pattern of debris-flow depth and velocity. Conclusions are well stated, linked to original research question, limited to supporting results and summarized the study with interpretation of facts.
Recommendations for future work: The authors noted that future research on the link between precipitation and the volume of sediment mobilized may have the greatest effect on reducing uncertainty in building damage forecasts.
Actuality, novelty and importance of the research: the authors indicated that forecasts made at the building level reliably reflect the spatial pattern of damage, but do not support interpretation at the individual building level.
Academic contribution: The paper increases the knowledge in predictive forecasting of building damage to debris flow. Thus, The authors remarked that the best forecast only predicted 50% of the observed damaged buildings correctly and had coherent spatial patterns of incorrectly forecast building damage (i.e., false positives and false negatives).
Figures Figures are of acceptable quality, easy to read, relevant and suitable.
Recommendation: This manuscript can be ACCEPTED based on the detailed report above.
With kind regards,
- Reviewer.
24.01.2024.
- AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
-
RC2: 'Comment on egusphere-2023-1892', Polina Lemenkova, 05 Feb 2024
Review of the manuscript No. egusphere-2023-1892 ‘Evaluation of debris-flow building damage forecasts’ submitted to NHESS.
Recommendation: ACCEPT
Focus of the paper is on reliable forecasts of building damage which are caused by debris flows. Such prognosis may provide situational awareness and guide land and emergency 10 management decisions.
Relevance: The presented study is the original primary research within the scope of the journal. The manuscript meets general criteria of the significance in risk assessment. The study has been conducted in accordance to the technical standards in modelling and spatial data analysis.
Abstract is well written and clearly describes the undertaken study.
Structure: The article is well organized with structured sections.
Introduction presents a background, defines research goals and provides a clear statement of research problem. It presents the purpose of the research investigation which is supported by the pertinent literature. Literature is well referenced and relevant.
Research questions and goal are identified: Developing methods of debris-flow runout modelling to generate forecasts which requires combining hazard intensity predictions with fragility functions that link hazard intensity with building damage.
English language: acceptable. Clear, unambiguous, professional English language used throughout.
Data used in this study are described: The authors evaluated the performance of building damage forecasts for the 9 January 2018 Montecito postfire debris-flow runout event, in which over 500 buildings were damaged.
Methods: Methods described with sufficient information: The authors constructed forecasts using either peak debris-flow depth or volume flux as the hazard intensity measure and applied each approach using three debris-flow runout models (RAMMS, FLO-2D, and D-Claw). The workflow is well structured. Generated forecasts were based on combining multiple simulations that sampled a range of debris-flow volume and mobility, reflecting typical sources and magnitude of pre-event uncertainty.
Results are reported: The authors found that only forecasts made with volume flux and the D-Claw model could correctly forecast the observed number of damaged buildings and the spatial patterns of building damage. They also noted that the best forecast only predicted 50% of the observed damaged buildings correctly and had coherent spatial patterns of incorrectly forecast building damage (i.e., false positives and false negatives).
Discussion interpreted the major outcomes of this study: The results obtained by the authors indicate that forecasts 20 made at the building level reliably reflect the spatial pattern of damage, but do not support interpretation at the individual building level. The authors found the event size strongly influences the number of damaged buildings and the spatial pattern of debris-flow depth and velocity.
Conclusion The authors concluded that future research on the link between precipitation and the volume of sediment mobilized may have the greatest effect on reducing uncertainty in building damage forecasts.
Actuality, novelty and importance of the research: The authors found that both depth and velocity are needed to forecast building damage, comparing debris flow models against spatially distributed observations of building damage is a more stringent test for model fidelity than comparison against the extent of debris-flow runout.
Academic contribution: The paper increases the knowledge in methods of risk assessment and prognosis of potential consequences of geological hazards.
Figures Figures are of acceptable quality, easy to read, relevant and suitable.
Recommendation: This manuscript can be accepted based on the detailed report above.
With kind regards,
05.02.2024.
- AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
-
RC3: 'Comment on egusphere-2023-1892', Anonymous Referee #2, 14 Feb 2024
Revision of the manuscript number “nhess-2023-1892” entitled “Evaluation of debris-flow building damage forecasts”.
This paper contributes in reliable forecasts of building damage caused by debris flows. Three different models to represent a debris flow event are used, RAMMS, FLO-2D, and D-Claw. The paper is well structured and written in general. The recommendation is to accept it for publishing. I recommend handling the comments given below. And, it is very important to clarify the meaning of the term “hv^2”, as pointed out below.
- The redaction style of the abstract must be improved. The word “forecasts” is appearing plenty of times, to mention one of the issues. It is a key word, however, redaction can be improved with no necessity of recurring (using) to synonyms.
- L76-L80. Improve redaction.
- L82-L83. These two paragraphs might be better unified. The description of the sections could be also better performed mentioning even those more specific procedures with no necessity of referencing every single subsection title.
- L103-L104. Improve redaction.
- Figure 1. Why the simulation domains (or boundaries of these three creeks) were not demarked or selected by using the watershed divide? Avoiding lack spaces between the creeks and event worst overlapping the domains with no necessity.
- “hv^2” is in fact representing the momentum flux, as it is coming from the depth-averaged momentum equation (see FEMA, 2022a, p. 5-28). Correct this for the entire manuscript. Also see and cite:
* Tan, W. Y. (1992). Shallow water hydrodynamics: Mathematical theory and numerical solution for a two-dimensional system of shallow-water equations. Elsevier.
* Vreugdenhil, C. B. (1994). Numerical methods for shallow-water flow (Vol. 13). Springer Science & Business Media.
- Could not be better write “100 by”? One more parenthesis is needed to close the complementary text.
- Figure 3. Make it clear if Figure 3a, is also a product of your paper or is this was taken from other document.
- L248 and L250. “Dimensionless” is more appropriated instead of “unitless”. And, explain better meaning of K_D.
- Define more appropriately the definition of the density used for your work. Is it the weighted averaged density of both water and soil particles?
- Are you estimating or assuming that hv^2=2/3?
- 5. Correct B_w.
- “We discuss the implications of these simplifications later in Section ---.”
Citation: https://doi.org/10.5194/egusphere-2023-1892-RC3 - AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2023-1892', Polina Lemenkova, 24 Jan 2024
Review of the manuscript No. egusphere-2023-1892 ‘Evaluation of debris-flow building damage forecasts’ submitted to NHESS.
Recommendation: ACCEPT
Focus of the paper is on reliable forecasts of building damage due to debris flows.
Relevance: The presented study is the original primary research within the scope of the journal. In this study, the authors evaluated the performance of building damage forecasts for the 9 January 2018 Montecito post-fire debris-flow runout event, in which over 500 buildings were damaged.
Abstract is well written and clearly describes the undertaken study.
Structure: The article is well organized with structured sections.
Introduction presents a background, defines research goals and provides a clear statement of research problem. It presents the purpose of the research investigation which is supported by the pertinent literature. Literature is well referenced and relevant.
Research questions and goal are identified: Application of debris-flow runout models to generate forecasts requires combining hazard intensity predictions with fragility functions that link hazard intensity with building damage.
Motivation is explained: reliable forecasts of building damage due to debris flows may provide situational awareness and guide land and emergency management decisions.
Methods: Methods described with sufficient information: The authors constructed forecasts using either peak debris-flow depth or volume flux as the hazard intensity measure and applied each approach using three debris-flow runout models (RAMMS, FLO-2D, and D-Claw).
Results are reported: The authors generated forecasts which were based on combining multiple simulations that sampled a range of debris-flow volume and mobility, reflecting typical sources and magnitude of pre-event uncertainty.
Discussion interpreted the major outcomes of this study: The authors found that only forecasts made with volume flux and the D-Claw model could correctly forecast the observed number of damaged buildings and spatial patterns of building damage. The authors also found found that both depth and velocity are needed to forecast building damage, comparing debris flow models against spatially distributed observations of building damage is a more stringent test for model fidelity than comparison against the extent of debris-flow runout.
Conclusion The authors concluded that the event size strongly influences the number of damaged buildings and the spatial pattern of debris-flow depth and velocity. Conclusions are well stated, linked to original research question, limited to supporting results and summarized the study with interpretation of facts.
Recommendations for future work: The authors noted that future research on the link between precipitation and the volume of sediment mobilized may have the greatest effect on reducing uncertainty in building damage forecasts.
Actuality, novelty and importance of the research: the authors indicated that forecasts made at the building level reliably reflect the spatial pattern of damage, but do not support interpretation at the individual building level.
Academic contribution: The paper increases the knowledge in predictive forecasting of building damage to debris flow. Thus, The authors remarked that the best forecast only predicted 50% of the observed damaged buildings correctly and had coherent spatial patterns of incorrectly forecast building damage (i.e., false positives and false negatives).
Figures Figures are of acceptable quality, easy to read, relevant and suitable.
Recommendation: This manuscript can be ACCEPTED based on the detailed report above.
With kind regards,
- Reviewer.
24.01.2024.
- AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
-
RC2: 'Comment on egusphere-2023-1892', Polina Lemenkova, 05 Feb 2024
Review of the manuscript No. egusphere-2023-1892 ‘Evaluation of debris-flow building damage forecasts’ submitted to NHESS.
Recommendation: ACCEPT
Focus of the paper is on reliable forecasts of building damage which are caused by debris flows. Such prognosis may provide situational awareness and guide land and emergency 10 management decisions.
Relevance: The presented study is the original primary research within the scope of the journal. The manuscript meets general criteria of the significance in risk assessment. The study has been conducted in accordance to the technical standards in modelling and spatial data analysis.
Abstract is well written and clearly describes the undertaken study.
Structure: The article is well organized with structured sections.
Introduction presents a background, defines research goals and provides a clear statement of research problem. It presents the purpose of the research investigation which is supported by the pertinent literature. Literature is well referenced and relevant.
Research questions and goal are identified: Developing methods of debris-flow runout modelling to generate forecasts which requires combining hazard intensity predictions with fragility functions that link hazard intensity with building damage.
English language: acceptable. Clear, unambiguous, professional English language used throughout.
Data used in this study are described: The authors evaluated the performance of building damage forecasts for the 9 January 2018 Montecito postfire debris-flow runout event, in which over 500 buildings were damaged.
Methods: Methods described with sufficient information: The authors constructed forecasts using either peak debris-flow depth or volume flux as the hazard intensity measure and applied each approach using three debris-flow runout models (RAMMS, FLO-2D, and D-Claw). The workflow is well structured. Generated forecasts were based on combining multiple simulations that sampled a range of debris-flow volume and mobility, reflecting typical sources and magnitude of pre-event uncertainty.
Results are reported: The authors found that only forecasts made with volume flux and the D-Claw model could correctly forecast the observed number of damaged buildings and the spatial patterns of building damage. They also noted that the best forecast only predicted 50% of the observed damaged buildings correctly and had coherent spatial patterns of incorrectly forecast building damage (i.e., false positives and false negatives).
Discussion interpreted the major outcomes of this study: The results obtained by the authors indicate that forecasts 20 made at the building level reliably reflect the spatial pattern of damage, but do not support interpretation at the individual building level. The authors found the event size strongly influences the number of damaged buildings and the spatial pattern of debris-flow depth and velocity.
Conclusion The authors concluded that future research on the link between precipitation and the volume of sediment mobilized may have the greatest effect on reducing uncertainty in building damage forecasts.
Actuality, novelty and importance of the research: The authors found that both depth and velocity are needed to forecast building damage, comparing debris flow models against spatially distributed observations of building damage is a more stringent test for model fidelity than comparison against the extent of debris-flow runout.
Academic contribution: The paper increases the knowledge in methods of risk assessment and prognosis of potential consequences of geological hazards.
Figures Figures are of acceptable quality, easy to read, relevant and suitable.
Recommendation: This manuscript can be accepted based on the detailed report above.
With kind regards,
05.02.2024.
- AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
-
RC3: 'Comment on egusphere-2023-1892', Anonymous Referee #2, 14 Feb 2024
Revision of the manuscript number “nhess-2023-1892” entitled “Evaluation of debris-flow building damage forecasts”.
This paper contributes in reliable forecasts of building damage caused by debris flows. Three different models to represent a debris flow event are used, RAMMS, FLO-2D, and D-Claw. The paper is well structured and written in general. The recommendation is to accept it for publishing. I recommend handling the comments given below. And, it is very important to clarify the meaning of the term “hv^2”, as pointed out below.
- The redaction style of the abstract must be improved. The word “forecasts” is appearing plenty of times, to mention one of the issues. It is a key word, however, redaction can be improved with no necessity of recurring (using) to synonyms.
- L76-L80. Improve redaction.
- L82-L83. These two paragraphs might be better unified. The description of the sections could be also better performed mentioning even those more specific procedures with no necessity of referencing every single subsection title.
- L103-L104. Improve redaction.
- Figure 1. Why the simulation domains (or boundaries of these three creeks) were not demarked or selected by using the watershed divide? Avoiding lack spaces between the creeks and event worst overlapping the domains with no necessity.
- “hv^2” is in fact representing the momentum flux, as it is coming from the depth-averaged momentum equation (see FEMA, 2022a, p. 5-28). Correct this for the entire manuscript. Also see and cite:
* Tan, W. Y. (1992). Shallow water hydrodynamics: Mathematical theory and numerical solution for a two-dimensional system of shallow-water equations. Elsevier.
* Vreugdenhil, C. B. (1994). Numerical methods for shallow-water flow (Vol. 13). Springer Science & Business Media.
- Could not be better write “100 by”? One more parenthesis is needed to close the complementary text.
- Figure 3. Make it clear if Figure 3a, is also a product of your paper or is this was taken from other document.
- L248 and L250. “Dimensionless” is more appropriated instead of “unitless”. And, explain better meaning of K_D.
- Define more appropriately the definition of the density used for your work. Is it the weighted averaged density of both water and soil particles?
- Are you estimating or assuming that hv^2=2/3?
- 5. Correct B_w.
- “We discuss the implications of these simplifications later in Section ---.”
Citation: https://doi.org/10.5194/egusphere-2023-1892-RC3 - AC1: 'Response to reviewer comments: egusphere-2023-1892', Katherine Barnhart, 22 Feb 2024
Peer review completion
Journal article(s) based on this preprint
Data sets
Select model results and model input parameters for debris-flow runout model simulations of the 9 January 2018 Montecito debris flow runout event Barnhart, K. R. https://doi.org/10.5066/P9X18F2H
Viewed
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 301 | 135 | 24 | 460 | 38 | 15 | 17 |
- HTML: 301
- PDF: 135
- XML: 24
- Total: 460
- Supplement: 38
- BibTeX: 15
- EndNote: 17
Viewed (geographical distribution)
| Country | # | Views | % |
|---|---|---|---|
| United States of America | 1 | 199 | 43 |
| China | 2 | 28 | 6 |
| Germany | 3 | 27 | 5 |
| Italy | 4 | 26 | 5 |
| France | 5 | 15 | 3 |
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
- 199
Cited
1 citations as recorded by crossref.
Katherine R. Barnhart
Christopher R. Miller
Francis K. Rengers
Jason W. Kean
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(10765 KB) - Metadata XML
-
Supplement
(625 KB) - BibTeX
- EndNote
- Final revised paper