the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Pooled Error Variance and Covariance Estimation of Sparse In Situ Soil Moisture Sensor Measurements in Agricultural Fields in Flanders
Abstract. Accurately quantifying errors in soil moisture measurements from in situ sensors at fixed locations is essential for reliable state and parameter estimation in probabilistic soil hydrological modeling. This quantification becomes particularly challenging when the number of sensors per field or measurement zone (MZ) is limited. When direct calculation of errors from sensor data in a certain MZ is not feasible, we propose to pool systematic and random errors of soil moisture measurements for a specific measurement setup to derive a pooled error covariance matrix that applies across different fields and soil types. In this study, a pooled error covariance matrix was derived from soil moisture sensor measurements and soil moisture sampling campaigns conducted over three growing seasons, covering 93 cropping cycles in agricultural fields with diverse soil textures in Belgium. The MZ soil moisture estimated from soil samples, which showed a small standard error (0.0038 m3 m‑3) and which was not correlated between different sampling campaigns since soil samples were taken at different locations, represented the ‘true’ MZ soil moisture. First, we established a pooled linear recalibration of the TEROS 10 (Meter Group, Inc., USA) manufacturer's sensor calibration function. Then, for each individual sensor as well as for each MZ, we identified systematic deviations and temporally varying residual deviations between the calibrated sensor data and sampling data. The autocovariance of the individual or the MZ-averaged sensor measurement errors was represented by the variance of the systematic deviations across all sensors or MZs whereas the random error variance was calculated from the variance of the pooled residual deviations. The total error variance was equal to the sum of the autocovariance and random error variance.
Due to spatial sensor correlation, the variance and autocovariance of MZ-average sensor measurement errors could not be derived from the individual sensor error variances and covariances. The pooled error covariance matrix of the MZ-averaged soil moisture measurements indicated a significant sensor error autocorrelation of 0.518, as the systematic error standard deviation (σα- = 0.0327 m3 m‑3) was similar to the random error standard deviation (σε- = 0.0316 m3 m‑3). These results demonstrate that the common assumption of uncorrelated random errors to determine parameter and model prediction uncertainty is not valid when measurements from sparse in situ soil moisture sensors are used to parameterize soil hydraulic models. Further research is required to assess to what extent the error covariances found in this study can be transferred to other areas, and how they impact parameter estimation in soil hydrological modeling.
- Preprint
(1906 KB) - Metadata XML
-
Supplement
(441 KB) - BibTeX
- EndNote
Status: final response (author comments only)
-
RC1: 'Comment on egusphere-2024-2943', Anonymous Referee #1, 18 Nov 2024
This study presents an approach to estimate error variance and covariance estimates for sparse in situ soil moisture monitoring networks.
This is certainly a relevant topic that fits well into the scope of the journal and addresses an important issue (i.e., the temporal and spatial error correlation properties of in situ measurements).
Unfortunately, I have to admit that I could not follow the method within a reasonable amount of time and mental effort. I am not an expert on in situ soil moisture sampling, so this can certainly be attributed, in part, to a lack of background understanding on my side. Nevertheless, I do think that the manuscript could benefit greatly from revising the description of the methodology, better motivating why certain steps are taken, and backing up certain claims and steps with literature.
For example, I do not understand why, in Eq. 7 an average of standard deviations is taken, and why the standard error of the mean of standard deviations should represent the measurement error of the composite soil moisture (which is the average of gravimetric measurements, right?)... Why is the error variance of an average standard deviation equal to the error variance of the average of the individual measurements?
Also, I do not get why, in L226, a "systematic error that is constant over time" is defined as a random variable... isn't that a self contradiction? Or where does Eq (14) come from? Shouldn't a correlation be the ratio between a covariance and the product of two standard deviations? Is this a standard approach, and is there literature to back that up?
I am also skeptical about the underlying assumption that (L247) there are no variations in error variance, covariance, and autocorrelation between different fields... How realistic is this assumption? Can you provide a rationale for the belief that this is justified "for MZs of about 80m2"?
Lastly, I would recommend to choose the language in general more carefully, reducing room for ambiguity or misinterpretations... For example, I belief that statements such as (L280) "measurement errors in a field are correlated with each other", do not actually mean that the errors of individual measurements are correlated, but that the deviations of the measurements of different sensors, which have been transformed to represent the same soil volume, from soil moisture in that volume are correlated?
Finally, I think the whole introductory part around Eqs. (1)-(3) can be omitted because it is not relevant for the study. The presented equations are just one choice to integrate the measurements with a model, and whether to use (2) or (3) is merely a choice of ignoring off-diagonals or not... This manuscript does not use the estimated error covariance information in any way, so I recommend simply saying that "it is important to use that in these situations and that's why we try to estimate it", but leave an arbitrarily chosen of how it could (theoretically) be used out of the paper.
In summary: I do believe that the authors have conducted rigorous experiments and are proposing something very relevant and probably sound, I just find myself unable to remove the "probably" from this sentence, because I simply cannot follow the methodology, which, again, could partly be attributed to a lack of understanding on my side, but I recommend nevertheless to revise the methodology and introduction to make the manuscript more accessible to a wider readership.
Citation: https://doi.org/10.5194/egusphere-2024-2943-RC1 -
RC2: 'Comment on egusphere-2024-2943', Anonymous Referee #2, 16 Dec 2024
This manuscript analyzes the results of a significant soil moisture field measurement campaign in northern Belgium. The motivation of the study is to estimate the "errors" that should be assigned to soil moisture measurements when assimilating those data into probabilistic modeling frameworks or using the data in inverse modeling. I put error in quotation marks because I think that the term is not appropriately defined in this manuscript. The term as used here includes both 1) the discrepancy between the soil moisture estimate from a sensor and the true soil moisture value in the sensor's measurement volume and 2) the discrepancy between the soil moisture estimate from a sensor and the true mean soil moisture value in some user-defined measurement zone which is far deeper and wider (by orders of magnitude) than the sensor's measurement volume. These two dimensions of "error" clearly have different physical causes and likely will have different temporal dynamics. Yet here they are lumped together and analyzed as if they are one phenomenon. I am not sure that this approach is justified. This is my primary concern with the manuscript. My secondary concern with the manuscript is that the importance of the results is unclear. The main outcomes are some estimates of parameters that could be assigned to represent the uncertainty and autocorrelation of the underlying soil moisture sensor data if they were used in data assimilation or inverse modeling. But the data are not used in that way here, so there is no way to estimate the significance of the results. The underlying data appear to be remarkably homogenous, as noted by the authors. So, in the end, the statistical rigor of the analysis and the presentation of the work is commendable, but the practical importance of the work is unclear. Clarifying that would improve the value of this contribution. I have included further detailed comments, questions, and suggested edits in an attached pdf version of the manuscript.
Viewed
HTML | XML | Total | Supplement | BibTeX | EndNote | |
---|---|---|---|---|---|---|
134 | 43 | 15 | 192 | 23 | 4 | 5 |
- HTML: 134
- PDF: 43
- XML: 15
- Total: 192
- Supplement: 23
- BibTeX: 4
- EndNote: 5
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1