Preprints
https://doi.org/10.5194/egusphere-2022-996
https://doi.org/10.5194/egusphere-2022-996
10 Oct 2022
 | 10 Oct 2022

How far can the error estimation problem in data assimilation be closed by collocated data?

Annika Vogel and Richard Ménard

Abstract. Accurate specification of error statistics required for data assimilation remains an ongoing challenge, partly because their estimation is an ill-posed problem that requires statistical assumptions. Even with the common assumption that background and observation errors are uncorrelated, the problem remains underdetermined. One natural question that could arise is: Can the increasing amount of overlapping observations or other datasets help to reduce the total number of statistical assumptions, or do they introduce more statistical unknowns? In order to answer this question, this paper provides a conceptual view on the statistical error estimation problem for multiple collocated datasets, including a generalized mathematical formulation, an exemplary demonstration with synthetic data as well as a formulation of the minimal and optimal conditions to solve the problem. It is demonstrated that the required number of statistical assumptions increases linearly with the number of datasets. However the number of error statistics that can be estimated increases quadratically, allowing for an estimation of an increasing number of error cross-statistics between datasets for more than three datasets. The presented optimal estimation of full error covariance and cross-covariance matrices between dataset does not accumulate uncertainties of assumptions among estimations of subsequent error statistics.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.

Journal article(s) based on this preprint

19 Sep 2023
How far can the statistical error estimation problem be closed by collocated data?
Annika Vogel and Richard Ménard
Nonlin. Processes Geophys., 30, 375–398, https://doi.org/10.5194/npg-30-375-2023,https://doi.org/10.5194/npg-30-375-2023, 2023
Short summary
Annika Vogel and Richard Ménard

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse

Peer review completion

AR: Author's response | RR: Referee report | ED: Editor decision | EF: Editorial file upload
AR by Annika Vogel on behalf of the Authors (18 Jan 2023)  Author's response   Author's tracked changes   Manuscript 
ED: Referee Nomination & Report Request started (26 Jan 2023) by Olivier Talagrand
RR by Ricardo Todling (13 Feb 2023)
RR by Anonymous Referee #3 (25 Feb 2023)
RR by Anonymous Referee #2 (05 Mar 2023)
ED: Reconsider after major revisions (further review by editor and referees) (09 Mar 2023) by Olivier Talagrand
AR by Annika Vogel on behalf of the Authors (01 May 2023)  Author's response   Author's tracked changes   Manuscript 
ED: Referee Nomination & Report Request started (04 May 2023) by Olivier Talagrand
RR by Anonymous Referee #2 (22 May 2023)
RR by Anonymous Referee #3 (23 May 2023)
ED: Publish subject to minor revisions (review by editor) (24 May 2023) by Olivier Talagrand
AR by Annika Vogel on behalf of the Authors (05 Jun 2023)  Author's response   Author's tracked changes   Manuscript 
ED: Reconsider after major revisions (further review by editor and referees) (12 Jun 2023) by Olivier Talagrand
AR by Annika Vogel on behalf of the Authors (07 Jul 2023)  Author's response   Author's tracked changes   Manuscript 
ED: Referee Nomination & Report Request started (11 Jul 2023) by Olivier Talagrand
RR by Anonymous Referee #2 (13 Jul 2023)
ED: Publish as is (13 Jul 2023) by Olivier Talagrand
AR by Annika Vogel on behalf of the Authors (17 Jul 2023)  Manuscript 

Post-review adjustments

AA: Author's adjustment | EA: Editor approval
AA by Annika Vogel on behalf of the Authors (30 Aug 2023)   Author's adjustment   Manuscript
EA: Adjustments approved (30 Aug 2023) by Olivier Talagrand

Journal article(s) based on this preprint

19 Sep 2023
How far can the statistical error estimation problem be closed by collocated data?
Annika Vogel and Richard Ménard
Nonlin. Processes Geophys., 30, 375–398, https://doi.org/10.5194/npg-30-375-2023,https://doi.org/10.5194/npg-30-375-2023, 2023
Short summary
Annika Vogel and Richard Ménard
Annika Vogel and Richard Ménard

Viewed

Total article views: 527 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
361 150 16 527 8 5
  • HTML: 361
  • PDF: 150
  • XML: 16
  • Total: 527
  • BibTeX: 8
  • EndNote: 5
Views and downloads (calculated since 10 Oct 2022)
Cumulative views and downloads (calculated since 10 Oct 2022)

Viewed (geographical distribution)

Total article views: 503 (including HTML, PDF, and XML) Thereof 503 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 06 Sep 2024
Download

The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.

Short summary
Accurate estimation of error statistics required for data assimilation remains an ongoing challenge, as statistical assumptions are required to solve the estimation problem. This paper provides a conceptual view on the statistical error estimation problem in the light of increasing amount of available datasets. It is found that the total number of required assumptions increases with the number of overlapping datasets, but the relative amount of error statistics which can be estimated increases.