11 Jun 2024
 | 11 Jun 2024
Status: this preprint is open for discussion.

A Python interface to the Fortran-based Parallel Data Assimilation Framework: pyPDAF v1.0.0

Yumeng Chen, Lars Nerger, and Amos S. Lawless

Abstract. Data assimilation (DA) is an essential component of numerical weather and climate prediction. Efficient implementation of DA benefits both operational prediction and research. Currently, a variety of DA software programs are available. One of the notable DA libraries is the Parallel Data Assimilation Framework (PDAF) designed for ensemble data assimilation. The DA framework is widely used with complex high-dimensional climate models and is applied for research on atmosphere, ocean, sea ice and marine ecosystem modelling, as well as operational ocean forecasting. Meanwhile, there exists increasing need for flexible and efficient DA implementations using Python due to the increasing amount of intermediate complexity models as well as machine learning based models coded in Python. To accommodate for such needs, here, we introduce a Python interface to PDAF, pyPDAF. The Python interface allows for flexible DA system development while retaining the efficient implementation of the core DA algorithms in the Fortran-based PDAF. The ideal use-case of pyPDAF is a DA system where the model integration is independent from the DA program, which reads the model forecast ensemble, produces a model analysis and update the restart files of the model, or a DA system where the model can be used in Python. With implementations of both PDAF and pyPDAF, this study demonstrates the use of pyPDAF and PDAF for coupled data assimilation (CDA) in a coupled atmosphere and ocean model, the Modular Arbitrary-Order Ocean-Atmosphere Model (MAOOAM). Using both weakly and strongly CDA, we demonstrate that pyPDAF allows for the utilisation of Python-based user-supplied functions in the Fortran-based DA framework. We also show that the Python-based user-supplied routine can be a main reason for the slow-down of the DA system based on pyPDAF. Our CDA experiments confirm the benefit of strongly coupled data assimilation compared to the weakly coupled data assimilation. We also demonstrate that the CDA not only improves the instantaneous analysis but also the long-term trend of the coupled dynamical system.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Yumeng Chen, Lars Nerger, and Amos S. Lawless

Status: open (until 06 Aug 2024)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2024-1078', Anonymous Referee #1, 12 Jun 2024 reply
Yumeng Chen, Lars Nerger, and Amos S. Lawless

Model code and software

yumengch/PDAF-MAOOAM: Submitted version Yumeng Chen

yumengch/pyPDAF: pyPDAF v1.0.0 Yumeng Chen

PDAF V2.1 Lars Nerger

Yumeng Chen, Lars Nerger, and Amos S. Lawless


Total article views: 30 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
23 5 2 30 1 1
  • HTML: 23
  • PDF: 5
  • XML: 2
  • Total: 30
  • BibTeX: 1
  • EndNote: 1
Views and downloads (calculated since 11 Jun 2024)
Cumulative views and downloads (calculated since 11 Jun 2024)

Viewed (geographical distribution)

Total article views: 29 (including HTML, PDF, and XML) Thereof 29 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
Latest update: 12 Jun 2024
Short summary
In this paper, we present pyPDAF, a Python interface to the parallel data assimilation framework (PDAF) allowing for coupling with Python-based models. We demonstrate the capability and efficiency of pyPDAF under a coupled data assimilation setup.