the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
TemDeep: A Self-Supervised Framework for Temporal Downscaling of Atmospheric Fields at Arbitrary Time Resolutions
Abstract. Numerical forecast products with high temporal resolution are crucial tools in atmospheric studies, allowing for accurate identification of rapid transitions and subtle changes that may be missed by lower-resolution data. However, the acquisition of high-resolution data is limited due to excessive computational demands and substantial storage needs in numerical models. Current deep learning methods for statistical downscaling still require massive ground truth with high temporal resolution for model training. In this paper, we present a self-supervised framework for downscaling atmospheric variables at arbitrary time resolutions by imposing a temporal coherence constraint. Firstly, we construct an encoder-decoder structured temporal downscaling network, and then pretrain this downscaling network on a subset of data that exhibits rapid transitions and is filtered out based on a composite index. Subsequently, this pretrained network is utilized to downscale the fields from adjacent time periods and generate the field at the middle time point. By leveraging the temporal coherence inherent in meteorological variables, the network is further trained based on the difference between the generated field and the actual middle field. To track the evolving trends in meteorological system movements, a flow estimation module is designed to assist with generating interpolated fields. Results show that our method can accurately recover evolution details superior to other methods, reaching 53.7 % in the restoration rate on the test set. In addition, to avoid generating abnormal values and guide the model out of local optima, two regularization terms are integrated into the loss function to enforce spatial and temporal continuity, which further improves the performance by 7.6 %.
- Preprint
(20697 KB) - Metadata XML
- BibTeX
- EndNote
Status: final response (author comments only)
-
RC1: 'Comment on egusphere-2023-1775', Anonymous Referee #1, 16 Oct 2023
Please find the review in the attached pdf file.
-
AC3: 'Reply on RC1', Qian Li, 12 Nov 2024
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2023/egusphere-2023-1775/egusphere-2023-1775-AC3-supplement.pdf
-
AC3: 'Reply on RC1', Qian Li, 12 Nov 2024
-
CEC1: 'Executive Editor comment on egusphere-2023-1775', Astrid Kerkweg, 23 Oct 2023
Dear authors,
in my role as Executive editor of GMD, I would like to bring to your attention our Editorial version 1.2: https://www.geosci-model-dev.net/12/2215/2019/
This highlights some requirements of papers published in GMD, which is also available on the GMD website in the ‘Manuscript Types’ section: http://www.geoscientific-model-development.net/submission/manuscript_types.html
In particular, please note that for your paper, the following requirement has not been met in the Discussions paper:
- Code must be published on a persistent public archive with a unique identifier for the exact model version described in the paper or uploaded to the supplement, unless this is impossible for reasons beyond the control of authors. All papers must include a section, at the end of the paper, entitled "Code availability". Here, either instructions for obtaining the code, or the reasons why the code is not available should be clearly stated. It is preferred for the code to be uploaded as a supplement or to be made available at a data repository with an associated DOI (digital object identifier) for the exact model version described in the paper. Alternatively, for established models, there may be an existing means of accessing the code through a particular system. In this case, there must exist a means of permanently accessing the precise model version described in the paper. In some cases, authors may prefer to put models on their own website, or to act as a point of contact for obtaining the code. Given the impermanence of websites and email addresses, this is not encouraged, and authors should consider improving the availability with a more permanent arrangement. Making code available through personal websites or via email contact to the authors is not sufficient. After the paper is accepted the model archive should be updated to include a link to the GMD paper.
As GitHub is not a persistent archive, please provide a persistent release for the exact version of the downscaling scripts used for the publication in this paper. As explained in https://www.geoscientific-model-development.net/about/manuscript_types.html the preferred reference to this release is through the use of a DOI which then can be cited in the paper. For projects in GitHub a DOI for a released code version can easily be created using Zenodo, see https://guides.github.com/activities/citable-code/ for details.
Please note, best practice is to publish both, the URL for the updated repositories and the permanently archived version of the code / data used for this publication.
Yours, Astrid Kerkweg
Citation: https://doi.org/10.5194/egusphere-2023-1775-CEC1 -
AC1: 'Reply on CEC1', Qian Li, 12 Nov 2024
Dear Dr. Kerkweg,
Thank you for your guidance regarding the requirements for code availability in GMD publications. We appreciate the clear instructions on ensuring code accessibility through a persistent public archive.
We have created a persistent release for the exact version of the downscaling scripts used in this study and have archived it on Zenodo to meet GMD’s code availability standards. The Zenodo link for our code is: https://zenodo.org/records/14062314. We will include this link and the associated DOI in the "Code availability" section of the revised manuscript to ensure compliance with GMD’s guidelines.
Thank you once again for the reminder, and please let us know if there are any additional requirements.
Best regards,
Qian Li
Citation: https://doi.org/10.5194/egusphere-2023-1775-AC1
-
RC2: 'Comment on egusphere-2023-1775', Zhenxin Liu, 31 Oct 2024
comments:
This study proposes a self-supervised framework named TemDeep for temporal downscaling of atmospheric field data at arbitrary time resolutions. The main objective is to improve the temporal resolution of atmospheric variables by imposing a temporal coherence constraint, thereby reducing dependence on large amounts of high temporal resolution ground truth data. Initially, an encoder-decoder structured downscaling network is developed and pretrained on a subset of data exhibiting rapid transitions. Subsequently, this network is used to downscale fields from adjacent time points to generate fields at intermediate times. To better capture the dynamic trends of meteorological system movements, the study designs a flow estimation module to assist with field interpolation. Experimental results demonstrate that this approach effectively recovers evolutionary details and outperforms existing methods, achieving a restoration rate of 53.7% on the test set. To avoid generating abnormal values and guide the model away from local optima, spatial and temporal continuity regularization terms are incorporated into the loss function, further enhancing performance by 7.6%. The study has innovation of self-supervised learning Approach, spatial and temporal Continuity Regularization, high adaptability.Suggestions
1. Further explanation of the physical meaning of regularization: The spatial and temporal continuity regularization terms enhance smoothness in downscaling fields. However, further explanation of their physical relevance would increase interpredictability, such as how these constraints reflect realistic atmospheric system evolution characteristics.Evaluation of Model Complexity and Computational Efficiency: Although this approach outperforms other unsupervised methods in restoration rate, the computational cost’s impact on practical applications remains undiscussed. Evaluating the model’s computational efficiency, especially in large-scale meteorological datasets or real-time applications, would provide valuable insights.
Add more discussion on comparison with traditional down-scaling methods: to illustrate the advantages of TemDeep comparing to one or more physics-based numerical models, explain why this approach achieves superior performance in restoration rate and consistency under unsupervised conditions could offer deeper insights.
Citation: https://doi.org/10.5194/egusphere-2023-1775-RC2 -
AC2: 'Reply on RC2', Qian Li, 12 Nov 2024
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2023/egusphere-2023-1775/egusphere-2023-1775-AC2-supplement.pdf
-
AC2: 'Reply on RC2', Qian Li, 12 Nov 2024
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
465 | 156 | 34 | 655 | 27 | 37 |
- HTML: 465
- PDF: 156
- XML: 34
- Total: 655
- BibTeX: 27
- EndNote: 37
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1