LARDAS v1.0: a latent-space aerosol–radiance data assimilation system for joint aerosol–surface constraints from satellite shortwave observations
Abstract. Satellite aerosol data assimilation has traditionally relied on retrieved aerosol products, introducing a "retrieve-then-assimilate" pathway that can propagate retrieval uncertainties and impose assumptions inconsistent with atmospheric models. Direct assimilation of satellite shortwave observations provides a more physically consistent alternative by constraining model states directly in observation space, but its application remains challenging because nonlinear radiative transfer calculations and high-dimensional state optimization are computationally demanding. Here we develop LARDAS (Latent-space Aerosol–Radiance Data Assimilation System), a differentiable latent-space framework that directly assimilates multi-band satellite shortwave reflectance to jointly constrain aerosol optical depth (AOD) and land-surface white-sky albedo. LARDAS combines variational autoencoder-based latent representations of aerosol and surface fields with a differentiable neural radiative transfer emulator, enabling gradient-based optimization from observation space to atmospheric state space. Five-band MODIS top-of-atmosphere reflectances are assimilated through an integrated observation operator consisting of latent decoders, an aerosol refinement network, and band-specific neural radiative transfer surrogates trained against VLIDORT. The proposed framework reduces the control space from approximately 2×5×141×141 physical variables to 256 latent variables while maintaining high reconstruction fidelity (median fraction skill scores >0.95 for aerosol fields and >0.98 for surface albedo). The neural radiative transfer emulator reproduces VLIDORT reflectance simulations with correlations exceeding 0.999 and RMSE below 0.003. Controlled experiments demonstrate that LARDAS can recover aerosol and surface states from multi-band reflectance observations. Real-data assimilation experiments using MODIS observations over eastern China show that LARDAS improves independent AERONET AOD evaluation relative to the model background and aerosol-product assimilation, while achieving comparable skill to physical-space radiance assimilation at approximately three orders of magnitude lower online computational cost under the operationally feasible CPU/GPU deployment configurations used here. Independent CERES validation further demonstrates that joint aerosol–surface optimization improves simulated shortwave radiation, particularly surface upward shortwave flux, where reflectance assimilation substantially reduces biases compared with aerosol-only assimilation. These results demonstrate that latent-space observation-to-state inference provides an efficient and physically consistent pathway toward next-generation satellite aerosol assimilation systems.
Dear authors,
Unfortunately, after checking your manuscript, it has come to our attention that it does not comply with our "Code and Data Policy".
https://www.geoscientific-model-development.net/policies/code_and_data_policy.html
Namely, to access the MODIS and AERONET data used in your study you cite some NASA sites that do not comply with the policy of the journal, as they do not appear to have a published policy for data preservation over many years or decades (some flexibility exists over the precise length of preservation, but the policy must exist).
If we have missed a published policy which does in fact address this matter satisfactorily, please post a response linking to it. If you have any questions about this issue, please post them in a reply.
I note here that in the Zenodo repository that you have included some data sample files seem to be available, but not all the data necessary to replicate your work, and it is unclear what prevents you of correctly sharing all the data instead of simple samples.
The GMD review and publication process depends on reviewers and community commentators being able to access, during the discussion phase, the code and data on which a manuscript depends, and on ensuring the provenance of replicability of the published papers for years after their publication. Please, therefore, publish your data in one of the appropriate repositories and reply to this comment with the relevant information (link and a permanent identifier for it (e.g. DOI)) as soon as possible. We cannot have manuscripts under discussion that do not comply with our policy.
Later, if the Topical Editor decides to continue with the review or publication process of your manuscript and you are requested to upload a new version of it, then The 'Code and Data Availability’ section of your manuscript must also be modified to cite the new repository locations, and corresponding references added to the bibliography.
Please, be aware that if you do not fix or provide a reply to this problem that addresses the outstanding issues satisfactorily, we cannot continue with the peer-review process or accept your manuscript for publication in GMD.
Juan A. Añel
Geosci. Model Dev. Executive Editor