the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Accelerating greenhouse gas retrievals with neural network-based forward models
Abstract. Greenhouse gas (GHG) retrievals rely on repeated evaluations of computationally expensive physics-based forward models, which limit the feasibility of near-real-time retrievals and timely detection of emission hotspots. A promising alternative is to replace these forward models with fast machine learning emulators trained to approximate their input-output mapping, while retaining the overall retrieval algorithm.
Here, we assess the feasibility of this approach in the context of the Sentinel-5 mission, systematically comparing two different emulation strategies: an end-to-end approach, which directly approximates the full forward model with neural networks, and a hybrid approach, which combines fast non-scattering simulations with a neural network-based correction for atmospheric scattering effects. We comprehensively validate each emulator in the full retrieval chain, evaluating their impact on the accuracy of retrieved XCO2 and XCH4.
Our results show that a hybrid approach is needed to meet the stringent accuracy requirements on XCH4 and XCO2. While the end-to-end emulator achieves large speed-ups exceeding a factor of 300, it introduces considerable errors of 7.22 ppb for XCH4 and 4.25 ppm for XCO2 compared to full-physics retrievals, and fails to generalize to high-emission scenarios beyond the training range. In contrast, the hybrid approach can effectively leverage the information provided by the non-scattering approximation, reducing emulator-induced retrieval errors to less than 1.5 ppb for XCH4 and 0.5 ppm for XCO2, while still being an order of magnitude faster than full-physics retrievals and maintaining robust performance for high-emission scenarios.
Together, these results pave the way for operational deployment of neural network-based forward models in GHG retrievals from Sentinel-5, and more broadly demonstrate the potential of hybrid machine learning emulators to facilitate timely and accurate processing of the rapidly growing data volumes from modern satellite missions.
Competing interests: At least one of the (co-)authors is a member of the editorial board of Atmospheric Measurement Techniques.
Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.- Preprint
(3598 KB) - Metadata XML
- BibTeX
- EndNote
Status: final response (author comments only)
- RC1: 'Comment on egusphere-2026-4724', Anonymous Referee #1, 27 Aug 2026
-
RC2: 'Comment on egusphere-2026-4724', Anonymous Referee #2, 11 Sep 2026
The manuscript describes interesting research about using neural networks (NN) for trace gas retrievals. It should be noted that although this topic is not new and there are a lot pf papers in this field, this research has a unique contribution. In particular the manuscript investigates the so called neural network emulators of radiative transfer models (RTM) for Sentinel 5P. There is a comparison of a purely data-driven emulator with hybrid approaches in which RTMs without scattering + NN correction is applied. The presented emulators are evaluated in the complete retrieval algorithm, that means including Jacobian computations.
I think that the topic is highly relevant for the journal. The manuscript is well organized and I recommend the paper for publication. I suggest that some points should be clarified.
1. The main drawback is that the tests (although performed in the retrieval framework) are based on synthetic data. There are several simplifications adopted by the authors (known noise model, aerosol parameters, cloud free cases, Lambertian albedo etc). In practice, we are dealing with much larger uncertainties. I do not think that an evaluation with real S5p data is a must for this paper, but at least it should be seen in the title and throughout the paper that we are dealing with “a model-consistent synthetic experiment”. Also claims about operational implementation should be formulated more carefully.
2. We see that the base emulator reaches a plateau at large training-set sizes. And it is interpreted as a saturation of the network capacity (line 415). If the base emulator capacity is limited, part of the large difference between the base and hybrid approaches could result from the chosen architecture rather than the hybrid formulation itself. So far we see that the hybrid representation makes the learning problem much easier (what we can expect), but the stronger conclusion that a base approach cannot reach the required accuracy cannot be made. Therefore I suggest adding a control experiment with a substantially larger base MLP, at least for the full training set in order to check whether the remaining performance gap persists when network capacity is increased. Also the conclusions regarding the fundamental limitations of “end-to-end” emulation should be softened.
3. The fact that usable Jacobians emerge from networks trained only on radiances is an interesting result. At present, however, the operational implementation evaluates the derivatives by finite differences because automatic differentiation is not available through FTorch. The finite-difference steps were selected by comparison with PyTorch derivatives. I suggest providing a quantitative measure of the finite-difference error relative to the automatic-differentiation result, rather than stating only that it is negligible. Also, correlation coefficients alone can be misleading for derivatives with small amplitudes.
4. As a continuation of point 3, a discussion about the possibility of adding into a loss term an L2 discrepancy of Jacobians would be very beneficial.
5. The high-emission experiment scales the entire CH4 reference profile. Since the paper motivates the method partly through rapid detection of emission hotspots, it would be useful to mention that real enhancements can be vertically localized and do not necessarily correspond to uniform scaling of the reference profile. I do not consider a new experiment essential, but this limitation should be acknowledged.
6. In introduction authors mention principal component analysis (PCA) based compression schemes. In the given references two different concepts of PCA models are presented (one is for output radiances, another is for input parameters), hence it is not correct to unite them into a single concept of PCA.
7. Some justification of the chosen architecture of NN should be given.
8. The idea of using an approximate model without scattering as a precursor is nice. I suggest to add a comparison of the approximate model with full RT simulations to see the amplitude of differences between them and the effect of the NN correction for the spectral radiances.Citation: https://doi.org/10.5194/egusphere-2026-4724-RC2
Viewed
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 185 | 130 | 33 | 348 | 33 | 35 |
- HTML: 185
- PDF: 130
- XML: 33
- Total: 348
- BibTeX: 33
- EndNote: 35
Viewed (geographical distribution)
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
Review of “Accelerating greenhouse gas retrievals with neural network-based forward models” by Fiona Lippert et al.
General comments
This new study investigates the use of neural network-based forward model emulators to accelerate greenhouse gas retrievals from Sentinel-5 measurements. The authors compare a fully data-driven end-to-end emulator with two hybrid approaches that combine a fast non-scattering radiative transfer model with a neural network correction for scattering effects. The different approaches are evaluated comprehensively in terms of spectral accuracy, Jacobians, retrieval performance, computational efficiency, sensitivity to training data volume, and generalization to methane concentrations outside the training range. The results clearly demonstrate the advantages of the hybrid approach. It achieves retrieval accuracies close to the full-physics reference, substantially improves robustness and data efficiency compared with the purely data-driven emulator, and still provides significant computational speed-ups.
Overall, I find this to be an excellent and very convincing study. The methodology is sound, the experimental design is comprehensive, and the results are robust and remarkably clear. In particular, I appreciate that the authors evaluate the proposed emulators not only in terms of spectral accuracy, but throughout the complete retrieval chain, including Jacobians, retrieval accuracy, computational performance, sensitivity to training data volume, and extrapolation beyond the training range. The manuscript is also very well written and provides sufficient detail to understand and reproduce the approach. I therefore recommend acceptance subject to minor revisions, as outlined below.
Specific comments
Line 10: I suggest expressing the emulator-induced XCH4 and XCO2 errors also, or perhaps preferably, as relative errors in percent, as these may be easier for readers to assess than the absolute values in ppb and ppm. In addition, reporting values such as 7.22 ppb and 4.25 ppm with three significant digits may suggest a level of precision that is not warranted for these summary error metrics; fewer significant digits might be more appropriate.
Lines 155–160: The atmosphere is represented by only 20 homogeneous layers that are equidistant in pressure. This may well be sufficient for the present retrieval setup, but it would be useful to briefly justify this choice, for example by referring to previous sensitivity studies or established RemoTeC/LINTRAN configurations showing that this vertical resolution is adequate for XCH4 and XCO2 retrievals.
Lines 165–170: The aerosol representation involves several simplifying assumptions, including spherical particles, fixed refractive indices, and a prescribed vertical distribution. These assumptions may be well established for the RemoTeC retrieval framework, but it would be helpful to briefly motivate them here or refer more explicitly to previous studies demonstrating that this simplified aerosol representation is adequate for the present XCH4/XCO2 retrieval application.
Lines 207–219: The logarithmic transformation of the radiances and the PCA-based dimensionality reduction appear to be important and well-motivated design choices for reducing the complexity of the learning problem. Could the authors briefly comment on how important these steps are in practice? For example, did tests without the logarithmic transformation or PCA result in noticeably less stable training or reduced emulator accuracy? A short qualitative statement based on their model-development experience would already be helpful.
Lines 305–310: Reducing the 20-layer temperature profiles to only two principal components is an efficient way to limit the dimensionality of the neural network input. At the same time, this may remove finer-scale vertical temperature structure. Could the authors briefly comment on whether such information is expected to be relevant for the Sentinel-5 retrieval geometry considered here, and whether two principal components were found to be sufficient in sensitivity tests or previous retrieval studies?
Lines 430–435: Since the Jacobian evaluation is an important part of demonstrating that the emulators can be used reliably within the iterative retrieval, I suggest moving one representative Jacobian figure from Appendix A into the main text. In addition, Figures A1–A3 show noticeably larger deviations for the aerosol central height (z_aer). The manuscript notes that this parameter also has the lowest instrument sensitivity; could the authors briefly discuss whether the reduced Jacobian agreement is mainly a consequence of this weak sensitivity and whether it has any noticeable impact on the retrieval performance?
Line 470: The runtime comparison is based on measurements on a single CPU core. It may be useful to briefly note that the reported relative speed-ups are implementation- and hardware-dependent, in particular since neural network inference may benefit considerably from GPU acceleration or batched processing.
Lines 538–540: The suggestion that emulator-based retrievals could ultimately exceed the accuracy of operational full-physics retrievals is interesting, but appears somewhat speculative based on the present results. The authors should qualify the statement as a possible future perspective.
Lines 555–560: Given that the present evaluation is based entirely on synthetic measurements, I suggest slightly qualifying the statement that the hybrid emulators are candidates for implementation in operational Sentinel-5 processing. The authors appropriately discuss the need for evaluation with real measurements later in this section, so a small wording adjustment here would make the distinction between demonstrated feasibility and operational readiness clearer. Also, “this emulators” should read “these emulators”.
Technical corrections
Line 160: “reach the required accuracy required”: please remove the duplicated “required”.
Line 525: A full stop is missing after “training distribution”.
Figure B1 caption: “aerosol layer hight” should read “aerosol layer height”.