the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
A unified synergistic retrieval of clouds, aerosols and precipitation from EarthCARE: the ACM-CAP product
Abstract. The ATLID-CPR-MSI retrieval of Clouds, Aerosols and Precipitation (ACM-CAP) product provides a synergistic “best-estimate” retrieval of the quantities and properties of all aerosols and hydrometeors detected by EarthCARE. While synergistic retrieval algorithms are now mature in many contexts, ACM-CAP is unique in providing a single unified retrieval product for all classes of hydrometeor—ice cloud and snow, drizzle and rain, and liquid clouds—and aerosol species, informed by the synergistic target classification (AC-TC). The simultaneous retrieval of the entire atmosphere with a single optimal estimation retrieval, called Cloud, Aerosol and Precipitation from mulTiple Instruments using a VAriational TEchnique (CAPTIVATE), allows for a robust accounting of observational and retrieval errors and the contributions of passive and integrated measurements in the context of layered and complex regimes, and for enforcing physical relationships between components (e.g. the conservation of precipitating mass flux through the melting layer).
We have demonstrated and evaluated the ACM-CAP product as applied to the three EarthCARE test scenes simulated from numerical weather model forecasts, using both case studies and statistical evaluation against the simulated measurements and the “true” quantities from the numerical model. We show that the retrievals are both strongly constrained by the observations from the active and passive instruments, and overall closely resemble the underlying model fields in terms of bulk quantities (e.g. cloud water content, precipitation mass flux, and aerosol extinction) and microphysical properties (e.g. cloud effective radius, median volume diameter, and aerosols lidar ratio). The retrieval performs best where the active instruments have strong and unambiguous signal: in ice clouds and snow, which is observed by both ATLID and CPR, and in light to moderate rain, where CPR signal is strong. In precipitation, CPR's Doppler capability permits enhanced retrievals of snow particle density and raindrop size. In complex and layered scenes where ATLID is obscured, we have shown that making a simple assumption about the presence and vertical distribution of liquid cloud in rain and mixed-phase clouds allows improved assimilation of MSI solar radiances. In combination with a constraint on CPR path-integrated attenuation from the ocean surface, this leads to improved retrievals of both liquid cloud and rain in mid-latitude stratiform precipitation. In the heaviest convective precipitation (i.e. greater than around 10 mm h-1), both active instruments are strongly attenuated and dominated by multiple scattering; in these situations ACM-CAP provides a seamless retrieval of cloud and precipitation, but one which is subject to a high degree of uncertainty. ACM-CAP's aerosol retrieval, constrained by ATLID and MSI solar radiances, is performed in hydrometeor-free parts of the atmosphere. The lidar backscatter is subject to high noise, while the solar radiances are expected to be dominated by uncertainties in surface properties especially over land. While the aerosol optical depth is well-constrained in the test scenes, there is a high degree of noise at the ~1 km resolution of the ACM-CAP product.
The use of numerical forecast models to simulate test scenes for testing and evaluation puts EarthCARE L2 processors at an unprecedented degree of readiness ahead of launch. While exposure to further simulated test scenes, campaign data, and ultimately in-flight EarthCARE measurements will motivate ongoing improvements to the representation of cloud and precipitation, the instrument forward-models, and their uncertainties, the present evaluation demonstrates that ACM-CAP will provide a novel unified and synergistic retrieval of clouds, aerosols and precipitation of high quality, including a robust accounting of the contributions of observations, and of measurement and retrieval errors.
-
Notice on discussion status
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
-
Preprint
(10739 KB)
-
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(10739 KB) - Metadata XML
- BibTeX
- EndNote
- Final revised paper
Journal article(s) based on this preprint
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2022-1195', Anonymous Referee #1, 09 Jan 2023
This is a very well written manuscript. I think Atmospheric Measurement Technique (AMT) readers will learn a lot about the logic and construction of the ACM-CAP satellite product. I do not have any suggestions on how to improve the manuscript. I look forward to seeing this manuscript published in AMT.
Citation: https://doi.org/10.5194/egusphere-2022-1195-RC1 -
AC1: 'Reply on RC1', Shannon Mason, 28 Feb 2023
We thank the reviewer for their feedback.
Citation: https://doi.org/10.5194/egusphere-2022-1195-AC1
-
AC1: 'Reply on RC1', Shannon Mason, 28 Feb 2023
-
RC2: 'Comment on egusphere-2022-1195', Anonymous Referee #2, 22 Jan 2023
The paper discusses a new algorithm which provides a synergistic “best-estimate” retrieval of the quantities and properties of all aerosols and hydrometeors detected by EarthCARE. The methods are very clearly described and the evaluation of all the results prior to real data shows good skill and a well balanced use of all the available information from the EarthCARE instruments.
The results from this algorithm will most likely be one of the most used EarthCARE products by the science community, especially as it has shown (radiatively) to provide superior results to a combination of single instrument retrievals.
Even though the paper is well written and all figures clearly presented there are a few minor revisions (both technical and textual) which will have to be made before the paper can be accepted for publication. The issues are specified by page and line numbers following the online PDF.
Page 1: Line 2: by EarthCARE --> by the EarthCARE instruments.
Line 4: and rain, and liquid clouds ; is the second and necessary there, I would remove it
Line 10/11 : you talk about three scenes but in line 11 say ‘using both case studies’. In the evaluation you only use the Hawaii, Halifax and Halifax-aerosol cases but not the third one. Please rephrase.
Page 2: Line 51: clouds are now mature --> clouds can now be considered mature.
Line 55: , the Moderate Resolution Imaging… ; also add the before ‘Cloud and the Earth’s …..’
Page 3: Lines 58-59: Please reformulate the line ‘One advantage …. scenes;
Line 59-60 Please reformulate line ‘For example ….phase clouds’ the second part does not seem to fit.
Page 4: Line 105: within in the ESA (remove in)
Line 117: Reference to Mason et al incorrect.
Line 122 for each. --> for each granule.
Page 5: Line 124: Missing citation to AC-TC
Page 6: Line 138: Missing citations to A-EBD, and in 140: to C-CD
Lines 142: What seems to be missing from the paper is a bit of context as described in the paper of Eisinger. The JSG should be mentioned here by a bit more than just the name, but also the data throughput of the data processing from single instrument L2a --> synergistic L2b. Please add a paragraph for context on the EarthCARE processing chain and choice of JSG
Line 157: In practice both the Hessian…
Page 7: Line 192.: On the discussion of why all variables are in elog space. The one issue which could arise is that when no negative retrievals (within the errors) are possible a bias could be introduced. Is this potentially the case, and if not why?
Table 1: This table is essential in order to understand how everything is linked and where the info comes from.
However, there is a problem with this as you describe parameters as, e.g. ln(S) but provide the linear value in the second column. Obviously I understand the why but it hurts the brain as it is confusing. My suggestion would be to show all parameters which are used logarithmically internally in boldface and remove the ln in the first columns. Describe this in the caption and all should be well.
The one remaining issue is the Lidar ratio, in this table you consistently use the backscatter to extinction ratio (units sr-1). However in the rest of the paper the lidar ratio is shown, in the more commonly used ratio, as extinction to backscatter ratio (i.e. line 351). Please change the table definition of S, even if your code uses the inverse in reality.
Page 11: Line 270: ‘is the retrieved as’ --> remove the
Line 293: Add references to A-TC and AC-TC
Page 12: Table 2 and Line 315 on page 13: Is Mie theory also used for dust aerosols? If so, what do you expect is the influence of this when used in the algorithm, do you experience biases with the MSI forward modelling due to this? Can you provide a short discussion on this around line 315
Page 14: Line 333: ‘2 m surface winds’. You have not described where the 2m winds are used for. My guess is a Cox-Munk like approach for the SW calculations?
Page 17: Lines 422-425; Page 32 Lines 587-592. Both the forward modelling of the test scenes and those of ACM-CAP have started with the definition of the same four basic aerosol types defined for all wavelength by the HETEAC model and therefore span exactly the same parameter space. There is indeed no interaction with the cloud microphysics but neither is this the case in ACM-CAP, since the AC-TC defines the targets. Wouldn’t it be more accurate to say that any differences seen between ACM-CAP and the model truth is could be due to differences in the RT models used and any LUTs resulting from this?
Line 435: ‘In the retrieved is systematically lower than the GEM model’ --> The retrieved is systematically lower than the GEM model values
Line 439-442 ‘this Warm … temperature.’ Rephrase this part, really hard to read, Warm --> warm
Line 445: sea level is a --> sea level shows a
Figure 3: Three areas of interest (A, B, C) are highlighted
Figure 12: panels a and b, text in bottom right not readable.
Page 29: tends --> tendency
Page 29, Line 545. Exhibit strong correlations. I agree that these are very strong correlations, similar to 14b-c , 16c. Doesn’t this just show how well the redistribution of information by the integrated measurements (MSI, PIA) is performed in the algorithm. The solution converges towards a fit of this information and since the integrated values have a relative smaller error compared to a single pixel lidar or radar value within the profile the correlation is very high. If the above argument is correct it would be good to reflect this in the text.
Page 30: Line 563 add a comment that in reality the ECMWF data will have different values to the truth as well (now with respect to the modelled fields).
Page 34: Line 621 which either is embedded
Citation: https://doi.org/10.5194/egusphere-2022-1195-RC2 -
AC2: 'Reply on RC2', Shannon Mason, 28 Feb 2023
We thank the reviewer for their constructive comments. We have responded to each comment in-line below, and will soon submit the updated manuscript including the changes described below.
Page 1: Line 2: by EarthCARE --> by the EarthCARE instruments.
Done
Line 4: and rain, and liquid clouds ; is the second and necessary there, I would remove it
Done.
Line 10/11 : you talk about three scenes but in line 11 say ‘using both case studies’. In the evaluation you only use the Hawaii, Halifax and Halifax-aerosol cases but not the third one. Please rephrase.
We agree that that was confusing. This now reads, “We have demonstrated and evaluated the ACM-CAP product as applied to EarthCARE test scenes simulated from numerical weather model forecasts, evaluating the product against the simulated measurements and the ``true'' quantities from the numerical model.”
Page 2: Line 51: clouds are now mature --> clouds can now be considered mature.
Thank you; done
Line 55: , the Moderate Resolution Imaging… ; also add the before ‘Cloud and the Earth’s …..’
Thank you; done.
Page 3: Lines 58-59: Please reformulate the line ‘One advantage …. Scenes;
This now reads, “Single-instrument retrievals can be especially subject to uncertainties in complex or layered scenes---a limitation that multiple-instrument synergies can help to overcome.”
Line 59-60 Please reformulate line ‘For example ….phase clouds’ the second part does not seem to fit.
Thank you; done
Page 4: Line 105: within in the ESA (remove in)
Thank you; done
Line 117: Reference to Mason et al incorrect.
We’ve removed the reference; this paper hasn’t yet been submitted
Line 122 for each. --> for each granule.
Thank you; done
Page 5: Line 124: Missing citation to AC-TC
Thank you; done
Page 6: Line 138: Missing citations to A-EBD, and in 140: to C-CD
Thank you; done
Lines 142: What seems to be missing from the paper is a bit of context as described in the paper of Eisinger. The JSG should be mentioned here by a bit more than just the name, but also the data throughput of the data processing from single instrument L2a --> synergistic L2b. Please add a paragraph for context on the EarthCARE processing chain and choice of JSG
We have added details about X-MET and X-JSG here, including links to the Eisinger paper. This paragraph now reads,
“CPR and MSI products are provided on their own instrument grids, while A-EBD is on the joint standard grid (JSG), which is initially defined by the auxiliary X-JSG data product (Eisinger et al., 2023) and then inherited by all ATLID and downstream synergistic L2 data products. The JSG provides the common reference grid at 1km horizontal (along-track) and 100m vertical resolution onto which all active measurements are mapped. Within the ACM-CAP processor the CPR and MSI measurements are first interpolated onto the common grid before the retrieval is carried out. To inform the interpretation and assimilation of each measurement, additional variables describing measurement uncertainties, and quality and detection statuses, are also read from each data product.”
Line 157: In practice both the Hessian…
Thank you; done
Page 7: Line 192.: On the discussion of why all variables are in elog space. The one issue which could arise is that when no negative retrievals (within the errors) are possible a bias could be introduced. Is this potentially the case, and if not why?
This is an interesting question. The first point is that an additional reason for using the logarithm is that many observed and retrieved variables, especially radar reflectivity, span many orders of magnitude; for this reason the use of logarithms is quite common and indeed the official CloudSat algorithms take the same approach (e.g. Austin et al., JGR 2009; Leinonen et al., JAMC 2016, which we now cite). But to fully address the question posed by the reviewer almost requires a separate study. Our understanding is as follows. By using logarithmic state variables, e.g. x=ln(LWC), the algorithm retrieves the expected value of x and an estimate of the standard deviation "sigma" of the probability distribution which is implicitly assumed to be Gaussian in ln(LWC) space. If we were to transform this probability distribution into linear LWC space then it would have a lognormal form such that the median of the new probability distribution is equal to exp(x), but the expected value would be larger with a value of exp(x+sigma^2/2) according to the property of lognormal distributions. If one wanted to know, say, the mean LWC of all clouds globally, then perhaps accounting for this difference would be needed, and it would be perfectly possible to compute given that we report the sigma value for all retrieved variables in the output product. But for radiative transfer applications, one of the major concerns of the EarthCARE mission, it is better to report the original retrieval, i.e. the expected value of the ln(LWC) probability distribution. This is because radiative properties of a cloud (shortwave albedo and longwave emissivity) are more linearly related to ln(optical depth) and hence ln(LWC) than they are to optical depth or LWC. These issues are applicable to a large number of radar algorithms, not just our own, so they deserve to be studied in detail in a future publication.
Table 1: This table is essential in order to understand how everything is linked and where the info comes from.
However, there is a problem with this as you describe parameters as, e.g. ln(S) but provide the linear value in the second column. Obviously I understand the why but it hurts the brain as it is confusing. My suggestion would be to show all parameters which are used logarithmically internally in boldface and remove the ln in the first columns. Describe this in the caption and all should be well.
The problem with Table 1, which we have now fixed, is that some of the stated a-priori values were for the logarithm of the microphysical quantity (e.g. ln(alpha_v) in ice), while others were of the quantity itself (e.g. LWC). We have now changed these entries so that all state the a-priori values for the actual state variable, i.e. the natural logarithm of the quantity (e.g. we now state "ln(10^-4)" for the a-priori of ln(LWC)). We do not think that using bold would be helpful since bold is used elsewhere in the paper to indicate vectors and matrices. So long as Table 1 is clear and consistent, and properly explained in the caption, we think this approach is preferrable.
The one remaining issue is the Lidar ratio, in this table you consistently use the backscatter to extinction ratio (units sr-1). However in the rest of the paper the lidar ratio is shown, in the more commonly used ratio, as extinction to backscatter ratio (i.e. line 351). Please change the table definition of S, even if your code uses the inverse in reality.
One role of the paper is to act as documentation for the algorithm and the product, which works with backscatter-to-extinction ratio S, so it would create more confusion to make the paper inconsistent with the product. The reason that the retrieval itself uses backscatter-to-extinction ratio, rather than lidar ratio, is that the former is more natural particle scattering property being similar in concept to the single scattering albedo (i.e. the scatter-to-extinction ratio). Also, for a completely absorbing particle the former tends to zero while the latter tends to infinity. The reviewer is right that the paper is inconsistent though: we have now replaced some incorrect uses of the term "lidar ratio" with "backscatter-to-extinction ratio" (in the abstract and Table 1). In the results section 3.4 we now state that our retrievals will be shown in the form of lidar ratio (the reciprocal of backscatter-to-extinction ratio) in order to be consistent with other EarthCARE papers in this special issue. We now no longer inconsistently use "S" for lidar ratio in the results section with units sr^-1, but use the acronym LR with units of sr.
Page 11: Line 270: ‘is the retrieved as’ --> remove the
Thank you; done
Line 293: Add references to A-TC and AC-TC
Thank you; done
Page 12: Table 2 and Line 315 on page 13: Is Mie theory also used for dust aerosols? If so, what do you expect is the influence of this when used in the algorithm, do you experience biases with the MSI forward modelling due to this? Can you provide a short discussion on this around line 315
This table was inaccurate: we use lookup tables of the scattering properties of the four HETEAC species, wherein the non-sphericity of coarse dust is accounted for as described in the HETEAC paper (Wandinger et al 2022). HETEAC is now cited directly in the table, both for the scattering properties and shape distributions, and the text has been updated to better describe the combination of lookup tables of scattering properties for the four HETEAC species.
Page 14: Line 333: ‘2 m surface winds’. You have not described where the 2m winds are used for. My guess is a Cox-Munk like approach for the SW calculations?
The surface winds were mentioned in error: we use the skin temperature for the thermal radiance model, but for the solar radiance forward model we rely on the surface albedo variable included in X-MET. Mention of the surface winds has been removed.
An option for a Cox-Munk like approach making use of the surface winds is a good and feasible suggestion, and should be the subject of future work.
Page 17: Lines 422-425; Page 32 Lines 587-592. Both the forward modelling of the test scenes and those of ACM-CAP have started with the definition of the same four basic aerosol types defined for all wavelength by the HETEAC model and therefore span exactly the same parameter space. There is indeed no interaction with the cloud microphysics but neither is this the case in ACM-CAP, since the AC-TC defines the targets. Wouldn’t it be more accurate to say that any differences seen between ACM-CAP and the model truth is could be due to differences in the RT models used and any LUTs resulting from this?
Thanks for pointing this out: these paragraphs certainly confused multiple issues, not all of which should not be interpreted as explaining the differences between the model truth and the retrieval.
The underlying HETEAC species in the test scenes and the retrieval are the same; however, the scene generation had access to the underlying quantities of the four HETEAC species freely varying in relation to one another, while the ACM-CAP retrieval can retrieve aerosols only with the predetermined mixtures of the four HETEAC species defined by the aerosol classes in A-TC. They may both be said to span the same parameter space, but the retrieval is not free to sample that parameter space evenly. The capacity of the ACM-CAP retrieval to recover the information in the model truth is therefore dependent on the classification from A-TC as well as the constraints applied within ACM-CAP. These latter indeed include the RT models and look-up tables, as well as the vertical representation and along-track Kalman smoothing, the treatment of observational errors, etc., etc.
We have re-written these two paragraphs to make fewer points more clearly.
Line 435: ‘In the retrieved is systematically lower than the GEM model’ --> The retrieved is systematically lower than the GEM model values
Thank you; done
Line 439-442 ‘this Warm … temperature.’ Rephrase this part, really hard to read, Warm --> warm
Thank you; done
Line 445: sea level is a --> sea level shows a
Thank you; done
Figure 3: Three areas of interest (A, B, C) are highlighted
Thank you; done
Figure 12: panels a and b, text in bottom right not readable.
Thank you; done
Page 29: tends --> tendency
Thank you; done
Page 29, Line 545. Exhibit strong correlations. I agree that these are very strong correlations, similar to 14b-c , 16c. Doesn’t this just show how well the redistribution of information by the integrated measurements (MSI, PIA) is performed in the algorithm. The solution converges towards a fit of this information and since the integrated values have a relative smaller error compared to a single pixel lidar or radar value within the profile the correlation is very high. If the above argument is correct it would be good to reflect this in the text.
In Figure 11 we are evaluating a retrieval against independent data, so a high correlation indicates a skilful retrieval, but in Fig. 12 we are comparing the forward model to the observations, so a high correlation simply indicates that the retrieval behaved correctly by trying to best fit the observations. We have changed the text so as not to imply that the correlation in Fig. 12 indicates skill but rather just a retrieval that is behaving sensibly.
Page 30: Line 563 add a comment that in reality the ECMWF data will have different values to the truth as well (now with respect to the modelled fields).
Done; we added a note that this uncertainty due to errors in the atmospheric state needs further investigation.
Page 34: Line 621 which either is embedded
Thank you; done
Citation: https://doi.org/10.5194/egusphere-2022-1195-AC2
-
AC2: 'Reply on RC2', Shannon Mason, 28 Feb 2023
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2022-1195', Anonymous Referee #1, 09 Jan 2023
This is a very well written manuscript. I think Atmospheric Measurement Technique (AMT) readers will learn a lot about the logic and construction of the ACM-CAP satellite product. I do not have any suggestions on how to improve the manuscript. I look forward to seeing this manuscript published in AMT.
Citation: https://doi.org/10.5194/egusphere-2022-1195-RC1 -
AC1: 'Reply on RC1', Shannon Mason, 28 Feb 2023
We thank the reviewer for their feedback.
Citation: https://doi.org/10.5194/egusphere-2022-1195-AC1
-
AC1: 'Reply on RC1', Shannon Mason, 28 Feb 2023
-
RC2: 'Comment on egusphere-2022-1195', Anonymous Referee #2, 22 Jan 2023
The paper discusses a new algorithm which provides a synergistic “best-estimate” retrieval of the quantities and properties of all aerosols and hydrometeors detected by EarthCARE. The methods are very clearly described and the evaluation of all the results prior to real data shows good skill and a well balanced use of all the available information from the EarthCARE instruments.
The results from this algorithm will most likely be one of the most used EarthCARE products by the science community, especially as it has shown (radiatively) to provide superior results to a combination of single instrument retrievals.
Even though the paper is well written and all figures clearly presented there are a few minor revisions (both technical and textual) which will have to be made before the paper can be accepted for publication. The issues are specified by page and line numbers following the online PDF.
Page 1: Line 2: by EarthCARE --> by the EarthCARE instruments.
Line 4: and rain, and liquid clouds ; is the second and necessary there, I would remove it
Line 10/11 : you talk about three scenes but in line 11 say ‘using both case studies’. In the evaluation you only use the Hawaii, Halifax and Halifax-aerosol cases but not the third one. Please rephrase.
Page 2: Line 51: clouds are now mature --> clouds can now be considered mature.
Line 55: , the Moderate Resolution Imaging… ; also add the before ‘Cloud and the Earth’s …..’
Page 3: Lines 58-59: Please reformulate the line ‘One advantage …. scenes;
Line 59-60 Please reformulate line ‘For example ….phase clouds’ the second part does not seem to fit.
Page 4: Line 105: within in the ESA (remove in)
Line 117: Reference to Mason et al incorrect.
Line 122 for each. --> for each granule.
Page 5: Line 124: Missing citation to AC-TC
Page 6: Line 138: Missing citations to A-EBD, and in 140: to C-CD
Lines 142: What seems to be missing from the paper is a bit of context as described in the paper of Eisinger. The JSG should be mentioned here by a bit more than just the name, but also the data throughput of the data processing from single instrument L2a --> synergistic L2b. Please add a paragraph for context on the EarthCARE processing chain and choice of JSG
Line 157: In practice both the Hessian…
Page 7: Line 192.: On the discussion of why all variables are in elog space. The one issue which could arise is that when no negative retrievals (within the errors) are possible a bias could be introduced. Is this potentially the case, and if not why?
Table 1: This table is essential in order to understand how everything is linked and where the info comes from.
However, there is a problem with this as you describe parameters as, e.g. ln(S) but provide the linear value in the second column. Obviously I understand the why but it hurts the brain as it is confusing. My suggestion would be to show all parameters which are used logarithmically internally in boldface and remove the ln in the first columns. Describe this in the caption and all should be well.
The one remaining issue is the Lidar ratio, in this table you consistently use the backscatter to extinction ratio (units sr-1). However in the rest of the paper the lidar ratio is shown, in the more commonly used ratio, as extinction to backscatter ratio (i.e. line 351). Please change the table definition of S, even if your code uses the inverse in reality.
Page 11: Line 270: ‘is the retrieved as’ --> remove the
Line 293: Add references to A-TC and AC-TC
Page 12: Table 2 and Line 315 on page 13: Is Mie theory also used for dust aerosols? If so, what do you expect is the influence of this when used in the algorithm, do you experience biases with the MSI forward modelling due to this? Can you provide a short discussion on this around line 315
Page 14: Line 333: ‘2 m surface winds’. You have not described where the 2m winds are used for. My guess is a Cox-Munk like approach for the SW calculations?
Page 17: Lines 422-425; Page 32 Lines 587-592. Both the forward modelling of the test scenes and those of ACM-CAP have started with the definition of the same four basic aerosol types defined for all wavelength by the HETEAC model and therefore span exactly the same parameter space. There is indeed no interaction with the cloud microphysics but neither is this the case in ACM-CAP, since the AC-TC defines the targets. Wouldn’t it be more accurate to say that any differences seen between ACM-CAP and the model truth is could be due to differences in the RT models used and any LUTs resulting from this?
Line 435: ‘In the retrieved is systematically lower than the GEM model’ --> The retrieved is systematically lower than the GEM model values
Line 439-442 ‘this Warm … temperature.’ Rephrase this part, really hard to read, Warm --> warm
Line 445: sea level is a --> sea level shows a
Figure 3: Three areas of interest (A, B, C) are highlighted
Figure 12: panels a and b, text in bottom right not readable.
Page 29: tends --> tendency
Page 29, Line 545. Exhibit strong correlations. I agree that these are very strong correlations, similar to 14b-c , 16c. Doesn’t this just show how well the redistribution of information by the integrated measurements (MSI, PIA) is performed in the algorithm. The solution converges towards a fit of this information and since the integrated values have a relative smaller error compared to a single pixel lidar or radar value within the profile the correlation is very high. If the above argument is correct it would be good to reflect this in the text.
Page 30: Line 563 add a comment that in reality the ECMWF data will have different values to the truth as well (now with respect to the modelled fields).
Page 34: Line 621 which either is embedded
Citation: https://doi.org/10.5194/egusphere-2022-1195-RC2 -
AC2: 'Reply on RC2', Shannon Mason, 28 Feb 2023
We thank the reviewer for their constructive comments. We have responded to each comment in-line below, and will soon submit the updated manuscript including the changes described below.
Page 1: Line 2: by EarthCARE --> by the EarthCARE instruments.
Done
Line 4: and rain, and liquid clouds ; is the second and necessary there, I would remove it
Done.
Line 10/11 : you talk about three scenes but in line 11 say ‘using both case studies’. In the evaluation you only use the Hawaii, Halifax and Halifax-aerosol cases but not the third one. Please rephrase.
We agree that that was confusing. This now reads, “We have demonstrated and evaluated the ACM-CAP product as applied to EarthCARE test scenes simulated from numerical weather model forecasts, evaluating the product against the simulated measurements and the ``true'' quantities from the numerical model.”
Page 2: Line 51: clouds are now mature --> clouds can now be considered mature.
Thank you; done
Line 55: , the Moderate Resolution Imaging… ; also add the before ‘Cloud and the Earth’s …..’
Thank you; done.
Page 3: Lines 58-59: Please reformulate the line ‘One advantage …. Scenes;
This now reads, “Single-instrument retrievals can be especially subject to uncertainties in complex or layered scenes---a limitation that multiple-instrument synergies can help to overcome.”
Line 59-60 Please reformulate line ‘For example ….phase clouds’ the second part does not seem to fit.
Thank you; done
Page 4: Line 105: within in the ESA (remove in)
Thank you; done
Line 117: Reference to Mason et al incorrect.
We’ve removed the reference; this paper hasn’t yet been submitted
Line 122 for each. --> for each granule.
Thank you; done
Page 5: Line 124: Missing citation to AC-TC
Thank you; done
Page 6: Line 138: Missing citations to A-EBD, and in 140: to C-CD
Thank you; done
Lines 142: What seems to be missing from the paper is a bit of context as described in the paper of Eisinger. The JSG should be mentioned here by a bit more than just the name, but also the data throughput of the data processing from single instrument L2a --> synergistic L2b. Please add a paragraph for context on the EarthCARE processing chain and choice of JSG
We have added details about X-MET and X-JSG here, including links to the Eisinger paper. This paragraph now reads,
“CPR and MSI products are provided on their own instrument grids, while A-EBD is on the joint standard grid (JSG), which is initially defined by the auxiliary X-JSG data product (Eisinger et al., 2023) and then inherited by all ATLID and downstream synergistic L2 data products. The JSG provides the common reference grid at 1km horizontal (along-track) and 100m vertical resolution onto which all active measurements are mapped. Within the ACM-CAP processor the CPR and MSI measurements are first interpolated onto the common grid before the retrieval is carried out. To inform the interpretation and assimilation of each measurement, additional variables describing measurement uncertainties, and quality and detection statuses, are also read from each data product.”
Line 157: In practice both the Hessian…
Thank you; done
Page 7: Line 192.: On the discussion of why all variables are in elog space. The one issue which could arise is that when no negative retrievals (within the errors) are possible a bias could be introduced. Is this potentially the case, and if not why?
This is an interesting question. The first point is that an additional reason for using the logarithm is that many observed and retrieved variables, especially radar reflectivity, span many orders of magnitude; for this reason the use of logarithms is quite common and indeed the official CloudSat algorithms take the same approach (e.g. Austin et al., JGR 2009; Leinonen et al., JAMC 2016, which we now cite). But to fully address the question posed by the reviewer almost requires a separate study. Our understanding is as follows. By using logarithmic state variables, e.g. x=ln(LWC), the algorithm retrieves the expected value of x and an estimate of the standard deviation "sigma" of the probability distribution which is implicitly assumed to be Gaussian in ln(LWC) space. If we were to transform this probability distribution into linear LWC space then it would have a lognormal form such that the median of the new probability distribution is equal to exp(x), but the expected value would be larger with a value of exp(x+sigma^2/2) according to the property of lognormal distributions. If one wanted to know, say, the mean LWC of all clouds globally, then perhaps accounting for this difference would be needed, and it would be perfectly possible to compute given that we report the sigma value for all retrieved variables in the output product. But for radiative transfer applications, one of the major concerns of the EarthCARE mission, it is better to report the original retrieval, i.e. the expected value of the ln(LWC) probability distribution. This is because radiative properties of a cloud (shortwave albedo and longwave emissivity) are more linearly related to ln(optical depth) and hence ln(LWC) than they are to optical depth or LWC. These issues are applicable to a large number of radar algorithms, not just our own, so they deserve to be studied in detail in a future publication.
Table 1: This table is essential in order to understand how everything is linked and where the info comes from.
However, there is a problem with this as you describe parameters as, e.g. ln(S) but provide the linear value in the second column. Obviously I understand the why but it hurts the brain as it is confusing. My suggestion would be to show all parameters which are used logarithmically internally in boldface and remove the ln in the first columns. Describe this in the caption and all should be well.
The problem with Table 1, which we have now fixed, is that some of the stated a-priori values were for the logarithm of the microphysical quantity (e.g. ln(alpha_v) in ice), while others were of the quantity itself (e.g. LWC). We have now changed these entries so that all state the a-priori values for the actual state variable, i.e. the natural logarithm of the quantity (e.g. we now state "ln(10^-4)" for the a-priori of ln(LWC)). We do not think that using bold would be helpful since bold is used elsewhere in the paper to indicate vectors and matrices. So long as Table 1 is clear and consistent, and properly explained in the caption, we think this approach is preferrable.
The one remaining issue is the Lidar ratio, in this table you consistently use the backscatter to extinction ratio (units sr-1). However in the rest of the paper the lidar ratio is shown, in the more commonly used ratio, as extinction to backscatter ratio (i.e. line 351). Please change the table definition of S, even if your code uses the inverse in reality.
One role of the paper is to act as documentation for the algorithm and the product, which works with backscatter-to-extinction ratio S, so it would create more confusion to make the paper inconsistent with the product. The reason that the retrieval itself uses backscatter-to-extinction ratio, rather than lidar ratio, is that the former is more natural particle scattering property being similar in concept to the single scattering albedo (i.e. the scatter-to-extinction ratio). Also, for a completely absorbing particle the former tends to zero while the latter tends to infinity. The reviewer is right that the paper is inconsistent though: we have now replaced some incorrect uses of the term "lidar ratio" with "backscatter-to-extinction ratio" (in the abstract and Table 1). In the results section 3.4 we now state that our retrievals will be shown in the form of lidar ratio (the reciprocal of backscatter-to-extinction ratio) in order to be consistent with other EarthCARE papers in this special issue. We now no longer inconsistently use "S" for lidar ratio in the results section with units sr^-1, but use the acronym LR with units of sr.
Page 11: Line 270: ‘is the retrieved as’ --> remove the
Thank you; done
Line 293: Add references to A-TC and AC-TC
Thank you; done
Page 12: Table 2 and Line 315 on page 13: Is Mie theory also used for dust aerosols? If so, what do you expect is the influence of this when used in the algorithm, do you experience biases with the MSI forward modelling due to this? Can you provide a short discussion on this around line 315
This table was inaccurate: we use lookup tables of the scattering properties of the four HETEAC species, wherein the non-sphericity of coarse dust is accounted for as described in the HETEAC paper (Wandinger et al 2022). HETEAC is now cited directly in the table, both for the scattering properties and shape distributions, and the text has been updated to better describe the combination of lookup tables of scattering properties for the four HETEAC species.
Page 14: Line 333: ‘2 m surface winds’. You have not described where the 2m winds are used for. My guess is a Cox-Munk like approach for the SW calculations?
The surface winds were mentioned in error: we use the skin temperature for the thermal radiance model, but for the solar radiance forward model we rely on the surface albedo variable included in X-MET. Mention of the surface winds has been removed.
An option for a Cox-Munk like approach making use of the surface winds is a good and feasible suggestion, and should be the subject of future work.
Page 17: Lines 422-425; Page 32 Lines 587-592. Both the forward modelling of the test scenes and those of ACM-CAP have started with the definition of the same four basic aerosol types defined for all wavelength by the HETEAC model and therefore span exactly the same parameter space. There is indeed no interaction with the cloud microphysics but neither is this the case in ACM-CAP, since the AC-TC defines the targets. Wouldn’t it be more accurate to say that any differences seen between ACM-CAP and the model truth is could be due to differences in the RT models used and any LUTs resulting from this?
Thanks for pointing this out: these paragraphs certainly confused multiple issues, not all of which should not be interpreted as explaining the differences between the model truth and the retrieval.
The underlying HETEAC species in the test scenes and the retrieval are the same; however, the scene generation had access to the underlying quantities of the four HETEAC species freely varying in relation to one another, while the ACM-CAP retrieval can retrieve aerosols only with the predetermined mixtures of the four HETEAC species defined by the aerosol classes in A-TC. They may both be said to span the same parameter space, but the retrieval is not free to sample that parameter space evenly. The capacity of the ACM-CAP retrieval to recover the information in the model truth is therefore dependent on the classification from A-TC as well as the constraints applied within ACM-CAP. These latter indeed include the RT models and look-up tables, as well as the vertical representation and along-track Kalman smoothing, the treatment of observational errors, etc., etc.
We have re-written these two paragraphs to make fewer points more clearly.
Line 435: ‘In the retrieved is systematically lower than the GEM model’ --> The retrieved is systematically lower than the GEM model values
Thank you; done
Line 439-442 ‘this Warm … temperature.’ Rephrase this part, really hard to read, Warm --> warm
Thank you; done
Line 445: sea level is a --> sea level shows a
Thank you; done
Figure 3: Three areas of interest (A, B, C) are highlighted
Thank you; done
Figure 12: panels a and b, text in bottom right not readable.
Thank you; done
Page 29: tends --> tendency
Thank you; done
Page 29, Line 545. Exhibit strong correlations. I agree that these are very strong correlations, similar to 14b-c , 16c. Doesn’t this just show how well the redistribution of information by the integrated measurements (MSI, PIA) is performed in the algorithm. The solution converges towards a fit of this information and since the integrated values have a relative smaller error compared to a single pixel lidar or radar value within the profile the correlation is very high. If the above argument is correct it would be good to reflect this in the text.
In Figure 11 we are evaluating a retrieval against independent data, so a high correlation indicates a skilful retrieval, but in Fig. 12 we are comparing the forward model to the observations, so a high correlation simply indicates that the retrieval behaved correctly by trying to best fit the observations. We have changed the text so as not to imply that the correlation in Fig. 12 indicates skill but rather just a retrieval that is behaving sensibly.
Page 30: Line 563 add a comment that in reality the ECMWF data will have different values to the truth as well (now with respect to the modelled fields).
Done; we added a note that this uncertainty due to errors in the atmospheric state needs further investigation.
Page 34: Line 621 which either is embedded
Thank you; done
Citation: https://doi.org/10.5194/egusphere-2022-1195-AC2
-
AC2: 'Reply on RC2', Shannon Mason, 28 Feb 2023
Peer review completion
Post-review adjustments
Journal article(s) based on this preprint
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
413 | 212 | 18 | 643 | 12 | 7 |
- HTML: 413
- PDF: 212
- XML: 18
- Total: 643
- BibTeX: 12
- EndNote: 7
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1
Cited
6 citations as recorded by crossref.
- Cloud and precipitation microphysical retrievals from the EarthCARE Cloud Profiling Radar: the C-CLD product K. Mroz et al. 10.5194/amt-16-2865-2023
- Detection of aerosol and cloud features for the EarthCARE atmospheric lidar (ATLID): the ATLID FeatureMask (A-FM) product G. van Zadelhoff et al. 10.5194/amt-16-3631-2023
- The EarthCARE mission – science and system overview T. Wehr et al. 10.5194/amt-16-3581-2023
- The classification of atmospheric hydrometeors and aerosols from the EarthCARE radar and lidar: the A-TC, C-TC and AC-TC products A. Irbah et al. 10.5194/amt-16-2795-2023
- HETEAC – the Hybrid End-To-End Aerosol Classification model for EarthCARE U. Wandinger et al. 10.5194/amt-16-2485-2023
- Processing reflectivity and Doppler velocity from EarthCARE's cloud-profiling radar: the C-FMR, C-CD and C-APC products P. Kollias et al. 10.5194/amt-16-1901-2023
Robin J. Hogan
Alessio Bozzo
Nicola L. Pounder
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(10739 KB) - Metadata XML