Process-based constraints are not sufficient: evaluating their role in combination with state variable-based constraints on aerosol–cloud radiative forcing
Abstract. Atmospheric aerosols and their interactions with clouds remain one of the largest sources of uncertainty in estimates of effective radiative forcing from aerosol–cloud interactions (ΔFaci). While perturbed parameter ensembles (PPEs) have been used to explore and constrain this uncertainty using observed state variables, recent work has proposed process-based constraints, such as the slope of the relationship between cloud droplet number concentration (Nd) and liquid water path (L), as potentially more informative indicators. Here we evaluate the effectiveness of the Nd–L slope as a process-based constraint using the UKESM1 model across three climatically distinct marine regions, and compare it with a previously established state variable-based constraint. The slope primarily constrains uncertainty associated with physical atmosphere parameters, while state-based observations constrain aerosol emissions and processes. However, the slope constraint alone produces only small reductions in Nd, L, and ΔFaci uncertainty. Combining the slope and state-based observations further constrains ΔFaci beyond the state-based constraint alone (up to an additional 36 % reduction in uncertainty). However, the combined constraint appears to rely on compensating parameter effects, highlighting structural limitations in the model representation of aerosol–cloud interactions. Our results show that process-based constraints provide complementary information to state-variable constraints, but cannot be used in isolation to meaningfully constrain ΔFaci. Specifically, combining process-based and state-variable constraints reveals structural deficiencies in current climate models, indicating that reducing uncertainty in ΔFaci ultimately requires improved representation of aerosol–cloud coupling.
Review of Ghosh et al. “Process-based constraints are not sufficient: evaluating their role in combination with state variable-based constraints on aerosol-cloud radiative forcing” submitted to ACP.
Summary:
Leveraging perturbed parameter ensembles (PPEs) that yield information on parametric uncertainty in climate models, the authors aim to determine how new process-based constraints can reduce the parametric uncertainty space. Their efforts build on those that use typical mean-state (i.e., average radiation, average precipitation, average water vapor, etc.) constraints to isolate the plausible sets of parameters that can be used in models. The effort to use process-based constraints alongside mean-state ones is conceptually quite appealing, and thus this paper is welcomed. The paper is quite dense and there is a lot of material to go through in terms of sensitivities that are quantified, etc. It was hard to keep track and collectively aggregate and assess all of these details, so my review largely focuses on the implementation of the new process-based constraint -- specifically, computation of and use of the observed/simulated relationship between liquid water path (L) and droplet number concentration (Nd) -- and questions that arise related to the computation of this relationship, and quantitative implementation of this constraint on a regime by regime basis. Addressing my general questions below might result in manuscript modifications that fall between minor and major revisions.
General Comments:
1.The approach to use the observed relationships between L and Nd in a few K-means clusters (where clusters are defined as those that have emergent uncertainty likely impacted by similar sets of parameters) as constraints was novel. But, spatially, the clusters have quite odd geometric shapes (in terms of where they span geographically and how amorphous they are; see Figure 1). In my own modeling work, for example, I am aware that simulated stratocumulus fields occur to the east (by a few hundred km, or a few ESM grid boxes) of where they occur in nature. When I am doing my regime-by-regime comparison, I try to eyeball and correct for this spatial misalignment so that I can then focus on the thermodynamics-cloud relationships in the regimes without enforcing that they *must* occur within the same amorphous spatial bounds. Of course, at the end of the day, we would want there to be spatial alignment of simulated-observed cloud regimes on Earth, but there are myriad reasons why this might not occur even in AMIP-style mode (circulation, large scale modes of variability, topography representation). And I am not even 100% sure that nudging would force the regimes to be exactly spatially coincident. Have you determined if your “hotspots” of marine cloud locations within the spatial clusters you identify are at least spatially co-aligned across the models and observations? Can you ensure this? In effect, you are forcing a restricted amorphous geographic domain to be used for constraint, and nudging will help this, but your regimes (clusters) are quite oddly shaped (especially the SE Pacific one). Commentary and a possible supplementary set of images showing that at least the cloud-aerosol processes we are aiming to constrain with observations are (in the spatial sense) simultaneously occurring in these amorphous geographic domains in the observations would be very beneficial. It would be a shame to misunderstand the constraint simply because in nature, these regimes are spatially shifted or have their own different amorphous shapes, and I’ve suffered from this in my own past work when trying to compare regional observations to the same region in models. You could start with the clusters as you’ve identified them, and then shrink them down to smaller domains in some way (perhaps by looking at where hotspots/peaks or storm-track enhancements in LWP occur?). If they are suitable as derived and spatial alignment not an issue, this reviewer would appreciate being convinced of that.
2.The observed Nd-L relationship (from MODIS) for the 3 different regimes, in the supplementary section, shows a negative (or near zero) relationship always, and I realize this is because of sampling that has to do with a min Nd threshold for observational sensitivity, but this makes me very concerned because the min Nd for which the linear fit is performed is really quite low, and the turn-over point (from positive to negative slope) in the PPE members are really quite variable. And, taking a step back even further, sometimes, the inclination to even fit a line to a number of these scatterplots is, well, questionable (e.g., in the observations, Fig. S4a, d or Fig. S6a) – I guess I’d not advise my students in class that a good analysis would start with fitting lines to some of these scatterplots. But, if it must be done this way and lines must be fit, why not just eyeball the approximate min Nd threshold from MODIS and use the same min for the model PPE members, and compute the slopes for the model PPE from that same min Nd onward? I see some PPE members actually have that negative slope beginning at lower Nd, so could they perhaps be better performing if we quantified the starting Nd for slopes differently? I realize that the authors didn’t want to force a specific Nd and L magnitude agreement, but that is a subjective decision, and it is not clear to me that having or not having the same slope from a really noisy set of points *and* one that is defined from differing Nd minmax intervals is the best. Why, conceptually, would it be so much worse to enforce the same Nd interval across all PPE members and observations? At least you wouldn’t be enforcing the same LWP magnitude. I am going to hypothesize that the slope of the Nd-L line for the high Nd part of the spectrum is quite sensitive to where that cross over point in Nd space is, and this makes me quite uncomfortable that the observations are being used in the optimal way. I even see some PPE members that have negative slopes for both the low and high Nd portions or at least starting at much lower Nd (somewhat like the observations; e.g., p=73 and p=161). Overall worried that slopes could be quite sensitive to turn over points in conjunction with the nature of fitting lines to these data that are, to my eyeball, not data I’d fit lines to across the board.
Specific Comments:
--I see the model has 85 levels, but what is the approximate vertical resolution in the PBL/lower trop? Parameterization structure aside, is the vertical resolution suitable for these marine cloud regimes? Can we rule that out at least in terms of “structural” error?
--Toward the end of the paper, uncertainty in observations is mentioned – obviously not real “observations” (no one is out there counting Nd or mass), they are remote sensing retrievals, or simpler (than ESM) retrieval algorithm models in themselves. The possibility that systematic errors exist even for these warm marine clouds particularly for LWP should be expected (see for example Fig. 15 here: https://agupubs.onlinelibrary.wiley.com/doi/full/10.1002/2014JD021568), where microwave and optical estimates differ even at times when the clouds are filtered to be low/warm, and who knows how it would impact the slope of the lines particularly if bias is regime-dependent and/or varying as Nd itself might vary.
Line 164: “following the terminology of ?” – the question mark is denoting text that was not added.