the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Why does the signal-to-noise paradox exist in seasonal climate predictability?
Abstract. Estimates of the potential predictability limit (PPL) for seasonal climate, typically based on a perfect model framework, sometimes encounter challenges of being paradoxical, as actual skill surpasses the PPL. The signal-to-noise paradox (SNP) gets its name from the use of model-based signal-to-noise ratios to estimate the PPL. Here, we study seasonal climate predictability in the tropical and subtropical regions during the boreal summer (June to September), with a focus on the SNP. We estimate PPL within the perfect model framework, only considering error growth from initial conditions. Signal and noise components display temporal non-orthogonality and a weak association between estimates of PPL and actual prediction skill, contradicting its intended purpose. Moreover, paradoxical regions do not align with significant correlations between signal and noise, indicating that the accurate separation of seasonal forecasts into signal and noise components alone is not sufficient to avoid paradoxes. We have also demonstrated that sub-seasonal components, which are building blocks of seasonal mean, substantially contribute to seasonal anomalies in association with major global predictors. The co-variability between sub-seasonal components and seasonal anomalies is wide-ranging and often skewed compared to observations, thereby influencing seasonal prediction skills and PPL. Therefore, a robust PPL estimation should consider errors from initial conditions and model-related factors such as physics, dynamics, and numerical methods. In this context, we propose a novel method to estimate the PPL of seasonal climate, which can be free from paradoxical situations.
- Preprint
(9197 KB) - Metadata XML
-
Supplement
(2150 KB) - BibTeX
- EndNote
Status: open (until 13 Oct 2025)
-
CC1: 'Comment on egusphere-2025-1683', Youmin Tang, 07 Sep 2025
reply
This manuscript aims to explore the paradox in estimating Potential Predictability (PPL) in seasonal climate forecasts. However, significant issues in its methodology, logical coherence, and theoretical foundation render it unsuitable for publication at this stage. The specific concerns are as follows:
1. Lack of Clarity in Methods and Logical Exposition
The manuscript suffers from poor readability and methodological rigor. Critical details are missing, for example:-
Figure 2 presents correlation coefficients between signal and noise components, but it does not specify how these components were extracted from the raw data or model output;
-
Figure 3 abruptly introduces the Niño3.4 index and regional precipitation without clarifying the research objective or the definition of "correlation skill" (e.g., does it refer to the correlation between the ensemble mean forecast and observations?). The role of Niño3.4 (as a predictor or a reference field) remains unexplained.
Such breaks in logical flow and ambiguous methodological descriptions make it impossible for readers to understand the study process or verify the conclusions, severely violating standards of scientific writing.
2. Conceptual Confusion and Misuse of Terminology
The manuscript contains inaccuracies in fundamental scientific expression:-
It conflates the concepts of "Analysis of Variance (ANOVA)" and "Signal-to-Noise Ratio." ANOVA is fundamentally a statistical significance testing method, while the manuscript merely borrows its variance decomposition framework to estimate the signal-to-noise ratio without clarifying the distinction, which may mislead readers;
-
The term "sub-seasonal scale" is poorly defined. Although filtering bands (e.g., synoptic scale, MJO) are mentioned later, the temporal scope is not specified in key derivations, undermining the core argument that "sub-seasonal components are building blocks of seasonal predictions."
3. Internal Contradictions in the Theoretical Framework
The manuscript contains fundamental academic flaws:-
Conflict Between Orthogonality Assumption and Physical Reality: The derivation of Equation (11) assumes orthogonality (zero covariance) between different components. However, significant nonlinear interactions exist across scales (e.g., synoptic, MJO, external forcing) in the climate system, making this assumption physically unrealistic;
-
Logical Inconsistency Paradox: The orthogonality assumption directly contradicts the manuscript's central argument that "covariability between sub-seasonal components and seasonal anomalies is a source of error." A theoretical framework based on an unreliable assumption cannot effectively demonstrate the effects of non-orthogonality, rendering the overall argument untenable.
Conclusion
Due to issues such as unclear presentation, conceptual confusion, and logical paradoxes, the conclusions of this manuscript are unreliable, and we recommend rejection.Citation: https://doi.org/10.5194/egusphere-2025-1683-CC1 -
AC1: 'Reply on CC1', S.K. Saha, 09 Sep 2025
reply
We thank you for your comments.
Here are point wise reply:
1. Lack of Clarity in Methods and Logical Exposition The manuscript suffers from poor readability and methodological rigor. Critical details are missing, for example:
Figure 2 presents correlation coefficients between signal and noise components, but it does not specify how these components were extracted from the raw data or model output;
Reply: In equation 3, which is based on Rowell et al. (1995), considers that total variance is the sum of external (i.e. signal) and internal variance (i.e. noise). Lines 104-106 clearly mention, what are signal, noise and their ratio, i.e. signal-to-noise ratio (SNR). Equations 1-3 and related description in lines 106-118 describe, how it can be calculated from model output variable (assumed ‘x’ in equations) . As per equation 3 or 4 signal and noise components are considered to be orthogonal.
In result section, line 197-1998 “This comprehensive analysis is conducted on seasonal (June-July-August-September) averaged rainfall, SST, MSLP, and 2-metre air temperature (land region) data of 1981-2021 …. “. So, here rainfall, SST, MSLP etc are ‘x’ variable in equations 1,2. This is a well known method and majority of predictability estimates are based on this method. We have cited several papers/books for further description (e.g. Rowell et al. (1995); Rowell, 1998; Kang and Shukla, 2006; Westra and Sharma, 2010).Figure 3 abruptly introduces the Niño3.4 index and regional precipitation without clarifying the research objective or the definition of "correlation skill" (e.g., does it refer to the correlation between the ensemble mean forecast and observations?). The role of Niño3.4 (as a predictor or a reference field) remains unexplained.
Reply: ENSO is the dominant mode of global climate variability and the primary large-scale predictor of both the Indian summer monsoon and tropical Pacific variability. Therefore, the Niño3.4 index was included to examine, by default, how the predictability of the predictor (Niño3.4) and the predictand (regional precipitation) compares with the actual skill achieved by the model. In other words, it provides a baseline for assessing the extent to which monsoon predictability arises from ENSO. Since ENSO remains the single most influential predictor of Indian summer monsoon rainfall, its inclusion is both natural and necessary. Therefore, we chose not to elaborate much, why we are using Niño3.4. Having said these, we are open to add in the manuscript briefly reason for using Niño3.4
Such breaks in logical flow and ambiguous methodological descriptions make it impossible for readers to understand the study process or verify the conclusions, severely violating standards of scientific writing.
We thank you for your comments, certainly we can add brief description to make it clearer to the readers.
2. Conceptual Confusion and Misuse of Terminology The manuscript contains inaccuracies in fundamental scientific expression:
It conflates the concepts of "Analysis of Variance (ANOVA)" and "Signal-to-Noise Ratio." ANOVA is fundamentally a statistical significance testing method, while the manuscript merely borrows its variance decomposition framework to estimate the signal-to-noise ratio without clarifying the distinction, which may mislead readers;
Reply: We do not fully agree with this statement. ANOVA is not solely a tool for statistical significance testing; in practice, it is widely applied for variance decomposition and uncertainty analysis (e.g. Rowell et al. (1995); Rowell, 1998; Kang and Shukla, 2006; Saha et al., 2016a, 2016b ). In fact, the calculation of the ‘signal-to-noise’ ratio is a well-established application that makes direct use of the ANOVA framework.
The term "sub-seasonal scale" is poorly defined. Although filtering bands (e.g., synoptic scale, MJO) are mentioned later, the temporal scope is not specified in key derivations, undermining the core argument that "sub-seasonal components are building blocks of seasonal predictions."
Reply: “Sub-seasonal scale”, i.e. synoptic (~2-7 days), super-synoptic (~10-20 days) and MISOs (~-20-60 days) are commonly used in literature. Section 2.3.3, in method describes comprehensively how co-variability between sub-seasonal and seasonal components are calculated. Line 142 “The sub-seasonal components (e.g., precipitation events on hourly, synoptic, or MISOs timescales) are the building blocks ...” clearly mentioned what we mean by sub-seasonal components. In the same section, we describe method to get these band explicitly in line 190-193: “Fourier analysis is used to construct a smooth annual cycle and total anomaly, while a Lanczos band-pass filter (Duchon, 1979) is applied to filter daily time series data into synoptic (2-5 days), super-synoptic (10-20 days), and Monsoon Intra-Seasonal Oscillations/Madden-Julian Oscillation(MISO/MJO) (20-60 days) bands.” However, we can add one or two lines in the beginning of method section 2.3.3 about sub-seasonal scale, which will make easy to understand for readers.
3. Internal Contradictions in the Theoretical Framework The manuscript contains fundamental academic flaws:
Conflict Between Orthogonality Assumption and Physical Reality: The derivation of Equation (11) assumes orthogonality (zero covariance) between different components. However, significant nonlinear interactions exist across scales (e.g., synoptic, MJO, external forcing) in the climate system, making this assumption physically unrealistic;
Reply: Strict orthogonality between components may not fully hold in the climate system due to non-linear cross-scale interactions (e.g., synoptic variability, MJO, external forcing). However, band-pass filtering minimizes covariance between frequency bands, reducing cross-scale leakage and allowing the total variance to be approximated as the sum of sub-seasonal components. Thus, the orthogonality assumption serves as a practical statistical simplification that enables robust variance partitioning and comparison across time scales, and it is widely adopted in climate diagnostics and prediction studies.
Logical Inconsistency Paradox: The orthogonality assumption directly contradicts the manuscript's central argument that "covariability between sub-seasonal components and seasonal anomalies is a source of error." A theoretical framework based on an unreliable assumption cannot effectively demonstrate the effects of non-orthogonality, rendering the overall argument untenable.
Reply : This interpretation is not correct. Here we argue that, since sub-seasonal components are the building blocks of the seasonal mean, their unrealistic contributions or systematically biased contributions reduces seasonal prediction skill and hence the predictability (evident in Figure 7a,b). The use of the orthogonality assumption is a methodological simplification to partition variance across time scales; it does not imply the absence of physical co-variability. The clear separation between lower- and higher-skill ensemble members (Figure 7), along with the larger biases in their covariance (particularly in the MISO bands), demonstrates that the orthogonality assumption is both useful and practical for understanding their influence on seasonal variability and predictability. Nevertheless, in the perfect model framework, it is assumed that only the initial error contributes to the noise/ensemble spread and hence the predictability, which overlook other sources of error such as physical processes, numerical methods etc. Moreover, it has no binding relationship with observations, thus often giving rise to paradoxical situation .
Conclusion Due to issues such as unclear presentation, conceptual confusion, and logical paradoxes, the conclusions of this manuscript are unreliable, and we recommend rejection.
We hope that we are able to address the concerns/comments. As mentioned in the point wise reply, brief discussion in some part of the manuscript may make it easier to follow for readers.
Citation: https://doi.org/10.5194/egusphere-2025-1683-AC1 -
CC2: 'Reply on AC1', Youmin Tang, 09 Sep 2025
reply
-
The article only explains how signal and noise variance are defined and calculated. Since variance itself is not the actual component, it is unclear how the signal and noise are extracted from the data. The concept and defintion are totally different between the variance and the variable itself.
-
The article tries to discuss and analyze the paradox, but the purpose of using Nino3.4 to predict precipitation remains unclear. What is the intention behind comparing it with dynamic models? Is it to demonstrate whether the actual or potential forecast skill of dynamic models is higher or lower, reasonable or unreasonable? The objective is not clearly stated. Moreover, can using Nino3.4 to predict precipitation effectively achieve these goals? Would the forecast skill be reliable? Was the forecast skill mentioned in the article derived from training or test data? Similarly, were other modes affecting precipitation in the Indian region, such as IOD, considered?
-
Rowell (1995) never defined signal variance and noise variance using ANOVA. While they did mention ANOVA, it was only used for statistical testing. The authors should revisit Rowell (1995) to better understand the content. ANOVA has exactly defintion in statistics, which should be followed to avoide unnecessary confusion.
-
I do not understand the meaning of the statement: "The use of the orthogonality assumption is a methodological simplification to partition variance across time scales; it does not imply the absence of physical co-variability." Do physical and mathematical co-variability have different interpretations? In my opinion, if two quantities are physically related, they cannot be assumed to be orthogonal in mathematics. Additionally, I do not comprehend the authors' claim that "sub-seasonal components are the building blocks of the seasonal mean." Following this logic, all time scales would be sources of error, since hourly components are the building blocks of the daily mean, and daily components are the building blocks of the weekly mean, and so on.
- So I have to feel sorry to decline this work again. The topic is interesting that is the reason why I agreed with reviewing it. Unfortunately I do not learn more from this work. To my understanding, the paradox should be from the "defintion" of potential predictability. The ratio of signal to noise may not well represent the potential predictability. If authors wish to work this problem, I suggest them to seek other measures to quantify the potential predictabilty.
- Due to busy schedule, I won't post the comments again. Sorry.
Citation: https://doi.org/10.5194/egusphere-2025-1683-CC2 -
-
CC2: 'Reply on AC1', Youmin Tang, 09 Sep 2025
reply
-
Viewed
HTML | XML | Total | Supplement | BibTeX | EndNote | |
---|---|---|---|---|---|---|
697 | 28 | 10 | 735 | 15 | 13 | 17 |
- HTML: 697
- PDF: 28
- XML: 10
- Total: 735
- Supplement: 15
- BibTeX: 13
- EndNote: 17
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1