the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
| 27 Jun 2022
Ensemble forecast of an index of the Madden Julian Oscillation using a stochastic weather generator based on circulation analogs
Abstract. The Madden-Julian Oscillation (MJO) is one of the main sources of sub-seasonal atmospheric predictability in the Tropical region. The MJO affects precipitation over highly populated areas, especially around Southern India. Therefore, predicting its phase and intensity is important as it has a high societal impact. Indices of the MJO can be derived from the first principal components of wind speed and outgoing longwave radiation (OLR) in the Tropics (RMM1 and RMM2 indices). The amplitude and phase of the MJO are derived from those indices. Our goal is to forecast these two indices on a sub-seasonal timescale. This study aims to provide an ensemble forecast of MJO indices from analogs of the atmospheric circulation, computed from the geopotential at 500 hPa (Z500) by using a stochastic weather generator (SWG). We generate an ensemble of 100 members for the MJO amplitude for sub-seasonal lead times (from 2 to 4 weeks). Then we evaluate the skill of the ensemble forecast and the ensemble mean using probabilistic scores and deterministic skill scores. According to score-based criteria, we find that a reasonable forecast of the MJO index could be achieved within 40-day lead times for the different seasons. We compare our SWG forecast with other forecasts of the MJO.
-
Notice on discussion status
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
-
Preprint
(1614 KB)
-
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(1614 KB) - Metadata XML
- BibTeX
- EndNote
- Final revised paper
Journal article(s) based on this preprint
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2022-524', Anonymous Referee #1, 25 Jul 2022
General comments:
In this study, the authors presented the performance of ensemble MJO forecasts using a stochastic weather generator based on circulation analogs. As the MJO is an important source of predictability on the subseasonal time scale, a useful forecast of the MJO is of significant scientific and practical values. Although there have been quite a few studies on MJO forecasts, this study uses a unique approach which is novel in this area. The result is interesting. It shows that a useful skill of the MJO can be achieved at a lead-time of 40 days, which is considerably longer than most dynamical and statistical models. The paper is in general clearly written, although some clarifications and edits are needed. A little more reasoning for choice of variables and region for the analogs and explanation of the results would improve the paper.
Specific comments
- The MJO is a planetary-scale tropical disturbance, but the tropical region for the analog calculation in the Indian Ocean (Fig. 2) is quite small. It is a little surprising that Z500 in such a small region can provide information for the MJO evolution. On lines 210-214, one reason for the choice is given which is based on the composition of the RMM index. This may explain why OLR is not used, but RMM does not include Z500 either. The MJO has a baroclinic structure, but 500 hPa is in the middle troposphere that cannot capture the vertical structure. In addition, geopotential height in the tropics does not represent well wind fields. Why not using zonal winds at upper or lower troposphere? Some more explanation on the choice of variable, region, and level would be very helpful.
- Some justification for the choice of region is given on lines 217-219. The dependence of MJO forecast skill on initial phase is in fact not conclusive in previous studies. It would be interesting to see how this is the case in this study, i.e., the dependence of MJO skill on the initial phase. It would be interesting to see the skill dependence on MJO amplitude as well.
- Section 6: Some introduction is needed for the two hindcasts of numerical models POAMA and ECMWF. More information on model resolution, version, ensemble size, hindcast period, etc., should be provided. A comparison as in Fig. 10 may not be very meaningful when these forecasts are for the different periods.
Minor comments:
- Line 4: first two principal
- Line 74: an MJO event
- Lines 81-82: “over the region covering 15N-15S” is redundant.
- Figure 2 caption last sentence: It seems the case for RMM2. How about RMM1?
- Line 228: “other atmospheric circulations” à “other atmospheric variables”
- Line 278: the ensemble spread is increasing, instead of decreasing.
- 7b: How is the bias calculated? Is it the average bias of RMM1 and RMM2?
- Line 283: remove “the” in front of “a similar”
- Line 284: A large RMSE does not necessarily mean a large spread.
- Line 309: Vitart (2017) also found that the MJO skill is higher in JJA for the ECMWF model
- Line 351: machine learning
Reference:
Vitart, F., 2017: Madden-Julian Oscillation prediction and teleconnections in the S2S database. Qarterly Journal of the Royal Meteorological Society, 143, 2210-2220.
Citation: https://doi.org/10.5194/egusphere-2022-524-RC1 -
AC1: 'Reply on RC1', Meriem Krouma, 19 Sep 2022
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2022/egusphere-2022-524/egusphere-2022-524-AC1-supplement.pdf
-
RC2: 'Comment on egusphere-2022-524', Anonymous Referee #2, 28 Jul 2022
Summary:
In this study a stochastic weather generator (SWG) based on the model analogs of the atmospheric circulation is formulated to predict the daily MJO index for a subseasonal lead time. The SWG method adopted by this study has been used to forecast climatic variables, precipitation and the North Atlantic Oscillation by the same authors, and this is the first time that they extend this method for the MJO prediction. The performance of the proposed method is compared against persistence, climatology, and state-of-the-art numerical models. In general the proposed method shows superior performance than both persistence and climatology forecast. Comparison against the full GCM model such as ECMWF forecast shows that the proposed model show larger RMSE (lower COR) than ECMWF model forecast for the 20-day forecast, but smaller RMSE (higher COR) than ECMWF model forecast for days 20-60.In general, this paper is well written, and the method they proposed is interesting. One significant advantage of their method is the substantially low computational cost compared to a full GCM model (since they use the past model outputs to find the analog), but with superior performance than a full GCM model forecast for days 20-60.
It would be preferable if the authors can clarify why different variables are chosen to form the MJO index and the analog. Besides, I have some other comments shown below.
Recommendation: Major revision
Major Comments:1. Why different variables and areas are used for RMM, and analog calculation?
Around Line 59: RMM1/2 are calculated from the satellite-derived OLR, and zonal wind at 250hPa, and 850hPa.
Around Line 84: analogs are calculated from the modeled geopotential at 500hPa, 300hPa, and OLR daily data.
Based on these, it seems you are using different variables to calculate RMM and analogs.
My questions are:
(1) what is the motivation to use geopotential at 500hPa & 300hPa, instead of zonal wind at 250hPa and 850hPa, to calculate the analog?
(2) Have you tried to use zonal wind at 250hPa and 850hPa to calculate the analog?
(3) For the analog computation, you used the model data from NCEP. Can you indicate which reanalysis datasets you are using? Are you using CFS-R from NCEP?
(4) Around line 59: RMM1&2 are calculated over the region between 15 deg N/S, while the analog is calculated based on the Indian ocean (around Line 100). I understand this is because Indian ocean is the onset place where the MJO occurs. My question is: is it necessary to only form the analog only based on the Indian Ocean? It seems that the analog formation process can be easily extended to later regions where MJO occurs. This might help the case where the initial signal is not well-captured by the initial analogs in the Indian Ocean.
2.It might be better to reorganize the section 3.2 “Configuration of the stochastic weather generator”
(1) Around Lines 110-120: Is it possible to plot some schematics to illustrate the SWG process?
(2) Line 110: “The random selection …that are computed are the products of two weights…rules”: rephrase the sentence. Also, it would be better to write an explicit equation combining \w_k^c and \w_k^\{Phi}. Though Lines 111-118 mention how the three w terms related, but it is better to reorder the sequence here and show the explicit equations for each w term.
(3) Line 129 “The persistence and climatological forecasts are randomized by adding a small Gaussian noise”: Can you further clarify what kind of Gaussian noise did you add? How did you determine the magnitude of the variance of Gaussian noise (Any justification)?
Page 30, Figure B1: Why there are so many triangular white zones in the figure? What variable (indicated by color) is plotted in this figure?
Minor Comments:
Line 11: “We compare our SWG forecast with other forecasts of MJO”: It might be better if you can give a short summary (1-2 sentences) of the advantages of your methods over other MJO prediction methods in summaryLine 65 “For this paper, …, the RMM1 and RMM2 allow to… (2004)”: rephrase the sentence.
Line 74 “For instance, we consider that there is a MJO event when A(t)>=1”. Why the value 1 is selected (any references)?
Figure 2: Is it possible to overlay the contour with p-values 0.05 so I know the correlated areas outside your boxed area.
Citation: https://doi.org/10.5194/egusphere-2022-524-RC2 -
AC2: 'Reply on RC2', Meriem Krouma, 19 Sep 2022
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2022/egusphere-2022-524/egusphere-2022-524-AC2-supplement.pdf
-
AC2: 'Reply on RC2', Meriem Krouma, 19 Sep 2022
Interactive discussion
Status: closed
-
RC1: 'Comment on egusphere-2022-524', Anonymous Referee #1, 25 Jul 2022
General comments:
In this study, the authors presented the performance of ensemble MJO forecasts using a stochastic weather generator based on circulation analogs. As the MJO is an important source of predictability on the subseasonal time scale, a useful forecast of the MJO is of significant scientific and practical values. Although there have been quite a few studies on MJO forecasts, this study uses a unique approach which is novel in this area. The result is interesting. It shows that a useful skill of the MJO can be achieved at a lead-time of 40 days, which is considerably longer than most dynamical and statistical models. The paper is in general clearly written, although some clarifications and edits are needed. A little more reasoning for choice of variables and region for the analogs and explanation of the results would improve the paper.
Specific comments
- The MJO is a planetary-scale tropical disturbance, but the tropical region for the analog calculation in the Indian Ocean (Fig. 2) is quite small. It is a little surprising that Z500 in such a small region can provide information for the MJO evolution. On lines 210-214, one reason for the choice is given which is based on the composition of the RMM index. This may explain why OLR is not used, but RMM does not include Z500 either. The MJO has a baroclinic structure, but 500 hPa is in the middle troposphere that cannot capture the vertical structure. In addition, geopotential height in the tropics does not represent well wind fields. Why not using zonal winds at upper or lower troposphere? Some more explanation on the choice of variable, region, and level would be very helpful.
- Some justification for the choice of region is given on lines 217-219. The dependence of MJO forecast skill on initial phase is in fact not conclusive in previous studies. It would be interesting to see how this is the case in this study, i.e., the dependence of MJO skill on the initial phase. It would be interesting to see the skill dependence on MJO amplitude as well.
- Section 6: Some introduction is needed for the two hindcasts of numerical models POAMA and ECMWF. More information on model resolution, version, ensemble size, hindcast period, etc., should be provided. A comparison as in Fig. 10 may not be very meaningful when these forecasts are for the different periods.
Minor comments:
- Line 4: first two principal
- Line 74: an MJO event
- Lines 81-82: “over the region covering 15N-15S” is redundant.
- Figure 2 caption last sentence: It seems the case for RMM2. How about RMM1?
- Line 228: “other atmospheric circulations” à “other atmospheric variables”
- Line 278: the ensemble spread is increasing, instead of decreasing.
- 7b: How is the bias calculated? Is it the average bias of RMM1 and RMM2?
- Line 283: remove “the” in front of “a similar”
- Line 284: A large RMSE does not necessarily mean a large spread.
- Line 309: Vitart (2017) also found that the MJO skill is higher in JJA for the ECMWF model
- Line 351: machine learning
Reference:
Vitart, F., 2017: Madden-Julian Oscillation prediction and teleconnections in the S2S database. Qarterly Journal of the Royal Meteorological Society, 143, 2210-2220.
Citation: https://doi.org/10.5194/egusphere-2022-524-RC1 -
AC1: 'Reply on RC1', Meriem Krouma, 19 Sep 2022
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2022/egusphere-2022-524/egusphere-2022-524-AC1-supplement.pdf
-
RC2: 'Comment on egusphere-2022-524', Anonymous Referee #2, 28 Jul 2022
Summary:
In this study a stochastic weather generator (SWG) based on the model analogs of the atmospheric circulation is formulated to predict the daily MJO index for a subseasonal lead time. The SWG method adopted by this study has been used to forecast climatic variables, precipitation and the North Atlantic Oscillation by the same authors, and this is the first time that they extend this method for the MJO prediction. The performance of the proposed method is compared against persistence, climatology, and state-of-the-art numerical models. In general the proposed method shows superior performance than both persistence and climatology forecast. Comparison against the full GCM model such as ECMWF forecast shows that the proposed model show larger RMSE (lower COR) than ECMWF model forecast for the 20-day forecast, but smaller RMSE (higher COR) than ECMWF model forecast for days 20-60.In general, this paper is well written, and the method they proposed is interesting. One significant advantage of their method is the substantially low computational cost compared to a full GCM model (since they use the past model outputs to find the analog), but with superior performance than a full GCM model forecast for days 20-60.
It would be preferable if the authors can clarify why different variables are chosen to form the MJO index and the analog. Besides, I have some other comments shown below.
Recommendation: Major revision
Major Comments:1. Why different variables and areas are used for RMM, and analog calculation?
Around Line 59: RMM1/2 are calculated from the satellite-derived OLR, and zonal wind at 250hPa, and 850hPa.
Around Line 84: analogs are calculated from the modeled geopotential at 500hPa, 300hPa, and OLR daily data.
Based on these, it seems you are using different variables to calculate RMM and analogs.
My questions are:
(1) what is the motivation to use geopotential at 500hPa & 300hPa, instead of zonal wind at 250hPa and 850hPa, to calculate the analog?
(2) Have you tried to use zonal wind at 250hPa and 850hPa to calculate the analog?
(3) For the analog computation, you used the model data from NCEP. Can you indicate which reanalysis datasets you are using? Are you using CFS-R from NCEP?
(4) Around line 59: RMM1&2 are calculated over the region between 15 deg N/S, while the analog is calculated based on the Indian ocean (around Line 100). I understand this is because Indian ocean is the onset place where the MJO occurs. My question is: is it necessary to only form the analog only based on the Indian Ocean? It seems that the analog formation process can be easily extended to later regions where MJO occurs. This might help the case where the initial signal is not well-captured by the initial analogs in the Indian Ocean.
2.It might be better to reorganize the section 3.2 “Configuration of the stochastic weather generator”
(1) Around Lines 110-120: Is it possible to plot some schematics to illustrate the SWG process?
(2) Line 110: “The random selection …that are computed are the products of two weights…rules”: rephrase the sentence. Also, it would be better to write an explicit equation combining \w_k^c and \w_k^\{Phi}. Though Lines 111-118 mention how the three w terms related, but it is better to reorder the sequence here and show the explicit equations for each w term.
(3) Line 129 “The persistence and climatological forecasts are randomized by adding a small Gaussian noise”: Can you further clarify what kind of Gaussian noise did you add? How did you determine the magnitude of the variance of Gaussian noise (Any justification)?
Page 30, Figure B1: Why there are so many triangular white zones in the figure? What variable (indicated by color) is plotted in this figure?
Minor Comments:
Line 11: “We compare our SWG forecast with other forecasts of MJO”: It might be better if you can give a short summary (1-2 sentences) of the advantages of your methods over other MJO prediction methods in summaryLine 65 “For this paper, …, the RMM1 and RMM2 allow to… (2004)”: rephrase the sentence.
Line 74 “For instance, we consider that there is a MJO event when A(t)>=1”. Why the value 1 is selected (any references)?
Figure 2: Is it possible to overlay the contour with p-values 0.05 so I know the correlated areas outside your boxed area.
Citation: https://doi.org/10.5194/egusphere-2022-524-RC2 -
AC2: 'Reply on RC2', Meriem Krouma, 19 Sep 2022
The comment was uploaded in the form of a supplement: https://egusphere.copernicus.org/preprints/2022/egusphere-2022-524/egusphere-2022-524-AC2-supplement.pdf
-
AC2: 'Reply on RC2', Meriem Krouma, 19 Sep 2022
Peer review completion
Journal article(s) based on this preprint
Viewed
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 355 | 165 | 21 | 541 | 4 | 6 |
- HTML: 355
- PDF: 165
- XML: 21
- Total: 541
- BibTeX: 4
- EndNote: 6
Viewed (geographical distribution)
| Country | # | Views | % |
|---|---|---|---|
| United States of America | 1 | 142 | 29 |
| France | 2 | 69 | 14 |
| China | 3 | 48 | 10 |
| Germany | 4 | 47 | 9 |
| India | 5 | 15 | 3 |
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
- 142
Riccardo Silini
Pascal Yiou
The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.
- Preprint
(1614 KB) - Metadata XML