IDEAS home Printed from https://ideas.repec.org/p/ags/ucdavw/11976.html
   My bibliography  Save this paper

Markov-Switching Model Selection Using Kullback-Leibler Divergence

Author

Listed:
  • Smith, Aaron D.
  • Naik, Prasad A.
  • Tsai, Chih-Ling

Abstract

In Markov-switching regression models, we use Kullback-Leibler (KL) divergence between the true and candidate models to select the number of states and variables simultaneously. In applying Akaike information criterion (AIC), which is an estimate of KL divergence, we find that AIC retains too many states and variables in the model. Hence, we derive a new information criterion, Markov switching criterion (MSC), which yields a marked improvement in state determination and variable selection because it imposes an appropriate penalty to mitigate the over-retention of states in the Markov chain. MSC performs well in Monte Carlo studies with single and multiple states, small and large samples, and low and high noise. Furthermore, it not only applies to Markov-switching regression models, but also performs well in Markov- switching autoregression models. Finally, the usefulness of MSC is illustrated via applications to the U.S. business cycle and the effectiveness of media advertising.

Suggested Citation

  • Smith, Aaron D. & Naik, Prasad A. & Tsai, Chih-Ling, 2005. "Markov-Switching Model Selection Using Kullback-Leibler Divergence," Working Papers 11976, University of California, Davis, Department of Agricultural and Resource Economics.
  • Handle: RePEc:ags:ucdavw:11976
    as

    Download full text from publisher

    File URL: http://ageconsearch.umn.edu/record/11976/files/wp050001.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Bruce E, 1992. "The Likelihood Ratio Test under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(S), pages 61-82, Suppl. De.
    2. Chang-Jin Kim & Charles R. Nelson, 1999. "Has The U.S. Economy Become More Stable? A Bayesian Approach Based On A Markov-Switching Model Of The Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 608-616, November.
    3. Eric Ghysels & Robert E. McCulloch & Ruey S. Tsay, 1998. "Bayesian inference for periodic regime-switching models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(2), pages 129-143.
    4. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    5. Andrew Ang & Geert Bekaert, 2002. "International Asset Allocation With Regime Shifts," Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1137-1187.
    6. Psaradakis, Zacharias & Sola, Martin, 1998. "Finite-sample properties of the maximum likelihood estimator in autoregressive models with Markov switching," Journal of Econometrics, Elsevier, vol. 86(2), pages 369-386, June.
    7. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, Elsevier.
    8. Kristian S. Palda, 1964. "The Measurement of Cumulative Advertising Effects," The Journal of Business, University of Chicago Press, vol. 38, pages 162-162.
    9. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
    10. Prasad A. Naik & Murali K. Mantrala & Alan G. Sawyer, 1998. "Planning Media Schedules in the Presence of Dynamic Advertising Quality," Marketing Science, INFORMS, vol. 17(3), pages 214-235.
    11. Timmermann, Allan, 2001. "Structural Breaks, Incomplete Information, and Stock Prices," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 299-314, July.
    12. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    13. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    14. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    15. Randolph E. Bucklin & Sunil Gupta, 1999. "Commercial Use of UPC Scanner Data: Industry and Academic Perspectives," Marketing Science, INFORMS, vol. 18(3), pages 247-273.
    16. Engel, Charles & Hamilton, James D, 1990. "Long Swings in the Dollar: Are They in the Data and Do Markets Know It?," American Economic Review, American Economic Association, vol. 80(4), pages 689-713, September.
    17. James H. Stock & Mark W. Watson, 2003. "Has the Business Cycle Changed and Why?," NBER Chapters,in: NBER Macroeconomics Annual 2002, Volume 17, pages 159-230 National Bureau of Economic Research, Inc.
    18. Ang, Andrew & Bekaert, Geert, 2002. "Regime Switches in Interest Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 163-182, April.
    19. Garcia, Rene & Perron, Pierre, 1996. "An Analysis of the Real Interest Rate under Regime Shifts," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 111-125, February.
    20. Zacharias Psaradakis & Nicola Spagnolo, 2003. "On The Determination Of The Number Of Regimes In Markov-Switching Autoregressive Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(2), pages 237-252, March.
    21. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    22. James H. Stock & Mark W. Watson, 2003. "Has the business cycle changed?," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 9-56.
    23. Garcia, Rene, 1998. "Asymptotic Null Distribution of the Likelihood Ratio Test in Markov Switching Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 763-788, August.
    24. Kim, Chang-Jin, 1994. "Dynamic linear models with Markov-switching," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 1-22.
    25. E. Roy Weintraub, 1992. "Introduction," History of Political Economy, Duke University Press, vol. 24(5), pages 3-12, Supplemen.
    26. Gustav Feichtinger & Richard F. Hartl & Suresh P. Sethi, 1994. "Dynamic Optimal Control Models in Advertising: Recent Developments," Management Science, INFORMS, vol. 40(2), pages 195-226, February.
    27. Hamilton, James D., 1990. "Analysis of time series subject to changes in regime," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 39-70.
    28. Chang-Jin Kim & Charles R. Nelson, 1999. "State-Space Models with Regime Switching: Classical and Gibbs-Sampling Approaches with Applications," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262112388, November.
    29. Zellner, Arnold, 2002. "Information processing and Bayesian analysis," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 41-50, March.
    30. Sawa, Takamitsu, 1978. "Information Criteria for Discriminating among Alternative Regression Models," Econometrica, Econometric Society, vol. 46(6), pages 1273-1291, November.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:ucdavw:11976. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (AgEcon Search). General contact details of provider: http://edirc.repec.org/data/daucdus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.