IDEAS home Printed from https://ideas.repec.org/a/taf/emetrv/v35y2016i5p782-844.html
   My bibliography  Save this article

On the Usefulness or Lack Thereof of Optimality Criteria for Structural Change Tests

Author

Listed:
  • Pierre Perron
  • Yohei Yamamoto

Abstract

Elliott and Müller (2006) considered the problem of testing for general types of parameter variations, including infrequent breaks. They developed a framework that yields optimal tests, in the sense that they nearly attain some local Gaussian power envelop. The main ingredient in their setup is that the variance of the process generating the changes in the parameters must go to zero at a fast rate. They recommended the so-called qL̂L test, a partial sums type test based on the residuals obtained from the restricted model. We show that for breaks that are very small, its power is indeed higher than other tests, including the popular sup-Wald (SW) test. However, the differences are very minor. When the magnitude of change is moderate to large, the power of the test is very low in the context of a regression with lagged dependent variables or when a correction is applied to account for serial correlation in the errors. In many cases, the power goes to zero as the magnitude of change increases. The power of the SW test does not show this non-monotonicity and its power is far superior to the qL̂L test when the break is not very small. We claim that the optimality of the qL̂L test does not come from the properties of the test statistics but the criterion adopted, which is not useful to analyze structural change tests. Instead, we use fixed-break size asymptotic approximations to assess the relative efficiency or power of the two tests. When doing so, it is shown that the SW test indeed dominates the qL̂L test and, in many cases, the latter has zero relative asymptotic efficiency.

Suggested Citation

  • Pierre Perron & Yohei Yamamoto, 2016. "On the Usefulness or Lack Thereof of Optimality Criteria for Structural Change Tests," Econometric Reviews, Taylor & Francis Journals, vol. 35(5), pages 782-844, May.
  • Handle: RePEc:taf:emetrv:v:35:y:2016:i:5:p:782-844
    DOI: 10.1080/07474938.2014.977621
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07474938.2014.977621
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Deng, Ai & Perron, Pierre, 2008. "A non-local perspective on the power properties of the CUSUM and CUSUM of squares tests for structural change," Journal of Econometrics, Elsevier, vol. 142(1), pages 212-240, January.
    2. Garcia, Rene & Perron, Pierre, 1996. "An Analysis of the Real Interest Rate under Regime Shifts," The Review of Economics and Statistics, MIT Press, vol. 78(1), pages 111-125, February.
    3. Juhl, Ted & Xiao, Zhijie, 2009. "Tests for changing mean with monotonic power," Journal of Econometrics, Elsevier, vol. 148(1), pages 14-24, January.
    4. Kim, Dukpa & Perron, Pierre, 2009. "Assessing the relative power of structural break tests using a framework based on the approximate Bahadur slope," Journal of Econometrics, Elsevier, vol. 149(1), pages 26-51, April.
    5. Phillips, Peter C B, 1988. "Regression Theory for Near-Integrated Time Series," Econometrica, Econometric Society, vol. 56(5), pages 1021-1043, September.
    6. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    7. Diebold, Francis X. & Chen, Celia, 1996. "Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures," Journal of Econometrics, Elsevier, vol. 70(1), pages 221-241, January.
    8. Raffaella Giacomini & Barbara Rossi, 2006. "How Stable is the Forecasting Performance of the Yield Curve for Output Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(s1), pages 783-795, December.
    9. Graham Elliott & Ulrich K. Muller, 2006. "Efficient Tests for General Persistent Time Variation in Regression Coefficients," Review of Economic Studies, Oxford University Press, vol. 73(4), pages 907-940.
    10. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    11. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    12. Altissimo, Filippo & Corradi, Valentina, 2003. "Strong rules for detecting the number of breaks in a time series," Journal of Econometrics, Elsevier, vol. 117(2), pages 207-244, December.
    13. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    14. Iliyan GEORGIEV, 2002. "Functional Weak Limit Theory for Rare Outlying Events," Economics Working Papers ECO2002/22, European University Institute.
    15. Alberto Musso & Livio Stracca & Dick van Dijk, 2009. "Instability and Nonlinearity in the Euro-Area Phillips Curve," International Journal of Central Banking, International Journal of Central Banking, vol. 5(2), pages 181-212, June.
    16. Perron, Pierre, 1990. "Testing for a Unit Root in a Time Series with a Changing Mean," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(2), pages 153-162, April.
    17. Nelson, Forrest D & Savin, N E, 1990. "The Danger of Extrapolating Asymptotic Local Power," Econometrica, Econometric Society, vol. 58(4), pages 977-981, July.
    18. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    19. Perron, Pierre, 1989. "The Great Crash, the Oil Price Shock, and the Unit Root Hypothesis," Econometrica, Econometric Society, vol. 57(6), pages 1361-1401, November.
    20. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    21. Kejriwal, Mohitosh, 2009. "Tests for a mean shift with good size and monotonic power," Economics Letters, Elsevier, vol. 102(2), pages 78-82, February.
    22. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    23. Leipus, Remigijus & Viano, Marie-Claude, 2003. "Long memory and stochastic trend," Statistics & Probability Letters, Elsevier, vol. 61(2), pages 177-190, January.
    24. Prodan, Ruxandra, 2008. "Potential Pitfalls in Determining Multiple Structural Changes With an Application to Purchasing Power Parity," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 50-65, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yohei Yamamoto, 2018. "A modified confidence set for the structural break date in linear regression models," Econometric Reviews, Taylor & Francis Journals, vol. 37(9), pages 974-999, October.
    2. Seong Yeon Chang & Pierre Perron, 2018. "A comparison of alternative methods to construct confidence intervals for the estimate of a break date in linear regression models," Econometric Reviews, Taylor & Francis Journals, vol. 37(6), pages 577-601, July.
    3. Pierre Perron & Yohei Yamamoto, 2021. "Testing for Changes in Forecasting Performance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 148-165, January.
    4. Oka, Tatsushi & Perron, Pierre, 2018. "Testing for common breaks in a multiple equations system," Journal of Econometrics, Elsevier, vol. 204(1), pages 66-85.
    5. Yamamoto, Yohei & Tanaka, Shinya, 2015. "Testing for factor loading structural change under common breaks," Journal of Econometrics, Elsevier, vol. 189(1), pages 187-206.
    6. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Papers 1805.03807, arXiv.org.
    7. YAMAZAKI, Daisuke & KUROZUMI, Eiji, 2014. "Improving the Finite Sample Performance of Tests for a Shift in Mean," Discussion Papers 2014-16, Graduate School of Economics, Hitotsubashi University.
    8. HORIE, Tetsushi & YAMAMOTO, Yohei, 2016. "Testing for Speculative Bubbles in Large-Dimensional Financial Panel Data Sets," Discussion Papers 2016-04, Graduate School of Economics, Hitotsubashi University.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yamamoto, Yohei & Tanaka, Shinya, 2015. "Testing for factor loading structural change under common breaks," Journal of Econometrics, Elsevier, vol. 189(1), pages 187-206.
    2. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Boston University - Department of Economics - Working Papers Series WP2019-02, Boston University - Department of Economics.
    3. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    4. Alaa Abi Morshed & Elena Andreou & Otilia Boldea, 2018. "Structural Break Tests Robust to Regression Misspecification," Econometrics, MDPI, Open Access Journal, vol. 6(2), pages 1-39, May.
    5. Seong Yeon Chang & Pierre Perron, 2018. "A comparison of alternative methods to construct confidence intervals for the estimate of a break date in linear regression models," Econometric Reviews, Taylor & Francis Journals, vol. 37(6), pages 577-601, July.
    6. Pierre Perron & Yohei Yamamoto & Jing Zhou, 2020. "Testing jointly for structural changes in the error variance and coefficients of a linear regression model," Quantitative Economics, Econometric Society, vol. 11(3), pages 1019-1057, July.
    7. Oka, Tatsushi & Perron, Pierre, 2018. "Testing for common breaks in a multiple equations system," Journal of Econometrics, Elsevier, vol. 204(1), pages 66-85.
    8. Kejriwal, Mohitosh & Perron, Pierre, 2010. "Testing for Multiple Structural Changes in Cointegrated Regression Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 503-522.
    9. Giorgio Canarella & Rangan Gupta & Stephen M. Miller & Stephen K. Pollard, 2019. "Unemployment rate hysteresis and the great recession: exploring the metropolitan evidence," Empirical Economics, Springer, vol. 56(1), pages 61-79, January.
    10. Travaglini, Guido, 2007. "The U.S. Dynamic Taylor Rule With Multiple Breaks, 1984-2001," MPRA Paper 3419, University Library of Munich, Germany, revised 15 Jun 2007.
    11. Carlos Santos & Maria Alberta Oliveira, 2010. "Assessing French inflation persistence with impulse saturation break tests and automatic general-to-specific modelling," Applied Economics, Taylor & Francis Journals, vol. 42(12), pages 1577-1589.
    12. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    13. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    14. Richard Bluhm & Denis de Crombrugghe & Adam Szirmai, 0. "Do Weak Institutions Prolong Crises? On the Identification, Characteristics, and Duration of Declines during Economic Slumps," World Bank Economic Review, World Bank Group, vol. 34(3), pages 810-832.
    15. Perron, Pierre, 1997. "L’estimation de modèles avec changements structurels multiples," L'Actualité Economique, Société Canadienne de Science Economique, vol. 73(1), pages 457-505, mars-juin.
    16. Vicente Esteve, 2004. "Política fiscal y productividad del trabajo en la economía española: un análisis de series temporales," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 19(1), pages 3-29, June.
    17. Georgios P. Kouretas & Mark E. Wohar, 2012. "The dynamics of inflation: a study of a large number of countries," Applied Economics, Taylor & Francis Journals, vol. 44(16), pages 2001-2026, June.
    18. Aue, Alexander & Horváth, Lajos & Hušková, Marie, 2012. "Segmenting mean-nonstationary time series via trending regressions," Journal of Econometrics, Elsevier, vol. 168(2), pages 367-381.
    19. Banerjee, Anindya & Urga, Giovanni, 2005. "Modelling structural breaks, long memory and stock market volatility: an overview," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 1-34.
    20. Bernard, Jean-Thomas & Idoudi, Nadhem & Khalaf, Lynda & Yelou, Clement, 2007. "Finite sample multivariate structural change tests with application to energy demand models," Journal of Econometrics, Elsevier, vol. 141(2), pages 1219-1244, December.

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:emetrv:v:35:y:2016:i:5:p:782-844. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://www.tandfonline.com/LECR20 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.