IDEAS home Printed from https://ideas.repec.org/p/qed/wpaper/1127.html
   My bibliography  Save this paper

Bootstrap Hypothesis Testing

Author

Listed:
  • James G. MacKinnon

    (Queen's University)

Abstract

This paper surveys bootstrap and Monte Carlo methods for testing hypothesesin econometrics. Several different ways of computing bootstrap P valuesare discussed, including the double bootstrap and the fast double bootstrap.It is emphasized that there are many different procedures for generatingbootstrap samples for regression models and other types of model. As anillustration, a simulation experiment examines the performance of severalmethods of bootstrapping the supF test for structural change with an unknownbreak point.

Suggested Citation

  • James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Paper 1127, Economics Department, Queen's University.
    • Handle: RePEc:qed:wpaper:1127
    as

    Download full text from publisher

    File URL: https://www.econ.queensu.ca/sites/econ.queensu.ca/files/qed_wp_1127.pdf
    File Function: First version 2007
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 35(4), pages 615-645, November.
    2. Diebold, Francis X. & Chen, Celia, 1996. "Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures," Journal of Econometrics, Elsevier, vol. 70(1), pages 221-241, January.
    3. L. G. Godfrey & C. D. Orme & J. M. C. Santos Silva, 2006. "Simulation-based tests for heteroskedasticity in linear regression models: Some further results," Econometrics Journal, Royal Economic Society, vol. 9(1), pages 76-97, March.
    4. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    5. Donald W. K. Andrews, 2002. "Higher-Order Improvements of a Computationally Attractive "k"-Step Bootstrap for Extremum Estimators," Econometrica, Econometric Society, vol. 70(1), pages 119-162, January.
    6. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    7. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    8. Hansen, Bruce E, 1997. "Approximate Asymptotic P Values for Structural-Change Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 60-67, January.
    9. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    10. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    11. Russell Davidson & James G. MacKinnon, 2008. "Bootstrap inference in a linear equation estimated by instrumental variables," Econometrics Journal, Royal Economic Society, vol. 11(3), pages 443-477, November.
    12. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    13. Goncalves, Silvia & White, Halbert, 2002. "Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models," University of California at San Diego, Economics Working Paper Series qt8hx21540, Department of Economics, UC San Diego.
    14. Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
    15. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    16. Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
    17. Efstathios Paparoditis & Dimitris N. Politis, 2003. "Residual-Based Block Bootstrap for Unit Root Testing," Econometrica, Econometric Society, vol. 71(3), pages 813-855, May.
    18. Wolfgang Härdle & Joel Horowitz & Jens‐Peter Kreiss, 2003. "Bootstrap Methods for Time Series," International Statistical Review, International Statistical Institute, vol. 71(2), pages 435-459, August.
    19. Yoosoon Chang & Joon Y. Park, 2003. "A Sieve Bootstrap For The Test Of A Unit Root," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 379-400, July.
    20. Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor & Francis Journals, vol. 16(3), pages 321-352.
    21. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    22. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    23. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    24. King, Maxwell L., 1985. "A point optimal test for autoregressive disturbances," Journal of Econometrics, Elsevier, vol. 27(1), pages 21-37, January.
    25. Donald W. K. Andrews, 2004. "the Block-Block Bootstrap: Improved Asymptotic Refinements," Econometrica, Econometric Society, vol. 72(3), pages 673-700, May.
    26. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Simulation based finite and large sample tests in multivariate regressions," Journal of Econometrics, Elsevier, vol. 111(2), pages 303-322, December.
    27. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    28. James G. MacKinnon & Jeff Racine, 2004. "Simulation-based Tests That Can Use Any Number Of Simulations," Working Paper 1027, Economics Department, Queen's University.
    29. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    30. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    31. Racine, Jeffrey S. & MacKinnon, James G., 2007. "Inference via kernel smoothing of bootstrap P values," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5949-5957, August.
    32. Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
    33. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    34. Dufour, Jean-Marie & King, Maxwell L., 1991. "Optimal invariant tests for the autocorrelation coefficient in linear regressions with stationary or nonstationary AR(1) errors," Journal of Econometrics, Elsevier, vol. 47(1), pages 115-143, January.
    35. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, April.
    36. Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228, Elsevier.
    37. Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
    38. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    39. Patrick Richard, 2007. "ARMA Sieve bootstrap unit root tests," Cahiers de recherche 07-05, Departement d'économique de l'École de gestion à l'Université de Sherbrooke, revised Jul 2009.
    40. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    41. Goncalves, Silvia & White, Halbert, 2004. "Maximum likelihood and the bootstrap for nonlinear dynamic models," Journal of Econometrics, Elsevier, vol. 119(1), pages 199-219, March.
    42. Koenker, Roger, 1981. "A note on studentizing a test for heteroscedasticity," Journal of Econometrics, Elsevier, vol. 17(1), pages 107-112, September.
    43. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 419-429.
    44. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2007. "Multivariate Tests of MeanVariance Efficiency With Possibly Non-Gaussian Errors: An Exact Simulation-Based Approach," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 398-410, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zsurkis, Gabriel & Nicolau, João & Rodrigues, Paulo M. M, 2021. "The expected time to cross a threshold and its determinants: a simple and flexible framework," Journal of Economic Dynamics and Control, Elsevier, vol. 122(C).
    2. Gelman, Sergey & Wilfling, Bernd, 2009. "Markov-switching in target stocks during takeover bids," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 745-758, December.
    3. Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
    4. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    5. Yalta, A. Talha, 2011. "Analyzing energy consumption and GDP nexus using maximum entropy bootstrap: The case of Turkey," Energy Economics, Elsevier, vol. 33(3), pages 453-460, May.
    6. Janusz L. Wywiał, 2018. "Application of Two Gamma Distributions Mixture to Financial Auditing," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 1-18, May.
    7. Todd, Prono, 2009. "Market Proxies, Correlation, and Relative Mean-Variance Efficiency: Still Living with the Roll Critique," MPRA Paper 20031, University Library of Munich, Germany.
    8. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    9. Johan Blomquist & Joakim Westerlund, 2016. "Panel bootstrap tests of slope homogeneity," Empirical Economics, Springer, vol. 50(4), pages 1359-1381, June.
    10. Rakovská, Zuzana, 2021. "Composite survey sentiment as a predictor of future market returns: Evidence for German equity indices," International Review of Economics & Finance, Elsevier, vol. 73(C), pages 473-495.
    11. A. Yasemin Yalta, 2011. "New Evidence on FDI-Led Growth: The Case of China," Working Papers 1107, TOBB University of Economics and Technology, Department of Economics.
    12. Stephanie Thomas, 2016. "A Standardized Method for the Evaluation of Adherence to Practice Guidelines," Department of Economics Working Papers 2016-14, McMaster University.
    13. Del Hoyo, Juan & Llorente, Guillermo & Rivero, Carlos, 2011. "Consumo de electricidad y producto interior bruto: Relación dinámica y estabilidad/Electricity Consumption and GDP: Dynamic Relationship and Stability," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 29, pages 473-492, Agosto.
    14. Eva Boj & Teresa Costa & Josep Fortiana & Anna Esteve, 2015. "Assessing the Importance of Risk Factors in Distance-Based Generalized Linear Models," Methodology and Computing in Applied Probability, Springer, vol. 17(4), pages 951-962, December.
    15. Christopher J. Bennett, 2009. "Consistent and Asymptotically Unbiased MinP Tests of Multiple Inequality Moment Restrictions," Vanderbilt University Department of Economics Working Papers 0908, Vanderbilt University Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    2. Bernard, Jean-Thomas & Idoudi, Nadhem & Khalaf, Lynda & Yelou, Clement, 2007. "Finite sample multivariate structural change tests with application to energy demand models," Journal of Econometrics, Elsevier, vol. 141(2), pages 1219-1244, December.
    3. Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
    4. Jamel Jouini, 2006. "Bootstrap Tests in Bivariate VAR Process with Single Structural Change : Power versus Corrected Size and Empirical Illustration," Working Papers halshs-00410759, HAL.
    5. Russell Davidson & Victoria Zinde‐Walsh, 2017. "Advances in specification testing," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1595-1631, December.
    6. Trenkler, Carsten, 2009. "Bootstrapping Systems Cointegration Tests With A Prior Adjustment For Deterministic Terms," Econometric Theory, Cambridge University Press, vol. 25(1), pages 243-269, February.
    7. James G. MacKinnon, 2012. "Thirty Years Of Heteroskedasticity-robust Inference," Working Paper 1268, Economics Department, Queen's University.
    8. Giuseppe Cavaliere & A. M. Robert Taylor, 2009. "Bootstrap M Unit Root Tests," Econometric Reviews, Taylor & Francis Journals, vol. 28(5), pages 393-421.
    9. Russell Davidson & James G. MacKinnon, 2015. "Bootstrap Tests for Overidentification in Linear Regression Models," Econometrics, MDPI, vol. 3(4), pages 1-39, December.
    10. Lorenzo Camponovo & O. Scaillet & Fabio Trojani, 2013. "Predictability Hidden by Anomalous Observations," Swiss Finance Institute Research Paper Series 13-05, Swiss Finance Institute.
    11. Jamel Jouini, 2010. "Bootstrap methods for single structural change tests: power versus corrected size and empirical illustration," Statistical Papers, Springer, vol. 51(1), pages 85-109, January.
    12. repec:hum:wpaper:sfb649dp2006-012 is not listed on IDEAS
    13. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    14. O'Reilly, Gerard & Whelan, Karl, 2005. "Testing Parameter Stability: A Wild Bootstrap Approach," Research Technical Papers 8/RT/05, Central Bank of Ireland.
    15. Monika Blaszkiewicz-Schwartzman, 2007. "Explaining Exchange Rate Movements in New Member States of the European Union: Nominal and Real Convergence," Money Macro and Finance (MMF) Research Group Conference 2006 144, Money Macro and Finance Research Group.
    16. Cavaliere, Giuseppe & Harvey, David I. & Leybourne, Stephen J. & Taylor, A.M. Robert, 2011. "Testing For Unit Roots In The Presence Of A Possible Break In Trend And Nonstationary Volatility," Econometric Theory, Cambridge University Press, vol. 27(5), pages 957-991, October.
    17. Helmut Lütkepohl, 2013. "Vector autoregressive models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 6, pages 139-164, Edward Elgar Publishing.
    18. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    19. Sensier, M. & van Dijk, D.J.C., 2001. "Short-term volatility versus long-term growth: evidence in US macroeconomic time series," Econometric Institute Research Papers EI 2001-11, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    20. Jack Strauss & Mark E. Wohar, 2007. "Domestic‐Foreign Interest Rate Differentials: Near Unit Roots and Symmetric Threshold Models," Southern Economic Journal, John Wiley & Sons, vol. 73(3), pages 814-829, January.
    21. Gerard O'Reilly & Karl Whelan, 2005. "Has Euro-Area Inflation Persistence Changed Over Time?," The Review of Economics and Statistics, MIT Press, vol. 87(4), pages 709-720, November.

    More about this item

    Keywords

    bootstrap test; supF test; wild bootstrap; pairs bootstrap; moving block bootstrap; residual bootstrap; bootstrap P value;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1127. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Babcock (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.