IDEAS home Printed from https://ideas.repec.org/p/ags/quedwp/273603.html

Bootstrap Hypothesis Testing

Author

Listed:
  • MacKinnon, James

Abstract

This paper surveys bootstrap and Monte Carlo methods for testing hypotheses in econometrics. Several different ways of computing bootstrap P values are discussed, including the double bootstrap and the fast double bootstrap. It is emphasized that there are many different procedures for generating bootstrap samples for regression models and other types of model. As an illustration, a simulation experiment examines the performance of several methods of bootstrapping the supF test for structural change with an unknown break point.

Suggested Citation

  • MacKinnon, James, 2007. "Bootstrap Hypothesis Testing," Queen's Economics Department Working Papers 273603, Queen's University - Department of Economics.
    • Handle: RePEc:ags:quedwp:273603
    DOI: 10.22004/ag.econ.273603
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/273603/files/qed_wp_1127.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.273603?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 35(4), pages 615-645, November.
    2. L. G. Godfrey & C. D. Orme & J. M. C. Santos Silva, 2006. "Simulation-based tests for heteroskedasticity in linear regression models: Some further results," Econometrics Journal, Royal Economic Society, vol. 9(1), pages 76-97, March.
    3. Diebold, Francis X. & Chen, Celia, 1996. "Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures," Journal of Econometrics, Elsevier, vol. 70(1), pages 221-241, January.
    4. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    5. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    6. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    7. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    8. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    9. Russell Davidson & James G. MacKinnon, 2008. "Bootstrap inference in a linear equation estimated by instrumental variables," Econometrics Journal, Royal Economic Society, vol. 11(3), pages 443-477, November.
    10. Efstathios Paparoditis & Dimitris N. Politis, 2003. "Residual-Based Block Bootstrap for Unit Root Testing," Econometrica, Econometric Society, vol. 71(3), pages 813-855, May.
    11. Wolfgang Härdle & Joel Horowitz & Jens‐Peter Kreiss, 2003. "Bootstrap Methods for Time Series," International Statistical Review, International Statistical Institute, vol. 71(2), pages 435-459, August.
    12. Yoosoon Chang & Joon Y. Park, 2003. "A Sieve Bootstrap For The Test Of A Unit Root," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 379-400, July.
    13. Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor & Francis Journals, vol. 16(3), pages 321-352.
    14. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    15. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    16. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    17. King, Maxwell L., 1985. "A point optimal test for autoregressive disturbances," Journal of Econometrics, Elsevier, vol. 27(1), pages 21-37, January.
    18. Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
    19. Hansen, Bruce E, 1997. "Approximate Asymptotic P Values for Structural-Change Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 60-67, January.
    20. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    21. Racine, Jeff & MacKinnon, James, 2004. "Simulation-based Tests that can Use Any Number of Simulations," Queen's Economics Department Working Papers 273465, Queen's University - Department of Economics.
    22. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    23. Racine, Jeffrey S. & MacKinnon, James G., 2007. "Inference via kernel smoothing of bootstrap P values," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5949-5957, August.
    24. Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
    25. Donald W. K. Andrews, 2002. "Higher-Order Improvements of a Computationally Attractive "k"-Step Bootstrap for Extremum Estimators," Econometrica, Econometric Society, vol. 70(1), pages 119-162, January.
    26. Donald W. K. Andrews, 2003. "Tests for Parameter Instability and Structural Change with Unknown Change Point: A Corrigendum," Econometrica, Econometric Society, vol. 71(1), pages 395-397, January.
    27. Dufour, Jean-Marie & King, Maxwell L., 1991. "Optimal invariant tests for the autocorrelation coefficient in linear regressions with stationary or nonstationary AR(1) errors," Journal of Econometrics, Elsevier, vol. 47(1), pages 115-143, January.
    28. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, April.
    29. Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228, Elsevier.
    30. Patrick Richard, 2007. "ARMA Sieve bootstrap unit root tests," Cahiers de recherche 07-05, Departement d'économique de l'École de gestion à l'Université de Sherbrooke, revised Jul 2009.
    31. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    32. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    33. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    34. MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
    35. Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
    36. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    37. Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
    38. Goncalves, Silvia & White, Halbert, 2004. "Maximum likelihood and the bootstrap for nonlinear dynamic models," Journal of Econometrics, Elsevier, vol. 119(1), pages 199-219, March.
    39. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Simulation based finite and large sample tests in multivariate regressions," Journal of Econometrics, Elsevier, vol. 111(2), pages 303-322, December.
    40. Horowitz, Joel L. & Lobato, I.N. & Nankervis, John C. & Savin, N.E., 2006. "Bootstrapping the Box-Pierce Q test: A robust test of uncorrelatedness," Journal of Econometrics, Elsevier, vol. 133(2), pages 841-862, August.
    41. Donald W. K. Andrews, 2004. "the Block-Block Bootstrap: Improved Asymptotic Refinements," Econometrica, Econometric Society, vol. 72(3), pages 673-700, May.
    42. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    43. Koenker, Roger, 1981. "A note on studentizing a test for heteroscedasticity," Journal of Econometrics, Elsevier, vol. 17(1), pages 107-112, September.
    44. Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
    45. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 419-429.
    46. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2007. "Multivariate Tests of MeanVariance Efficiency With Possibly Non-Gaussian Errors: An Exact Simulation-Based Approach," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 398-410, October.
    47. Davidson, Russell & MacKinnon, James G., 2010. "Wild Bootstrap Tests for IV Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 128-144.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alessandro Riboni & Francisco Ruge‐Murcia, 2023. "The Power Of The Federal Reserve Chair," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(2), pages 727-756, May.
    2. Johan Blomquist & Joakim Westerlund, 2016. "Panel bootstrap tests of slope homogeneity," Empirical Economics, Springer, vol. 50(4), pages 1359-1381, June.
    3. Gelman, Sergey & Wilfling, Bernd, 2009. "Markov-switching in target stocks during takeover bids," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 745-758, December.
    4. Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
    5. A. Yasemin Yalta, 2011. "New Evidence on FDI-Led Growth: The Case of China," Working Papers 1107, TOBB University of Economics and Technology, Department of Economics.
    6. Todd Prono, 2009. "Market proxies, correlation, and relative mean-variance efficiency: still living with the roll critique," Supervisory Research and Analysis Working Papers QAU09-3, Federal Reserve Bank of Boston.
    7. Martin Huber & Giovanni Mellace, 2015. "Testing Instrument Validity for LATE Identification Based on Inequality Moment Constraints," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 398-411, May.
    8. Stephanie Thomas, 2016. "A Standardized Method for the Evaluation of Adherence to Practice Guidelines," Department of Economics Working Papers 2016-14, McMaster University.
    9. Yalta, A. Talha, 2011. "Analyzing energy consumption and GDP nexus using maximum entropy bootstrap: The case of Turkey," Energy Economics, Elsevier, vol. 33(3), pages 453-460, May.
    10. Del Hoyo, Juan & Llorente, Guillermo & Rivero, Carlos, 2011. "Consumo de electricidad y producto interior bruto: Relación dinámica y estabilidad/Electricity Consumption and GDP: Dynamic Relationship and Stability," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 29, pages 473-492, Agosto.
    11. Janusz L. Wywiał, 2018. "Application of Two Gamma Distributions Mixture to Financial Auditing," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 1-18, May.
    12. Eva Boj & Teresa Costa & Josep Fortiana & Anna Esteve, 2015. "Assessing the Importance of Risk Factors in Distance-Based Generalized Linear Models," Methodology and Computing in Applied Probability, Springer, vol. 17(4), pages 951-962, December.
    13. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    14. Christopher J. Bennett, 2009. "Consistent and Asymptotically Unbiased MinP Tests of Multiple Inequality Moment Restrictions," Vanderbilt University Department of Economics Working Papers 0908, Vanderbilt University Department of Economics.
    15. Zsurkis, Gabriel & Nicolau, João & Rodrigues, Paulo M. M, 2021. "The expected time to cross a threshold and its determinants: a simple and flexible framework," Journal of Economic Dynamics and Control, Elsevier, vol. 122(C).
    16. Rakovská, Zuzana, 2021. "Composite survey sentiment as a predictor of future market returns: Evidence for German equity indices," International Review of Economics & Finance, Elsevier, vol. 73(C), pages 473-495.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages 2-18, September.
    2. Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
    3. Bernard, Jean-Thomas & Idoudi, Nadhem & Khalaf, Lynda & Yelou, Clement, 2007. "Finite sample multivariate structural change tests with application to energy demand models," Journal of Econometrics, Elsevier, vol. 141(2), pages 1219-1244, December.
    4. Jamel Jouini, 2006. "Bootstrap Tests in Bivariate VAR Process with Single Structural Change : Power versus Corrected Size and Empirical Illustration," Working Papers halshs-00410759, HAL.
    5. MacKinnon, James G., 2011. "Thirty Years of Heteroskedasticity-Robust Inference," Queen's Economics Department Working Papers 273816, Queen's University - Department of Economics.
    6. Russell Davidson & Victoria Zinde-Walsh, 2017. "Advances in specification testing," Canadian Journal of Economics, Canadian Economics Association, vol. 50(5), pages 1595-1631, December.
    7. Trenkler, Carsten, 2009. "Bootstrapping Systems Cointegration Tests With A Prior Adjustment For Deterministic Terms," Econometric Theory, Cambridge University Press, vol. 25(1), pages 243-269, February.
    8. Russell Davidson & James G. MacKinnon, 2015. "Bootstrap Tests for Overidentification in Linear Regression Models," Econometrics, MDPI, vol. 3(4), pages 1-39, December.
    9. Giuseppe Cavaliere & A. M. Robert Taylor, 2009. "Bootstrap M Unit Root Tests," Econometric Reviews, Taylor & Francis Journals, vol. 28(5), pages 393-421.
    10. Davidson, Russell & Trokić, Mirza, 2020. "The fast iterated bootstrap," Journal of Econometrics, Elsevier, vol. 218(2), pages 451-475.
    11. Jamel Jouini, 2010. "Bootstrap methods for single structural change tests: power versus corrected size and empirical illustration," Statistical Papers, Springer, vol. 51(1), pages 85-109, January.
    12. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    13. Karl Whelan, 2005. "Testing parameter stability : a wild bootstrap approach," Open Access publications 10197/225, School of Economics, University College Dublin.
    14. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    15. Monika Blaszkiewicz-Schwartzman, 2007. "Explaining Exchange Rate Movements in New Member States of the European Union: Nominal and Real Convergence," Money Macro and Finance (MMF) Research Group Conference 2006 144, Money Macro and Finance Research Group.
    16. repec:hum:wpaper:sfb649dp2006-012 is not listed on IDEAS
    17. King, Maxwell L. & Zhang, Xibin & Akram, Muhammad, 2020. "Hypothesis testing based on a vector of statistics," Journal of Econometrics, Elsevier, vol. 219(2), pages 425-455.
    18. Cavaliere, Giuseppe & Harvey, David I. & Leybourne, Stephen J. & Taylor, A.M. Robert, 2011. "Testing For Unit Roots In The Presence Of A Possible Break In Trend And Nonstationary Volatility," Econometric Theory, Cambridge University Press, vol. 27(5), pages 957-991, October.
    19. Zhenlin Yang, 2013. "LM Tests of Spatial Dependence Based on Bootstrap Critical Values," Working Papers 03-2013, Singapore Management University, School of Economics.
    20. Lorenzo Camponovo & O. Scaillet & Fabio Trojani, 2013. "Predictability Hidden by Anomalous Observations," Swiss Finance Institute Research Paper Series 13-05, Swiss Finance Institute.
    21. Emma Iglesias & Jean Marie Dufour, 2004. "Finite Sample and Optimal Inference in Possibly Nonstationary ARCH Models with Gaussian and Heavy-Tailed Errors," Econometric Society 2004 North American Summer Meetings 161, Econometric Society.

    More about this item

    Keywords

    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:quedwp:273603. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.