IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Bootstrap Hypothesis Testing

  • James G. MacKinnon


    (Queen's University)

This paper surveys bootstrap and Monte Carlo methods for testing hypotheses in econometrics. Several different ways of computing bootstrap P values are discussed, including the double bootstrap and the fast double bootstrap. It is emphasized that there are many different procedures for generating bootstrap samples for regression models and other types of model. As an illustration, a simulation experiment examines the performance of several methods of bootstrapping the supF test for structural change with an unknown break point.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
File Function: First version 2007
Download Restriction: no

Paper provided by Queen's University, Department of Economics in its series Working Papers with number 1127.

in new window

Length: 35 pages
Date of creation: Jun 2007
Date of revision:
Handle: RePEc:qed:wpaper:1127
Contact details of provider: Postal: Kingston, Ontario, K7L 3N6
Phone: (613) 533-2250
Fax: (613) 533-6668
Web page:

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-56, July.
  2. Jeff Racine & James G. MacKinnon, 2006. "Inference via kernel smoothing of bootstrap P values," Working Papers 1054, Queen's University, Department of Economics.
  3. Russell Davidson & James Mackinnon, 2006. "Improving the reliability of bootstrap tests with the fast double bootstrap," Working Papers halshs-00439247, HAL.
  4. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
  5. Russell Davidson & James G. MacKinnon, 2001. "Bootstrap Tests: How Many Bootstraps?," Working Papers 1036, Queen's University, Department of Economics.
  6. Russell Davidson & James G. MacKinnon, 2008. "Bootstrap Inference in a Linear Equation Estimated by Instrumental Variables," Working Papers 1157, Queen's University, Department of Economics.
  7. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
  8. Russell Davidson & Emmanuel Flachaire, 2001. "The wild bootstrap, tamed at last," LSE Research Online Documents on Economics 6560, London School of Economics and Political Science, LSE Library.
  9. Goncalves, Silvia & White, Halbert, 2000. "Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models," University of California at San Diego, Economics Working Paper Series qt1bj657ff, Department of Economics, UC San Diego.
  10. Russell Davidson & James G. MacKinnon, 2004. "The Power of Bootstrap and Asymptotic Tests," Working Papers 1035, Queen's University, Department of Economics.
  11. Bruce E. Hansen, 1995. "Approximate Asymptotic P-Values for Structural Change Tests," Boston College Working Papers in Economics 297., Boston College Department of Economics.
  12. Efstathios Paparoditis & Dimitris N. Politis, 2003. "Residual-Based Block Bootstrap for Unit Root Testing," Econometrica, Econometric Society, vol. 71(3), pages 813-855, 05.
  13. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-36, July.
  14. Diebold, Francis X. & Chen, Celia, 1996. "Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures," Journal of Econometrics, Elsevier, vol. 70(1), pages 221-241, January.
  15. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
  16. Joon Y. Park, 2000. "Bootstrap Unit Root Tests," Econometric Society World Congress 2000 Contributed Papers 1587, Econometric Society.
  17. Yoosoon Chang & Joon Y. Park, 2003. "A Sieve Bootstrap For The Test Of A Unit Root," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 379-400, 07.
  18. Jeff Racine & James G. MacKinnon, 2004. "Simulation-based Tests that Can Use Any Number of Simulations," Working Papers 1027, Queen's University, Department of Economics.
  19. King, Maxwell L., 1985. "A point optimal test for autoregressive disturbances," Journal of Econometrics, Elsevier, vol. 27(1), pages 21-37, January.
  20. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, 04.
  21. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
  22. Russell Davidson & James G. MacKinnon, 1980. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Working Papers 378, Queen's University, Department of Economics.
  23. Donald W.K. Andrews & Werner Ploberger, 1992. "Optimal Tests When a Nuisance Parameter Is Present Only Under the Alternative," Cowles Foundation Discussion Papers 1015, Cowles Foundation for Research in Economics, Yale University.
  24. Gonçalves, Sílvia & KILIAN, Lutz, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Cahiers de recherche 01-2003, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
  25. Dufour, J.M. & Khalaf, L., 2000. "Simulation-Based Finite and Large Sample Tests in Multivariate Regressions," Cahiers de recherche 2000-10, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
  26. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2007. "Multivariate Tests of MeanVariance Efficiency With Possibly Non-Gaussian Errors: An Exact Simulation-Based Approach," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 398-410, October.
  27. James G. MacKinnon & Anthony A. Smith Jr., 1995. "Approximate Bias Correction in Econometrics," Working Papers 919, Queen's University, Department of Economics.
  28. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-94, September.
  29. Donald W.K. Andrews, 1999. "Higher-Order Improvements of a Computationally Attractive-Step Bootstrap for Extremum Estimators," Cowles Foundation Discussion Papers 1230, Cowles Foundation for Research in Economics, Yale University.
  30. James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 35(4), pages 615-645, November.
  31. Patrick Richard, 2007. "ARMA Sieve bootstrap unit root tests," Cahiers de recherche 07-05, Departement d'Economique de la Faculte d'administration à l'Universite de Sherbrooke, revised Jul 2009.
  32. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 419-429.
  33. JAMES G. MacKINNON, 2006. "Bootstrap Methods in Econometrics," The Economic Record, The Economic Society of Australia, vol. 82(s1), pages S2-S18, 09.
  34. Davidson, R. & Mackinnon, J.G., 1996. "The Size Distorsion of Bootstrap Tests," G.R.E.Q.A.M. 96a15, Universite Aix-Marseille III.
  35. Donald W. K. Andrews, 2004. "the Block-Block Bootstrap: Improved Asymptotic Refinements," Econometrica, Econometric Society, vol. 72(3), pages 673-700, 05.
  36. Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228 Elsevier.
  37. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
  38. Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor & Francis Journals, vol. 16(3), pages 321-352.
  39. L. G. Godfrey & C. D. Orme & J. M. C. Santos Silva, 2006. "Simulation-based tests for heteroskedasticity in linear regression models: Some further results," Econometrics Journal, Royal Economic Society, vol. 9(1), pages 76-97, 03.
  40. Dufour, Jean-Marie & King, Maxwell L., 1991. "Optimal invariant tests for the autocorrelation coefficient in linear regressions with stationary or nonstationary AR(1) errors," Journal of Econometrics, Elsevier, vol. 47(1), pages 115-143, January.
  41. Koenker, Roger, 1981. "A note on studentizing a test for heteroscedasticity," Journal of Econometrics, Elsevier, vol. 17(1), pages 107-112, September.
  42. Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1127. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Babcock)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.