Bootstrap Hypothesis Testing
Abstract
This paper surveys bootstrap and Monte Carlo methods for testing hypotheses in econometrics. Several different ways of computing bootstrap P values are discussed, including the double bootstrap and the fast double bootstrap. It is emphasized that there are many different procedures for generating bootstrap samples for regression models and other types of model. As an illustration, a simulation experiment examines the performance of several methods of bootstrapping the supF test for structural change with an unknown break point.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Queen's University, Department of Economics in its series Working Papers with number 1127.Length: 35 pages
Date of creation: Jun 2007
Date of revision:
Handle: RePEc:qed:wpaper:1127
Contact details of provider:
Postal: Kingston, Ontario, K7L 3N6
Phone: (613) 533-2250
Fax: (613) 533-6668
Email:
Web page: http://qed.econ.queensu.ca/
More information through EDIRC
Related research
Keywords: bootstrap test; supF test; wild bootstrap; pairs bootstrap; moving block bootstrap; residual bootstrap; bootstrap P value;Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
This paper has been announced in the following NEP Reports:
- NEP-ALL-2007-06-30 (All new papers)
- NEP-ECM-2007-06-30 (Econometrics)
- NEP-ICT-2007-06-30 (Information & Communication Technologies)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Cameron, A. Colin & Miller, Douglas & Gelbach, Jonah B., 2006.
"Bootstrap-Based Improvements for Inference with Clustered Errors,"
Working Papers
06-21, University of California at Davis, Department of Economics.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
- Doug Miller & A. Colin Cameron & Jonah B. Gelbach, 2006. "Bootstrap-Based Improvements for Inference with Clustered Errors," Working Papers 621, University of California, Davis, Department of Economics.
- Francis X. Diebold & Celia Chen, 1993.
"Testing structural stability with endogenous break point: a size comparison of analytic and bootstrap procedures,"
Working Papers
93-11, Federal Reserve Bank of Philadelphia.
- Diebold, Francis X. & Chen, Celia, 1996. "Testing structural stability with endogenous breakpoint A size comparison of analytic and bootstrap procedures," Journal of Econometrics, Elsevier, vol. 70(1), pages 221-241, January.
- L. G. Godfrey & C. D. Orme & J. M. C. Santos Silva, 2006. "Simulation-based tests for heteroskedasticity in linear regression models: Some further results," Econometrics Journal, Royal Economic Society, vol. 9(1), pages 76-97, 03.
- Emmanuel Flachaire, 2001.
"The Wild Bootstrap, Tamed at Last,"
STICERD - Distributional Analysis Research Programme Papers
58, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
- Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
- Russell Davidson & Emmanuel Flachaire, 2000. "The Wild Bootstrap, Tamed at Last," Econometric Society World Congress 2000 Contributed Papers 1413, Econometric Society.
- Russell Davidson & Emmanuel Flachaire, 2001. "The Wild Bootstrap, Tamed at Last," Working Papers 1000, Queen's University, Department of Economics.
- Davidson, R. & Flachaire, E., 1999. "The Wild Bootstrap, Tamed at Last," G.R.E.Q.A.M. 99a32, Universite Aix-Marseille III.
- Bruce E. Hansen, 1995.
"Approximate Asymptotic P-Values for Structural Change Tests,"
Boston College Working Papers in Economics
297., Boston College Department of Economics.
- Hansen, Bruce E, 1997. "Approximate Asymptotic P Values for Structural-Change Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 60-67, January.
- JAMES G. MacKINNON, 2006.
"Bootstrap Methods in Econometrics,"
The Economic Record,
The Economic Society of Australia, vol. 82(s1), pages S2-S18, 09.
- James G. MacKinnon, 2006. "Bootstrap Methods in Econometrics," Working Papers 1028, Queen's University, Department of Economics.
- Hansen, Bruce E., 2000.
"Testing for structural change in conditional models,"
Journal of Econometrics,
Elsevier, vol. 97(1), pages 93-115, July.
- Tom Doan, . "RATS programs to replicate structural break test with Hansen's fixed regressor bootstrap," Statistical Software Components RTZ00089, Boston College Department of Economics.
- Bruce E. Hansen, 1998. "Testing for Structural Change in Conditional Models," Boston College Working Papers in Economics 310., Boston College Department of Economics.
- Tom Doan, . "REGHBREAK: RATS procedure to perform structural break test with bootstrapped p-values," Statistical Software Components RTS00176, Boston College Department of Economics.
- Russell Davidson & James Mackinnon, 2009.
"Bootstrap inference in a linear equation estimated by instrumental variables,"
Working Papers
halshs-00442713, HAL.
- Russell Davidson & James G. MacKinnon, 2008. "Bootstrap inference in a linear equation estimated by instrumental variables," Econometrics Journal, Royal Economic Society, vol. 11(3), pages 443-477, November.
- Russell Davidson & James MacKinnon, 2006. "Bootstrap Inference In A Linear Equation Estimated By Instrumental Variables," Departmental Working Papers 2006-21, McGill University, Department of Economics.
- Russell Davidson & James G. MacKinnon, 2008. "Bootstrap Inference in a Linear Equation Estimated by Instrumental Variables," Working Papers 1157, Queen's University, Department of Economics.
- Russell Davidson & James G. MacKinnon, 2006. "Bootstrap Inference in a Linear Equation Estimated by Instrumental Variables," Working Papers 1024, Queen's University, Department of Economics.
- Gonçalves, Sílvia & KILIAN, Lutz, 2003.
"Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form,"
Cahiers de recherche
01-2003, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
- Lutz Kilian & Silvia Goncalves, 2002. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Working Paper Series 196, European Central Bank.
- GONÇALVES, Silvia & KILIAN, Lutz, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Cahiers de recherche 2003-01, Universite de Montreal, Departement de sciences economiques.
- Kilian, Lutz & Gonçalves, Sílvia, 2002. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Discussion Paper Series 1: Economic Studies 2002,26, Deutsche Bundesbank, Research Centre.
- Sílvia Gonçalves & Lutz Kilian, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," CIRANO Working Papers 2003s-17, CIRANO.
- Davidson, Russell & MacKinnon, James G, 1981.
"Several Tests for Model Specification in the Presence of Alternative Hypotheses,"
Econometrica,
Econometric Society, vol. 49(3), pages 781-93, May.
- Russell Davidson & James G. MacKinnon, 1980. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Working Papers 378, Queen's University, Department of Economics.
- Goncalves, Silvia & White, Halbert, 2002.
"Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models,"
University of California at San Diego, Economics Working Paper Series
qt8hx21540, Department of Economics, UC San Diego.
- Goncalves, Silvia & White, Halbert, 2004. "Maximum likelihood and the bootstrap for nonlinear dynamic models," Journal of Econometrics, Elsevier, vol. 119(1), pages 199-219, March.
- Goncalves, Silvia & White, Halbert, 2000. "Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models," University of California at San Diego, Economics Working Paper Series qt1bj657ff, Department of Economics, UC San Diego.
- Sílvia Gonçalves & Halbert White, 2002. "Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models," CIRANO Working Papers 2002s-41, CIRANO.
- Joon Y. Park, 2000.
"Bootstrap Unit Root Tests,"
Econometric Society World Congress 2000 Contributed Papers
1587, Econometric Society.
- Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
- Park, Joon, 2002. "Bootstrap Unit Root Tests," Working Papers 2003-04, Rice University, Department of Economics.
- Donald W.K. Andrews & Werner Ploberger, 1992.
"Optimal Tests When a Nuisance Parameter Is Present Only Under the Alternative,"
Cowles Foundation Discussion Papers
1015, Cowles Foundation for Research in Economics, Yale University.
- Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
- Russell Davidson & James G. MacKinnon, 2004.
"The Power of Bootstrap and Asymptotic Tests,"
Working Papers
1035, Queen's University, Department of Economics.
- Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
- Efstathios Paparoditis & Dimitris N. Politis, 2003. "Residual-Based Block Bootstrap for Unit Root Testing," Econometrica, Econometric Society, vol. 71(3), pages 813-855, 05.
- Yoosoon Chang & Joon Y. Park, 2003. "A Sieve Bootstrap For The Test Of A Unit Root," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 379-400, 07.
- Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor and Francis Journals, vol. 16(3), pages 321-352.
- Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
- King, Maxwell L., 1985. "A point optimal test for autoregressive disturbances," Journal of Econometrics, Elsevier, vol. 27(1), pages 21-37, January.
- Donald W.K. Andrews, 2002.
"The Block-block Bootstrap: Improved Asymptotic Refinements,"
Cowles Foundation Discussion Papers
1370, Cowles Foundation for Research in Economics, Yale University.
- Donald W. K. Andrews, 2004. "the Block-Block Bootstrap: Improved Asymptotic Refinements," Econometrica, Econometric Society, vol. 72(3), pages 673-700, 05.
- Dufour, J.M. & Khalaf, L., 2000.
"Simulation-Based Finite and Large Sample Tests in Multivariate Regressions,"
Cahiers de recherche
2000-10, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Simulation based finite and large sample tests in multivariate regressions," Journal of Econometrics, Elsevier, vol. 111(2), pages 303-322, December.
- DUFOUR, Jean-Marie & KHALAF, Lynda, 2000. "Simulation-Based Finite and Large Sample Tests in Multivariate Regressions," Cahiers de recherche 2000-10, Universite de Montreal, Departement de sciences economiques.
- Jean-Marie Dufour & Lynda Khalaf, 2000. "Simulation Based Finite and Large Sample Tests in Multivariate Regressions," CIRANO Working Papers 2000s-15, CIRANO.
- Imbens, Guido & Abadie, Alberto, 2008.
"On the Failure of the Bootstrap for Matching Estimators,"
Scholarly Articles
3043415, Harvard University Department of Economics.
- Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
- Alberto Abadie & Guido W. Imbens, 2006. "On the Failure of the Bootstrap for Matching Estimators," NBER Technical Working Papers 0325, National Bureau of Economic Research, Inc.
- Jeff Racine & James G. MacKinnon, 2004. "Simulation-based Tests that Can Use Any Number of Simulations," Working Papers 1027, Queen's University, Department of Economics.
- Jean-Marie Dufour, 2005.
"Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and non-standard asymptotics,"
CIRANO Working Papers
2005s-02, CIRANO.
- Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
- DUFOUR, Jean-Marie, 2005. "Monte Carlo Tests with Nuisance Parameters: A General Approach to Finite-Sample Inference and Nonstandard Asymptotics," Cahiers de recherche 2005-03, Universite de Montreal, Departement de sciences economiques.
- James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 35(4), pages 615-645, November.
- Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-94, September.
- Racine, Jeffrey S. & MacKinnon, James G., 2007.
"Inference via kernel smoothing of bootstrap P values,"
Computational Statistics & Data Analysis,
Elsevier, vol. 51(12), pages 5949-5957, August.
- Jeff Racine & James G. MacKinnon, 2006. "Inference via kernel smoothing of bootstrap P values," Working Papers 1054, Queen's University, Department of Economics.
- Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
- Andrews, Donald W K, 1993.
"Tests for Parameter Instability and Structural Change with Unknown Change Point,"
Econometrica,
Econometric Society, vol. 61(4), pages 821-56, July.
- Donald W.K. Andrews, 1990. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Cowles Foundation Discussion Papers 943, Cowles Foundation for Research in Economics, Yale University.
- Dufour, Jean-Marie & King, Maxwell L., 1991. "Optimal invariant tests for the autocorrelation coefficient in linear regressions with stationary or nonstationary AR(1) errors," Journal of Econometrics, Elsevier, vol. 47(1), pages 115-143, January.
- Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, 04.
- Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228 Elsevier.
- Russell Davidson & James G. MacKinnon, 2006.
"Improving the Reliability of Bootstrap Tests with the Fast Double Bootstrap,"
Working Papers
1044, Queen's University, Department of Economics.
- Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
- Russell Davidson & James Mackinnon, 2006. "Improving the reliability of bootstrap tests with the fast double bootstrap," Working Papers halshs-00439247, HAL.
- James G. MacKinnon & Anthony A. Smith Jr., 1995.
"Approximate Bias Correction in Econometrics,"
Working Papers
919, Queen's University, Department of Economics.
- MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
- James G. MacKinnon & Anthony A. Smith, Jr., . "Approximate Bias Correction in Econometrics," GSIA Working Papers 1997-36, Carnegie Mellon University, Tepper School of Business.
- Mackinnon, J.G. & Smith, A.A., 1996. "Approximate Bias Correction in Econometrics," G.R.E.Q.A.M. 96a14, Universite Aix-Marseille III.
- Patrick Richard, 2007. "ARMA Sieve bootstrap unit root tests," Cahiers de recherche 07-05, Departement d'Economique de la Faculte d'administration à l'Universite de Sherbrooke, revised Jul 2009.
- Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996.
"Efficient Tests for an Autoregressive Unit Root,"
Econometrica,
Econometric Society, vol. 64(4), pages 813-36, July.
- Graham Elliott & Thomas J. Rothenberg & James H. Stock, 1992. "Efficient Tests for an Autoregressive Unit Root," NBER Technical Working Papers 0130, National Bureau of Economic Research, Inc.
- Tom Doan, . "ERSTEST: RATS procedure to perform Elliott-Rothenberg-Stock unit root tests," Statistical Software Components RTS00066, Boston College Department of Economics.
- Tom Doan, . "GLSDETREND: RATS procedure to perform local to unity GLS detrending," Statistical Software Components RTS00077, Boston College Department of Economics.
- Davidson, Russell & MacKinnon, James G., 1999.
"The Size Distortion Of Bootstrap Tests,"
Econometric Theory,
Cambridge University Press, vol. 15(03), pages 361-376, June.
- Davidson, R. & Mackinnon, J.G., 1996. "The Size Distorsion of Bootstrap Tests," G.R.E.Q.A.M. 96a15, Universite Aix-Marseille III.
- Koenker, Roger, 1981. "A note on studentizing a test for heteroscedasticity," Journal of Econometrics, Elsevier, vol. 17(1), pages 107-112, September.
- Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor and Francis Journals, vol. 21(4), pages 419-429.
- Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2007. "Multivariate Tests of MeanVariance Efficiency With Possibly Non-Gaussian Errors: An Exact Simulation-Based Approach," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 398-410, October.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Gelman, Sergey & Wilfling, Bernd, 2009. "Markov-switching in target stocks during takeover bids," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 745-758, December.
- Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
- Huber, Martin & Mellace, Giovanni, 2011. "Testing instrument validity for LATE identification based on inequality moment constraints," Economics Working Paper Series 1143, University of St. Gallen, School of Economics and Political Science.
- Yalta, A. Talha, 2011.
"Analyzing energy consumption and GDP nexus using maximum entropy bootstrap: The case of Turkey,"
Energy Economics,
Elsevier, vol. 33(3), pages 453-460, May.
- A. Talha Yalta, 2011. "Analyzing Energy Consumption and GDP Nexus Using Maximum Entropy Bootstrap: The Case of Turkey," Working Papers 1103, TOBB University of Economics and Technology, Department of Economics.
- Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2009.
"Hypothesis testing in econometrics,"
IEW - Working Papers
444, Institute for Empirical Research in Economics - University of Zurich.
- Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, 09.
- A. Yasemin Yalta, 2011. "New Evidence on FDI-Led Growth: The Case of China," Working Papers 1107, TOBB University of Economics and Technology, Department of Economics.
- Todd, Prono, 2009. "Market Proxies, Correlation, and Relative Mean-Variance Efficiency: Still Living with the Roll Critique," MPRA Paper 20031, University Library of Munich, Germany.
- Del Hoyo, Juan & Llorente, Guillermo & Rivero, Carlos, 2011. "Consumo de electricidad y producto interior bruto: Relación dinámica y estabilidad/Electricity Consumption and GDP: Dynamic Relationship and Stability," Estudios de Economía Aplicada, Estudios de Economía Aplicada, vol. 29, pages 473-492, Agosto.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1127For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Babcock).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

