Improving the Reliability of Bootstrap Tests with the Fast Double Bootstrap
Abstract
We first propose two procedures for estimating the rejection probabilities of bootstrap tests in Monte Carlo experiments without actually computing a bootstrap test for each replication. These procedures are only about twice as expensive (per replication) as estimating rejection probabilities for asymptotic tests. We then propose a new procedure for computing bootstrap P values that will often be more accurate than ordinary ones. This "fast double bootstrap" is closely related to the double bootstrap, but it is far less computationally demanding. Simulation results for three different cases suggest that this procedure can be very useful in practice.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Queen's University, Department of Economics in its series Working Papers with number 1044.Length: 34 pages
Date of creation: Mar 2006
Date of revision:
Publication status: forthcoming in Computational Statistics and Data Analysis
Handle: RePEc:qed:wpaper:1044
Contact details of provider:
Postal: Kingston, Ontario, K7L 3N6
Phone: (613) 533-2250
Fax: (613) 533-6668
Email:
Web page: http://qed.econ.queensu.ca/
More information through EDIRC
Related research
Keywords: bootstrap test; double bootstrap; Monte Carlo experiment; rejection frequency; fast double bootstrap; FDB;Other versions of this item:
- Davidson, Russell & MacKinnon, James G., 2007. "Improving the reliability of bootstrap tests with the fast double bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3259-3281, April.
- Russell Davidson & James Mackinnon, 2006. "Improving the reliability of bootstrap tests with the fast double bootstrap," Working Papers halshs-00439247, HAL.
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
This paper has been announced in the following NEP Reports:
- NEP-ALL-2006-03-18 (All new papers)
- NEP-ECM-2006-03-18 (Econometrics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004.
"Simulation-based finite-sample tests for heteroskedasticity and ARCH effects,"
Journal of Econometrics,
Elsevier, vol. 122(2), pages 317-347, October.
- DUFOUR, Jean-Marie & KHALAF, Lynda & BERNARD, Jean-Thomas, 2001. "Simulation-Based Finite-Sample Tests for Heteroskedasticity and ARCH Effects," Cahiers de recherche 2001-08, Universite de Montreal, Departement de sciences economiques.
- Jean-Thomas Bernard & Jean-Marie Dufour & Ian Genest & Lynda Khalaf, 2001. "Simulation-Based Finite-Sample Tests for Heteroskedasticity and ARCH Effects," CIRANO Working Papers 2001s-25, CIRANO.
- Dufour, J.M. & Khalaf, L. & Bernard, J.T. & Genest, I., 2001. "Simulation-Based Finite-Sample Tests for Heteroskedasticity and ARCH Effects," Cahiers de recherche 2001-08, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Davidson, James, 2006. "Alternative bootstrap procedures for testing cointegration in fractionally integrated processes," Journal of Econometrics, Elsevier, vol. 133(2), pages 741-777, August.
- Gonçalves, Sílvia & KILIAN, Lutz, 2003.
"Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form,"
Cahiers de recherche
01-2003, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
- Lutz Kilian & Silvia Goncalves, 2002. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Working Paper Series 196, European Central Bank.
- GONÇALVES, Silvia & KILIAN, Lutz, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Cahiers de recherche 2003-01, Universite de Montreal, Departement de sciences economiques.
- Kilian, Lutz & Gonçalves, Sílvia, 2002. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," Discussion Paper Series 1: Economic Studies 2002,26, Deutsche Bundesbank, Research Centre.
- Sílvia Gonçalves & Lutz Kilian, 2003. "Bootstrapping Autoregressions with Conditional Heteroskedasticity of Unknown Form," CIRANO Working Papers 2003s-17, CIRANO.
- Joon Y. Park, 2000.
"Bootstrap Unit Root Tests,"
Econometric Society World Congress 2000 Contributed Papers
1587, Econometric Society.
- Joon Y. Park, 2003. "Bootstrap Unit Root Tests," Econometrica, Econometric Society, vol. 71(6), pages 1845-1895, November.
- Park, Joon, 2002. "Bootstrap Unit Root Tests," Working Papers 2003-04, Rice University, Department of Economics.
- Russell Davidson & James G. MacKinnon, 2004.
"The Power of Bootstrap and Asymptotic Tests,"
Working Papers
1035, Queen's University, Department of Economics.
- Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
- Russell Davidson & James MacKinnon, 2000.
"Bootstrap tests: how many bootstraps?,"
Econometric Reviews,
Taylor and Francis Journals, vol. 19(1), pages 55-68.
- Russell Davidson & James G. MacKinnon, 2001. "Bootstrap Tests: How Many Bootstraps?," Working Papers 1036, Queen's University, Department of Economics.
- Jean-FranÁois Lamarche, 2004. "The Numerical Performance of Fast Bootstrap Procedures," Computational Economics, Society for Computational Economics, vol. 23(4), pages 379-389, 06.
- Davidson, R. & Mackinnon, J.G., 1997.
"Bootstrap Tests of Nonnested Linear Regression Models,"
ASSET - Instituto De Economia Publica
170, ASSET (Association of Southern European Economic Theorists).
- Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
- Davidson, R. & Mackinnon, J. G., 1995. "Bootstrap Tests of Nonnested Linear Regression Models," G.R.E.Q.A.M. 97a25, Universite Aix-Marseille III.
- James G. MacKinnon, 2002. "Bootstrap inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 35(4), pages 615-645, November.
- Russell Davidson & James G. MacKinnon, 2000. "Improving the Reliability of Bootstrap Tests," Working Papers 995, Queen's University, Department of Economics.
- James G. MacKinnon & Anthony A. Smith Jr., 1995.
"Approximate Bias Correction in Econometrics,"
Working Papers
919, Queen's University, Department of Economics.
- MacKinnon, James G. & Smith Jr., Anthony A., 1998. "Approximate bias correction in econometrics," Journal of Econometrics, Elsevier, vol. 85(2), pages 205-230, August.
- James G. MacKinnon & Anthony A. Smith, Jr., . "Approximate Bias Correction in Econometrics," GSIA Working Papers 1997-36, Carnegie Mellon University, Tepper School of Business.
- Mackinnon, J.G. & Smith, A.A., 1996. "Approximate Bias Correction in Econometrics," G.R.E.Q.A.M. 96a14, Universite Aix-Marseille III.
- Russell Davidson & James G. MacKinnon, 1982.
"Convenient Specification Tests for Logit and Probit Models,"
Working Papers
514, Queen's University, Department of Economics.
- Davidson, Russell & MacKinnon, James G., 1984. "Convenient specification tests for logit and probit models," Journal of Econometrics, Elsevier, vol. 25(3), pages 241-262, July.
- Omtzigt Pieter & Fachin Stefano, 2002. "Bootstrapping and Bartlett corrections in the cointegrated VAR model," Economics and Quantitative Methods qf0212, Department of Economics, University of Insubria.
- Davidson, Russell & MacKinnon, James G., 1999.
"The Size Distortion Of Bootstrap Tests,"
Econometric Theory,
Cambridge University Press, vol. 15(03), pages 361-376, June.
- Davidson, R. & Mackinnon, J.G., 1996. "The Size Distorsion of Bootstrap Tests," G.R.E.Q.A.M. 96a15, Universite Aix-Marseille III.
- Davidson, R. & Mackinnon, J.G., 1997.
"Bootstrap Testing in Nonlinear Models,"
G.R.E.Q.A.M.
97a39, Universite Aix-Marseille III.
- Davidson, Russell & MacKinnon, James G, 1999. "Bootstrap Testing in Nonlinear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 487-508, May.
- James G. MacKinnon, 2006. "Applications of the Fast Double Bootstrap," Working Papers 1023, Queen's University, Department of Economics.
- Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor and Francis Journals, vol. 21(4), pages 419-429.
- Durbin, J, 1970. "Testing for Serial Correlation in Least-Squares Regression When Some of the Regressors are Lagged Dependent Variables," Econometrica, Econometric Society, vol. 38(3), pages 410-21, May.
- Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
- Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Richard, Patrick, 2009.
"Modified fast double sieve bootstraps for ADF tests,"
Computational Statistics & Data Analysis,
Elsevier, vol. 53(12), pages 4490-4499, October.
- Patrick Richard, 2008. "Modified Fast Double Sieve Bootstraps for ADF Tests," Cahiers de recherche 08-17, Departement d'Economique de la Faculte d'administration à l'Universite de Sherbrooke.
- Godfrey, L.G., 2007. "Alternative approaches to implementing Lagrange multiplier tests for serial correlation in dynamic regression models," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3282-3295, April.
- Christian Kascha & Carsten Trenkler, 2009.
"Bootstrapping the likelihood ratio cointegration test in error correction models with unknown lag order,"
Working Paper
2009/12, Norges Bank.
- Kascha, Christian & Trenkler, Carsten, 2011. "Bootstrapping the likelihood ratio cointegration test in error correction models with unknown lag order," Computational Statistics & Data Analysis, Elsevier, vol. 55(2), pages 1008-1017, February.
- Qian, Hang, 2011. "Sampling Variation, Monotone Instrumental Variables and the Bootstrap Bias Correction," MPRA Paper 32634, University Library of Munich, Germany.
- Chiu, Sung Nok & Wang, Ling, 2009. "Homogeneity tests for several Poisson populations," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4266-4278, October.
- Ahlgren, Niklas & Antell, Jan, 2006.
"Bootstrap and Fast Double Bootstrap Tests of Cointegration Rank with Financial Time Series,"
Working Papers
519, Hanken School of Economics.
- Ahlgren, N. & Antell, J., 2008. "Bootstrap and fast double bootstrap tests of cointegration rank with financial time series," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4754-4767, June.
- Bolduc, Denis & Khalaf, Lynda & Moyneur, Érick, 2008. "Identification-robust simulation-based inference in joint discrete/continuous models for energy markets," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 3148-3161, February.
- Cerrato, Mario & Sarantis, Nicholas, 2007. "A bootstrap panel unit root test under cross-sectional dependence, with an application to PPP," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 4028-4037, May.
- James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Papers 1127, Queen's University, Department of Economics.
- Kleijnen, J.P.C., 2006. "White Noise Assumptions Revisited: Regression Models and Statistical Designs for Simulation Practice," Discussion Paper 2006-50, Tilburg University, Center for Economic Research.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1044For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Babcock).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

