IDEAS home Printed from https://ideas.repec.org/p/ags/queddp/273372.html
   My bibliography  Save this paper

The Power of Bootstrap Tests

Author

Listed:
  • Davidson, Russell
  • MacKinnon, James G.

Abstract

Bootstrap tests are tests for which the signicance level is calculated using some variant of the bootstrap which may be parametric or nonparametric We show that the power of a bootstrap test will generally be very close to the power of the asymptotic test on which it is based provided that both tests are properly adjusted to have the correct size We also discuss the loss of power that can occur when the number of bootstrap samples is relatively small Some Monte Carlo results for two forms of omitted variable test in logit models are presented These illustrate the theoretical results of the paper and demonstrate that the sizeadjusted power of asymptotic tests can vary greatly depending on the method used for size adjustment

Suggested Citation

  • Davidson, Russell & MacKinnon, James G., 1996. "The Power of Bootstrap Tests," Queen's Institute for Economic Research Discussion Papers 273372, Queen's University - Department of Economics.
  • Handle: RePEc:ags:queddp:273372
    DOI: 10.22004/ag.econ.273372
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/273372/files/qed_wp_937.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.273372?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Davidson, Russell & MacKinnon, James G., 1984. "Convenient specification tests for logit and probit models," Journal of Econometrics, Elsevier, vol. 25(3), pages 241-262, July.
    2. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    3. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    4. Horowitz, Joel L., 1994. "Bootstrap-based critical values for the information matrix test," Journal of Econometrics, Elsevier, vol. 61(2), pages 395-411, April.
    5. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    6. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    7. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andersson, Michael K. & Gredenhoff, Mikael P., 1998. "Robust Testing for Fractional Integration Using the Bootstrap," SSE/EFI Working Paper Series in Economics and Finance 218, Stockholm School of Economics.
    2. Flachaire, Emmanuel, 1999. "A better way to bootstrap pairs," Economics Letters, Elsevier, vol. 64(3), pages 257-262, September.
    3. Pinkse, Joris & Slade, Margaret E., 1998. "Contracting in space: An application of spatial statistics to discrete-choice models," Journal of Econometrics, Elsevier, vol. 85(1), pages 125-154, July.
    4. Siani, Carole & de Peretti, Christian, 2007. "Analysing the performance of bootstrap neural tests for conditional heteroskedasticity in ARCH-M models," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2442-2460, February.
    5. Alessandra Canepa & Raymond O'Brien, 2000. "The Size and Power of Bootstrap Tests for Linear Restrictions in Misspecified Cointegrating Relationships," Econometric Society World Congress 2000 Contributed Papers 1807, Econometric Society.
    6. L. G. Godfrey & C. D. Orme, 1999. "The robustness, reliabiligy and power of heteroskedasticity tests," Econometric Reviews, Taylor & Francis Journals, vol. 18(2), pages 169-194.
    7. Coakley, Jerry & Fuertes, Ana-Maria, 2006. "Testing for sign and amplitude asymmetries using threshold autoregressions," Journal of Economic Dynamics and Control, Elsevier, vol. 30(4), pages 623-654, April.
    8. Christian de Peretti, 2003. "Bilateral Bootstrap Tests for Long Memory: An Application to the Silver Market," Computational Economics, Springer;Society for Computational Economics, vol. 22(2), pages 187-212, October.
    9. Michael K. Andersson & Sune Karlsson, 2001. "Bootstrapping Error Component Models," Computational Statistics, Springer, vol. 16(2), pages 221-231, July.
    10. Li, Hongyi & Xiao, Zhijie, 2000. "On bootstrapping regressions with unit root processes," Statistics & Probability Letters, Elsevier, vol. 48(3), pages 261-267, July.
    11. Harris, R. I. D. & Judge, G., 1998. "Small sample testing for cointegration using the bootstrap approach," Economics Letters, Elsevier, vol. 58(1), pages 31-37, January.
    12. Tor Jacobson & Johan Lyhagen & Rolf Larsson & Marianne Nessén, 2008. "Inflation, exchange rates and PPP in a multivariate panel cointegration model," Econometrics Journal, Royal Economic Society, vol. 11(1), pages 58-79, March.
    13. Martin, Michael A., 2007. "Bootstrap hypothesis testing for some common statistical problems: A critical evaluation of size and power properties," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6321-6342, August.
    14. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    15. Dirk Hoorelbeke, 2004. "Bootstrap correcting the score test," Econometric Society 2004 North American Summer Meetings 228, Econometric Society.
    16. Christian Peretti, 2007. "Long Memory and Hysteresis," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 363-389, Springer.
    17. Andersson, Michael K. & Gredenhoff, Mikael P., 1997. "Bootstrap Testing for Fractional Integration," SSE/EFI Working Paper Series in Economics and Finance 188, Stockholm School of Economics.
    18. Monfardini, Chiara, 2003. "An illustration of Cox's non-nested testing procedure for logit and probit models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 425-444, March.
    19. Jeong, Jinook & Chung, Seoung, 2001. "Bootstrap tests for autocorrelation," Computational Statistics & Data Analysis, Elsevier, vol. 38(1), pages 49-69, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    2. Joel L. Horowitz, 2018. "Bootstrap Methods in Econometrics," Papers 1809.04016, arXiv.org.
    3. Bergström, Pål, 1999. "Bootstrap Methods and Applications in Econometrics - A Brief Survey," Working Paper Series 1999:2, Uppsala University, Department of Economics.
    4. Davidson, Russell & MacKinnon, James G., 1997. "Bootstrap Testing How Many Bootstraps," Queen's Institute for Economic Research Discussion Papers 273385, Queen's University - Department of Economics.
    5. Yang, Zhenlin, 2015. "LM tests of spatial dependence based on bootstrap critical values," Journal of Econometrics, Elsevier, vol. 185(1), pages 33-59.
    6. Yazid Dissou & Reza Ghazal, 2010. "Energy Substitutability in Canadian Manufacturing Econometric Estimation with Bootstrap Confidence Intervals," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 121-148.
    7. Zhenlin Yang, 2018. "Bootstrap LM tests for higher-order spatial effects in spatial linear regression models," Empirical Economics, Springer, vol. 55(1), pages 35-68, August.
    8. Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
    9. Ilaria Piatti & Fabio Trojani, 2020. "Dividend Growth Predictability and the Price–Dividend Ratio," Management Science, INFORMS, vol. 66(1), pages 130-158, January.
    10. Wolfgang Härdle & Joel Horowitz & Jens‐Peter Kreiss, 2003. "Bootstrap Methods for Time Series," International Statistical Review, International Statistical Institute, vol. 71(2), pages 435-459, August.
    11. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    12. Grammig, Joachim & Schrimpf, Andreas, 2009. "Asset pricing with a reference level of consumption: New evidence from the cross-section of stock returns," Review of Financial Economics, Elsevier, vol. 18(3), pages 113-123, August.
    13. John Lynham, 2017. "Identifying Peer Effects Using Gold Rushers," Land Economics, University of Wisconsin Press, vol. 93(3), pages 527-548.
    14. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    15. Groneck, Max & Ludwig, Alexander & Zimper, Alexander, 2016. "A life-cycle model with ambiguous survival beliefs," Journal of Economic Theory, Elsevier, vol. 162(C), pages 137-180.
    16. Guerron-Quintana, Pablo & Inoue, Atsushi & Kilian, Lutz, 2017. "Impulse response matching estimators for DSGE models," Journal of Econometrics, Elsevier, vol. 196(1), pages 144-155.
    17. Zhenlin Yang, 2013. "LM Tests of Spatial Dependence Based on Bootstrap Critical Values," Working Papers 03-2013, Singapore Management University, School of Economics.
    18. Lorenzo Camponovo & O. Scaillet & Fabio Trojani, 2013. "Predictability Hidden by Anomalous Observations," Swiss Finance Institute Research Paper Series 13-05, Swiss Finance Institute.
    19. Dovonon, Prosper & Gonçalves, Sílvia, 2017. "Bootstrapping the GMM overidentification test under first-order underidentification," Journal of Econometrics, Elsevier, vol. 201(1), pages 43-71.
    20. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:queddp:273372. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.