This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Bootstrap correcting the score test

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Dirk Hoorelbeke
Abstract

The Lagrange multiplier test, or score test, suggested independently by Aitchison and Silvey (1958) and Rao (1948), tests for parametric restrictions. Although the score test is an intuitively appealing and often used procedure, the exact distribution of the score test statistic is generally unknown and is often approximated by its first-order asymptotic $\chi^2$ distribution. In problems of econometric inference, however, first-order asymptotic theory may be a poor guide, and this is also true for the score test, as demonstrated in different Monte Carlo studies. See e.g. Breusch and Pagan (1979), Bera and Jarque (1981), Davidson and MacKinnon (1983, 1984, 1992), Chesher and Spady (1991) and Horowitz (1994), among many others. One can use the bootstrap distribution of the score test statistic to obtain a critical value. This can give already satisfactory results in terms of ERP (error in rejection probability: the difference between nominal and actual rejection probability under the null hypothesis). However, the score test uses a quadratic form statistic. In the construction and implementation of such a quadratic form statistic two important aspects, which determine the performance of the test (both under the null and the alternative), are (i) the weighting matrix (the covariance matrix of the score vector) and (ii) the critical value. Since the score test statistic is asymptotically pivotal, the bootstrap critical value is second-order correct. However, one can achieve better performance, as well in terms of ERP as of power, by using a better estimate of the weighting matrix used in the quadratic form. In this paper we propose a bootstrap-based method to obtain both a second-order correct estimate of the covariance matrix of the score vector and a second-order correct critical value, using only one round of simulations (instead of B1 + B1 x B2). The method works as follows. Assume there exists a matrix A such that the score vector premultiplied by A is asymptotically pivotal. An obvious choice for A is the inverse of a square root of a covariance matrix estimate of the score vector, yielding a multivariate studentized score vector. This is not the only possible choice for A, though. Since then the transformed score vector is asymptotically pivotal, the bootstrap distribution is a second-order approximation to the exact finite sample distribution. As such, the bootstrap covariance matrix of the transformed score vector is also second-order correct. The next step is to construct a quadratic form statistic in the transformed score vector using its bootstrap covariance matrix as weighting matrix. This statistic is asymptotically (as both the sample size and the number of bootstrap simulations go to infinity) chi-squared distributed with q (the dimension of the score) degrees of freedom. In practice, however, the number of bootstrap simulations is fixed to, say, B simulations. In this case the statistic is asymptotically (for the sample size tending to infinity) Hotelling T-squared distributed with q and B-1 degrees of freedom. Using a finite B, the exact finite sample covariance matrix of the transformed score vector is estimated with some noise, but the T-squared critical values correct for this. When the T-squared critical values are used, one is still only first-order correct. But the distribution of the new statistic can also be approximated by the empirical distribution function of the quadratic forms in the bootstrap replications of the transformed score vector using the inverse of the bootstrap covariance matrix as weighting matrix. The appropriate quantile of this empirical distribution delivers a critical value which is second-order correct. In a Monte Carlo simulation study we look at the information matrix test (White, 1982) in the regression model. Chesher (1983) showed that the information matrix is a score test for parameter constancy. We correct the Chesher-Lancaster version (Chesher, 1983 and Lancaster, 1984) of the information matrix test with the method proposed above and look at the ERP under the null and the power under a heteroskedastic alternative. The corrected statistic outperforms the Chesher-Lancaster statistic both in terms of ERP (with asymptotic or bootstrap critical values) and power.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://repec.org/esNASM04/up.10721.1075302399.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Econometric Society in its series Econometric Society 2004 North American Summer Meetings with number 228.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length:
Date of creation: 11 Aug 2004
Date of revision:
Handle: RePEc:ecm:nasm04:228

Contact details of provider:
Phone: 1 212 998 3820
Fax: 1 212 995 4487
Email:
Web page: http://www.econometricsociety.org/pastmeetings.asp
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Christopher F. Baum).

Related research
Keywords: bootstrap score test

Find related papers by JEL classification:
C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Hypothesis Testing
C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Statistical Simulation Methods

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Chesher, Andrew D, 1984. "Testing for Neglected Heterogeneity," Econometrica, Econometric Society, vol. 52(4), pages 865-72, July. [Downloadable!] (restricted)
  2. Dhaene, Geert & Hoorelbeke, Dirk, 2004. "The information matrix test with bootstrap-based covariance matrix estimation," Economics Letters, Elsevier, vol. 82(3), pages 341-347, March. [Downloadable!] (restricted)
    Other versions:
  3. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, Blackwell Publishing, vol. 66(1), pages 1-26, January.
    Other versions:
  4. Davidson, Russell & MacKinnon, James G., 1984. "Convenient specification tests for logit and probit models," Journal of Econometrics, Elsevier, vol. 25(3), pages 241-262, July. [Downloadable!] (restricted)
    Other versions:
  5. Orme, Chris, 1990. "The small-sample performance of the information-matrix test," Journal of Econometrics, Elsevier, vol. 46(3), pages 309-331, December. [Downloadable!] (restricted)
  6. Teresa Aparicio, Inmaculada Villanua, 2001. "The asymptotically efficient version of the information matrix test in binary choice models. A study of size and power," Journal of Applied Statistics, Taylor and Francis Journals, vol. 28(2), pages 167-182, February. [Downloadable!] (restricted)
  7. Hall, Alastair, 1987. "The Information Matrix Test for the Linear Model," Review of Economic Studies, Blackwell Publishing, vol. 54(2), pages 257-63, April. [Downloadable!] (restricted)
    Other versions:
  8. Davidson, Russel & MacKinnon, James G., 1983. "Small sample properties of alternative forms of the Lagrange Multiplier test," Economics Letters, Elsevier, vol. 12(3-4), pages 269-275. [Downloadable!] (restricted)
    Other versions:
  9. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-94, September. [Downloadable!] (restricted)
  10. Russell Davidson & James G. MacKinnon, 1996. "The Power of Bootstrap Tests," Working Papers 937, Queen's University, Department of Economics. [Downloadable!]
  11. Lancaster, Tony, 1984. "The Covariance Matrix of the Information Matrix Test," Econometrica, Econometric Society, vol. 52(4), pages 1051-53, July. [Downloadable!] (restricted)
  12. Davidson, Russell & MacKinnon, James G, 1992. "A New Form of the Information Matrix Test," Econometrica, Econometric Society, vol. 60(1), pages 145-57, January. [Downloadable!] (restricted)
    Other versions:
  13. Chesher, Andrew, 1983. "The information matrix test : Simplified calculation via a score test interpretation," Economics Letters, Elsevier, vol. 13(1), pages 45-48. [Downloadable!] (restricted)
Full references

Statistics
Access and download statistics

Did you know? RePEc encourages publishers to make their bibliographic data freely available to the public.

This page was last updated on 2008-10-3.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.