Local sensitivity and diagnostic tests
AbstractIn this paper, we confront sensitivity analysis with diagnostic testing. Every model is misspecified (in the sense that no model coincides with the data-generating process), but a model is useful if the parameters of interest (the focus) are not sensitive to small perturbations in the underlying assumptions. The study of the effect of these violations on the focus is called sensitivity analysis. Diagnostic testing, on the other hand, attempts to find out whether a nuisance parameter is (statistically) "large" or "small". Both aspects are important, but traditional applied econometrics tends to use only diagnostics and forget about sensitivity analysis. We develop a theory of sensitivity in a maximum likelihood framework, give conditions under which the diagnostic and the sensitivity are asymptotically independent, and demonstrate with three core examples that this independence is the rule rather than the exception, thus underlying the importance of sensitivity analysis. Copyright Royal Economic Society 2007
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Royal Economic Society in its journal Econometrics Journal.
Volume (Year): 10 (2007)
Issue (Month): 1 (03)
Contact details of provider:
Postal: Office of the Secretary-General, School of Economics and Finance, University of St. Andrews, St. Andrews, Fife, KY16 9AL, UK
Phone: +44 1334 462479
Web page: http://www.res.org.uk/
More information through EDIRC
Other versions of this item:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models &bull Diffusion Processes
- C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Banerjee, Anurag N. & Magnus, Jan R., 1999. "The sensitivity of OLS when the variance matrix is (partially) unknown," Journal of Econometrics, Elsevier, vol. 92(2), pages 295-323, October.
- Donald W.K. Andrews, 1994.
"Hypothesis Testing with a Restricted Parameter Space,"
Cowles Foundation Discussion Papers
1060R, Cowles Foundation for Research in Economics, Yale University.
- Andrews, Donald W. K., 1998. "Hypothesis testing with a restricted parameter space," Journal of Econometrics, Elsevier, vol. 84(1), pages 155-199, May.
- Magnus, Jan R., 1978. "Maximum likelihood estimation of the GLS model with unknown parameters in the disturbance covariance matrix," Journal of Econometrics, Elsevier, vol. 7(3), pages 281-312, April.
- Edward E. Leamer, 1983.
"Global Sensitivity Results for Generalized Least Squares Estimates,"
UCLA Economics Working Papers
296, UCLA Department of Economics.
- Edward E. Leamer, 1983. "Global Sensitivity Results for Generalized Least Squares Estimates," UCLA Economics Working Papers 006, UCLA Department of Economics.
- Banerjee, Anurag N. & Magnus, Jan R., 2000. "On the sensitivity of the usual t- and F-tests to covariance misspecification," Journal of Econometrics, Elsevier, vol. 95(1), pages 157-176, March.
- Magnus, J.R., 1978. "Maximum likelihood estimation of the GLS model with unknown parameters in the disturbance covariance matrix," Open Access publications from Tilburg University urn:nbn:nl:ui:12-153204, Tilburg University.
- Karim M. Abadir & Jan R. Magnus, 2002.
"Notation in econometrics: a proposal for a standard,"
Royal Economic Society, vol. 5(1), pages 76-90, June.
- Abadir, K.M. & Magnus, J.R., 2001. "Notation in Econometrics: A Proposal for a Standard," Discussion Paper 2001-8, Tilburg University, Center for Economic Research.
- Kleijnen, J.P.C., 1997. "Sensitivity analysis and related analyses: A review of some statistical techniques," Open Access publications from Tilburg University urn:nbn:nl:ui:12-73904, Tilburg University.
- Heijmans, Risto D. H. & Magnus, Jan R., 1986. "Consistent maximum-likelihood estimation with dependent observations : The general (non-normal) case and the normal case," Journal of Econometrics, Elsevier, vol. 32(2), pages 253-285, July.
- Heijmans, R.D.H. & Magnus, J.R., 1986. "On the first-order efficiency and asymptotic normality of maximum likelihood estimators obtained from dependent observations," Open Access publications from Tilburg University urn:nbn:nl:ui:12-153217, Tilburg University.
- Shi, Lei & Wang, Xueren, 1999. "Local influence in ridge regression," Computational Statistics & Data Analysis, Elsevier, vol. 31(3), pages 341-353, September.
- Mayston, David, 2009. "The determinants of cumulative endogeneity bias in multivariate analysis," Journal of Multivariate Analysis, Elsevier, vol. 100(6), pages 1120-1136, July.
- Carrasco, Jalmar M.F. & Ortega, Edwin M.M. & Paula, Gilberto A., 2008. "Log-modified Weibull regression models with censored data: Sensitivity and residual analysis," Computational Statistics & Data Analysis, Elsevier, vol. 52(8), pages 4021-4039, April.
- Zhang, Xinyu & Chen, Ti & Wan, Alan T.K. & Zou, Guohua, 2009. "Robustness of Stein-type estimators under a non-scalar error covariance structure," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2376-2388, November.
- Liu, Shuangzhe & Ma, Tiefeng & Polasek, Wolfgang, 2014. "Spatial system estimators for panel models: A sensitivity and simulation study," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 101(C), pages 78-102.
- Vasnev, Andrey L., 2010. "Sensitivity of GLS estimators in random effects models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1252-1262, May.
- Cibele Russo & Reiko Aoki & Gilberto Paula, 2012. "Assessment of variance components in nonlinear mixed-effects elliptical models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer, vol. 21(3), pages 519-545, September.
- Eric Manes, 2009. "Pakistan's Investment Climate : Laying the Foundation for Growth, Volume 2. Annexes," World Bank Other Operational Studies 12411, The World Bank.
- Hashimoto, Elizabeth M. & Ortega, Edwin M.M. & Cancho, Vicente G. & Cordeiro, Gauss M., 2010. "The log-exponentiated Weibull regression model for interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 1017-1035, April.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.