IDEAS home Printed from https://ideas.repec.org/a/ect/emjrnl/v10y2007i1p166-192.html
   My bibliography  Save this article

Local sensitivity and diagnostic tests

Author

Listed:
  • Jan R. Magnus
  • Andrey L. Vasnev

Abstract

In this paper, we confront sensitivity analysis with diagnostic testing. Every model is misspecified (in the sense that no model coincides with the data-generating process), but a model is useful if the parameters of interest (the focus) are not sensitive to small perturbations in the underlying assumptions. The study of the effect of these violations on the focus is called sensitivity analysis. Diagnostic testing, on the other hand, attempts to find out whether a nuisance parameter is (statistically) "large" or "small". Both aspects are important, but traditional applied econometrics tends to use only diagnostics and forget about sensitivity analysis. We develop a theory of sensitivity in a maximum likelihood framework, give conditions under which the diagnostic and the sensitivity are asymptotically independent, and demonstrate with three core examples that this independence is the rule rather than the exception, thus underlying the importance of sensitivity analysis. Copyright Royal Economic Society 2007

Suggested Citation

  • Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
  • Handle: RePEc:ect:emjrnl:v:10:y:2007:i:1:p:166-192
    as

    Download full text from publisher

    File URL: http://www.blackwell-synergy.com/doi/abs/10.1111/j.1368-423X.2007.00204.x
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrews, Donald W. K., 1998. "Hypothesis testing with a restricted parameter space," Journal of Econometrics, Elsevier, vol. 84(1), pages 155-199, May.
    2. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    3. Karim M. Abadir & Jan R. Magnus, 2002. "Notation in econometrics: a proposal for a standard," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 76-90, June.
    4. Ruud, Paul A., 2000. "An Introduction to Classical Econometric Theory," OUP Catalogue, Oxford University Press, number 9780195111644.
    5. Banerjee, Anurag N. & Magnus, Jan R., 2000. "On the sensitivity of the usual t- and F-tests to covariance misspecification," Journal of Econometrics, Elsevier, vol. 95(1), pages 157-176, March.
    6. Heijmans, R.D.H. & Magnus, J.R., 1986. "On the first-order efficiency and asymptotic normality of maximum likelihood estimators obtained from dependent observations," Other publications TiSEM b2fc9176-e950-4580-90e6-5, Tilburg University, School of Economics and Management.
    7. Magnus, Jan R., 1978. "Maximum likelihood estimation of the GLS model with unknown parameters in the disturbance covariance matrix," Journal of Econometrics, Elsevier, vol. 7(3), pages 281-312, April.
    8. Banerjee, Anurag N. & Magnus, Jan R., 1999. "The sensitivity of OLS when the variance matrix is (partially) unknown," Journal of Econometrics, Elsevier, vol. 92(2), pages 295-323, October.
    9. Shi, Lei & Wang, Xueren, 1999. "Local influence in ridge regression," Computational Statistics & Data Analysis, Elsevier, vol. 31(3), pages 341-353, September.
    10. Geert Verbeke & Geert Molenberghs & Herbert Thijs & Emmanuel Lesaffre & Michael G. Kenward, 2001. "Sensitivity Analysis for Nonrandom Dropout: A Local Influence Approach," Biometrics, The International Biometric Society, vol. 57(1), pages 7-14, March.
    11. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    12. Magnus, J.R., 1978. "Maximum likelihood estimation of the GLS model with unknown parameters in the disturbance covariance matrix," Other publications TiSEM 388c2c25-0925-4b56-834a-7, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Shuangzhe & Ma, Tiefeng & Polasek, Wolfgang, 2014. "Spatial system estimators for panel models: A sensitivity and simulation study," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 101(C), pages 78-102.
    2. Zhang, Xinyu & Chen, Ti & Wan, Alan T.K. & Zou, Guohua, 2009. "Robustness of Stein-type estimators under a non-scalar error covariance structure," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2376-2388, November.
    3. Qin, Huaizhen & Wan, Alan T.K. & Zou, Guohua, 2009. "On the sensitivity of the one-sided t test to covariance misspecification," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1593-1609, September.
    4. Giuseppe De Luca & Jan R. Magnus & Franco Peracchi, 2015. "On the ambiguous consequences of omitting variables," EIEF Working Papers Series 1505, Einaudi Institute for Economics and Finance (EIEF), revised May 2015.
    5. Hashimoto, Elizabeth M. & Ortega, Edwin M.M. & Cancho, Vicente G. & Cordeiro, Gauss M., 2010. "The log-exponentiated Weibull regression model for interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 1017-1035, April.
    6. Carrasco, Jalmar M.F. & Ortega, Edwin M.M. & Paula, Gilberto A., 2008. "Log-modified Weibull regression models with censored data: Sensitivity and residual analysis," Computational Statistics & Data Analysis, Elsevier, vol. 52(8), pages 4021-4039, April.
    7. Vasnev, Andrey L., 2010. "Sensitivity of GLS estimators in random effects models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1252-1262, May.
    8. Cibele Russo & Reiko Aoki & Gilberto Paula, 2012. "Assessment of variance components in nonlinear mixed-effects elliptical models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(3), pages 519-545, September.
    9. Eric Manes, 2009. "Pakistan's Investment Climate : Laying the Foundation for Growth, Volume 2. Annexes," World Bank Other Operational Studies 12411, The World Bank.
    10. Mayston, David, 2009. "The determinants of cumulative endogeneity bias in multivariate analysis," Journal of Multivariate Analysis, Elsevier, vol. 100(6), pages 1120-1136, July.
    11. Magnus, Jan R. & Vasnev, Andrey L., 2015. "Interpretation and use of sensitivity in econometrics, illustrated with forecast combinations," International Journal of Forecasting, Elsevier, vol. 31(3), pages 769-781.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ect:emjrnl:v:10:y:2007:i:1:p:166-192. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://edirc.repec.org/data/resssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.