IDEAS home Printed from https://ideas.repec.org/a/ect/emjrnl/v10y2007i1p166-192.html

Local sensitivity and diagnostic tests

Author

Listed:
  • Jan R. Magnus
  • Andrey L. Vasnev

Abstract

In this paper, we confront sensitivity analysis with diagnostic testing. Every model is misspecified (in the sense that no model coincides with the data-generating process), but a model is useful if the parameters of interest (the focus) are not sensitive to small perturbations in the underlying assumptions. The study of the effect of these violations on the focus is called sensitivity analysis. Diagnostic testing, on the other hand, attempts to find out whether a nuisance parameter is (statistically) "large" or "small". Both aspects are important, but traditional applied econometrics tends to use only diagnostics and forget about sensitivity analysis. We develop a theory of sensitivity in a maximum likelihood framework, give conditions under which the diagnostic and the sensitivity are asymptotically independent, and demonstrate with three core examples that this independence is the rule rather than the exception, thus underlying the importance of sensitivity analysis. Copyright Royal Economic Society 2007

Suggested Citation

  • Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
  • Handle: RePEc:ect:emjrnl:v:10:y:2007:i:1:p:166-192
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a
    for a similarly titled item that would be available.

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Xinyu & Chen, Ti & Wan, Alan T.K. & Zou, Guohua, 2009. "Robustness of Stein-type estimators under a non-scalar error covariance structure," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2376-2388, November.
    2. Giuseppe De Luca & Jan R. Magnus & Franco Peracchi, 2018. "Balanced Variable Addition In Linear Models," Journal of Economic Surveys, Wiley Blackwell, vol. 32(4), pages 1183-1200, September.
    3. Hashimoto, Elizabeth M. & Ortega, Edwin M.M. & Cancho, Vicente G. & Cordeiro, Gauss M., 2010. "The log-exponentiated Weibull regression model for interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 54(4), pages 1017-1035, April.
    4. Carrasco, Jalmar M.F. & Ortega, Edwin M.M. & Paula, Gilberto A., 2008. "Log-modified Weibull regression models with censored data: Sensitivity and residual analysis," Computational Statistics & Data Analysis, Elsevier, vol. 52(8), pages 4021-4039, April.
    5. Eric Manes, 2009. "Pakistan's Investment Climate : Laying the Foundation for Growth, Volume 2. Annexes," World Bank Publications - Reports 12411, The World Bank Group.
    6. Mayston, David, 2009. "The determinants of cumulative endogeneity bias in multivariate analysis," Journal of Multivariate Analysis, Elsevier, vol. 100(6), pages 1120-1136, July.
    7. Liu, Shuangzhe & Leiva, Víctor & Zhuang, Dan & Ma, Tiefeng & Figueroa-Zúñiga, Jorge I., 2022. "Matrix differential calculus with applications in the multivariate linear model and its diagnostics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    8. Magnus, Jan R. & Vasnev, Andrey L., 2015. "Interpretation and use of sensitivity in econometrics, illustrated with forecast combinations," International Journal of Forecasting, Elsevier, vol. 31(3), pages 769-781.
    9. Qin, Huaizhen & Wan, Alan T.K. & Zou, Guohua, 2009. "On the sensitivity of the one-sided t test to covariance misspecification," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1593-1609, September.
    10. Giuseppe De Luca & Jan R. Magnus & Franco Peracchi, 2015. "On the ambiguous consequences of omitting variables," EIEF Working Papers Series 1505, Einaudi Institute for Economics and Finance (EIEF), revised May 2015.
    11. Liu, Shuangzhe & Ma, Tiefeng & Polasek, Wolfgang, 2014. "Spatial system estimators for panel models: A sensitivity and simulation study," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 101(C), pages 78-102.
    12. Vasnev, Andrey L., 2010. "Sensitivity of GLS estimators in random effects models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1252-1262, May.
    13. Cibele Russo & Reiko Aoki & Gilberto Paula, 2012. "Assessment of variance components in nonlinear mixed-effects elliptical models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(3), pages 519-545, September.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ect:emjrnl:v:10:y:2007:i:1:p:166-192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: https://edirc.repec.org/data/resssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.