IDEAS home Printed from https://ideas.repec.org/p/bbk/bbkcam/1707.html
   My bibliography  Save this paper

Posterior Means and Precisions of the Coefficients in Linear Models with Highly Collinear Regressors

Author

Listed:
  • M Hashem Pesaran

    (University of Southern California
    Trinity College, Cambridge)

  • Ron P Smith

    (Birkbeck, University of London)

Abstract

When there is exact collinearity between regressors, their individual coefficients are not identified, but given an informative prior their Bayesian posterior means are well defined. The case of high but not exact collinearity is more complicated but similar results follow. Just as exact collinearity causes non-identification of the parameters, high collinearity can be viewed as weak identification of the parameters, which we represent, in line with the weak instrument literature, by the correlation matrix being of full rank for a finite sample size T, but converging to a rank deficient matrix as T goes to infinity. This paper examines the asymptotic behaviour of the posterior mean and precision of the parameters of a linear regression model for both the cases of exactly and highly collinear regressors. We show that in both cases the posterior mean remains sensitive to the choice of prior means even if the sample size is sufficiently large, and that the precision rises at a slower rate than the sample size. In the highly collinear case, the posterior means converge to normally distributed random variables whose mean and variance depend on the priors for coefficients and precision. The distribution degenerates to fixed points for either exact collinearity or strong identification. The analysis also suggests a diagnostic statistic for the highly collinear case, which is illustrated with an empirical example.

Suggested Citation

  • M Hashem Pesaran & Ron P Smith, 2017. "Posterior Means and Precisions of the Coefficients in Linear Models with Highly Collinear Regressors," BCAM Working Papers 1707, Birkbeck Centre for Applied Macroeconomics.
  • Handle: RePEc:bbk:bbkcam:1707
    as

    Download full text from publisher

    File URL: http://www.bbk.ac.uk/ems/research/BirkCAM/working-papers/BCAM1707.pdf
    File Function: First version, 2017
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Spanos, Aris & McGuirk, Anya, 2002. "The problem of near-multicollinearity revisited: erratic vs systematic volatility," Journal of Econometrics, Elsevier, vol. 108(2), pages 365-393, June.
    2. Sanderson, Eleanor & Windmeijer, Frank, 2016. "A weak instrument F-test in linear IV models with multiple endogenous variables," Journal of Econometrics, Elsevier, vol. 190(2), pages 212-221.
    3. Pesaran, M. Hashem, 2015. "Time Series and Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780198759980.
    4. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    5. Tingting Cheng & Jiti Gao & Peter CB Phillips, 2017. "Bayesian estimation based on summary statistics: Double asymptotics and practice," Monash Econometrics and Business Statistics Working Papers 4/17, Monash University, Department of Econometrics and Business Statistics.
    6. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    7. Nalan Basturk & Lennart Hoogerheide & Herman K. van Dijk, 2017. "Bayesian Analysis of Boundary and Near-Boundary Evidence in Econometric Models with Reduced Rank," Tinbergen Institute Discussion Papers 17-058/III, Tinbergen Institute.
    8. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    9. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(04), pages 483-509, August.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Bayesian identi?cation; multicollinear regressions; weakly identi?ed regression coefficients; highly collinear regressors.;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bbk:bbkcam:1707. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://www.ems.bbk.ac.uk/research/BirkCAM .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.