IDEAS home Printed from https://ideas.repec.org/p/vic/vicewp/1701.html
   My bibliography  Save this paper

Model Averaging OLS and 2SLS: An Application of the WALS Procedure

Author

Abstract

More commonly, applied and theoretical researchers are examining model averaging as a tool when considering estimation of regression models. Weighted-average least squares (WALS), originally proposed by Magnus and Durbin (1999, Econometrica) within the framework of estimating some of the parameters of a linear regression model when other coefficients are of no interest, is one such model averaging method with their proposed approach being a Bayesian combination of frequentist ordinary least squares and restricted least squares estimators. We generalize their work, along with that of other researchers, to consider averaging ordinary least squares (OLS) and two stage least squares (2SLS) estimators when possibly one or more regressors are endogenous. We derive asymptotic properties of our weighted OLS and 2SLS estimator under a local misspecification framework, showing that results from the existing WALS literature apply equally well to our case. In particular, determining the optimal weight function reduces to the problem of estimating the mean of a normally distributed random variate, which is unrelated to the details specific to the regression model of interest, including the extent of correlation between the explanatory variable(s) and the error term. We illustrate our findings with two examples. The first example, from a commonly adopted econometrics textbook, considers returns to schooling, and the second case is a growth regression application, which examines whether religion assists in explaining disparities in cross-country economic growth.

Suggested Citation

  • Judith Anne Clarke, 2017. "Model Averaging OLS and 2SLS: An Application of the WALS Procedure," Econometrics Working Papers 1701, Department of Economics, University of Victoria.
  • Handle: RePEc:vic:vicewp:1701
    Note: ISSN 1485-6441
    as

    Download full text from publisher

    File URL: https://www.uvic.ca/socialsciences/economics/_assets/docs/econometrics/EWP1701.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Einmahl, J.H.J. & Magnus, J.R. & Kumar, K., 2011. "On the Choice of Prior in Bayesian Model Averaging," Discussion Paper 2011-003, Tilburg University, Center for Economic Research.
    2. Magnus, J.R. & Powell, O.R. & Prüfer, P., 2008. "A Comparison of Two Averaging Techniques with an Application to Growth Empirics," Other publications TiSEM 0392dffa-51e0-4bc9-9644-f, Tilburg University, School of Economics and Management.
    3. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    4. Clarke, Judith A., 2008. "On weighted estimation in linear regression in the presence of parameter uncertainty," Economics Letters, Elsevier, vol. 100(1), pages 1-3, July.
    5. Jan R. Magnus & Wendun Wang, 2014. "Concept-Based Bayesian Model Averaging and Growth Empirics," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(6), pages 874-897, December.
    6. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2012. "Is God in the details? A reexamination of the role of religion in economic growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1059-1075, November.
    7. Kim T-H. & White H., 2001. "James-Stein-Type Estimators in Large Samples With Application to the Least Absolute Deviations Estimator," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 697-705, June.
    8. Jan R. Magnus & Giuseppe De Luca, 2016. "Weighted-Average Least Squares (Wals): A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 30(1), pages 117-148, February.
    9. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, September.
    10. Karen Poghosyan & Jan R. Magnus, 2012. "WALS Estimation and Forecasting in Factor-based Dynamic Models with an Application to Armenia," International Econometric Review (IER), Econometric Research Association, vol. 4(1), pages 40-58, April.
    11. Wu, De-Min, 1973. "Alternative Tests of Independence Between Stochastic Regressors and Disturbances," Econometrica, Econometric Society, vol. 41(4), pages 733-750, July.
    12. Richardson, David H & Wu, De-Min, 1971. "A Note on the Comparison of Ordinary and Two-Stage Least Squares Estimators," Econometrica, Econometric Society, vol. 39(6), pages 973-981, November.
    13. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2008. "Are Any Growth Theories Robust?," Economic Journal, Royal Economic Society, vol. 118(527), pages 329-346, March.
    14. Dmitry Danilov, 2005. "Estimation of the mean of a univariate normal distribution when the variance is not known," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 277-291, December.
    15. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    16. De Luca, Giuseppe & Magnus, Jan R. & Peracchi, Franco, 2018. "Weighted-average least squares estimation of generalized linear models," Journal of Econometrics, Elsevier, vol. 204(1), pages 1-17.
    17. Giles, Judith A & Giles, David E A, 1993. "Pre-test Estimation and Testing in Econometrics: Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 7(2), pages 145-197, June.
    18. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    19. Gourieroux, C. & Trognon, A., 1984. "Specification pre-test estimator," Journal of Econometrics, Elsevier, vol. 25(1-2), pages 15-27.
    20. Christopher F Baum & Mark E. Schaffer & Steven Stillman, 2003. "Instrumental variables and GMM: Estimation and testing," Stata Journal, StataCorp LP, vol. 3(1), pages 1-31, March.
    21. Adrian Mander, 2012. "INTEGRATE: Stata module to perform one-dimensional integration," Statistical Software Components S457429, Boston College Department of Economics, revised 10 Aug 2018.
    22. Magnus, Jan R. & Wan, Alan T.K. & Zhang, Xinyu, 2011. "Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1331-1341, March.
    23. Nakamura, Alice & Nakamura, Masao, 1981. "On the Relationships among Several Specification Error Tests Presented by Durbin, Wu, and Hausman," Econometrica, Econometric Society, vol. 49(6), pages 1583-1588, November.
    24. Giuseppe De Luca & Jan R. Magnus, 2011. "Bayesian model averaging and weighted-average least squares: Equivariance, stability, and numerical issues," Stata Journal, StataCorp LP, vol. 11(4), pages 518-544, December.
    25. Enrique Moral-Benito, 2015. "Model Averaging In Economics: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 46-75, February.
    26. McCleary, Rachel & Barro, Robert, 2003. "Religion and Economic Growth across Countries," Scholarly Articles 3708464, Harvard University Department of Economics.
    27. Alex Lenkoski & Theo S. Eicher & Adrian E. Raftery, 2014. "Two-Stage Bayesian Model Averaging in Endogenous Variable Models," Econometric Reviews, Taylor & Francis Journals, vol. 33(1-4), pages 122-151, June.
    28. Robert J. Barro & Rachel McCleary, 2003. "Religion and Economic Growth," NBER Working Papers 9682, National Bureau of Economic Research, Inc.
    29. Morey, M.J., 1984. "The statistical implications of preliminary specification error testing," Journal of Econometrics, Elsevier, vol. 25(1-2), pages 63-72.
    30. Jan R. Magnus & J. Durbin, 1999. "Estimation of Regression Coefficients of Interest When Other Regression Coefficients Are of No Interest," Econometrica, Econometric Society, vol. 67(3), pages 639-644, May.
    31. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    32. Jan R. Magnus, 2002. "Estimation of the mean of a univariate normal distribution with known variance," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 225-236, June.
    33. Zou, Guohua & Wan, Alan T.K. & Wu, Xiaoyong & Chen, Ti, 2007. "Estimation of regression coefficients of interest when other regression coefficients are of no interest: The case of non-normal errors," Statistics & Probability Letters, Elsevier, vol. 77(8), pages 803-810, April.
    34. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    35. Danilov, Dmitry & Magnus, J.R.Jan R., 2004. "On the harm that ignoring pretesting can cause," Journal of Econometrics, Elsevier, vol. 122(1), pages 27-46, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    2. De Luca, Giuseppe & Magnus, Jan R. & Peracchi, Franco, 2018. "Weighted-average least squares estimation of generalized linear models," Journal of Econometrics, Elsevier, vol. 204(1), pages 1-17.
    3. De Luca, Giuseppe & Magnus, Jan R. & Peracchi, Franco, 2022. "Sampling properties of the Bayesian posterior mean with an application to WALS estimation," Journal of Econometrics, Elsevier, vol. 230(2), pages 299-317.
    4. Jan R. Magnus & Wendun Wang & Xinyu Zhang, 2016. "Weighted-Average Least Squares Prediction," Econometric Reviews, Taylor & Francis Journals, vol. 35(6), pages 1040-1074, June.
    5. Giuseppe Luca & Jan R. Magnus & Franco Peracchi, 2023. "Weighted-Average Least Squares (WALS): Confidence and Prediction Intervals," Computational Economics, Springer;Society for Computational Economics, vol. 61(4), pages 1637-1664, April.
    6. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    7. Michael Berger & Markus Pock & Miriam Reiss & Gerald Röhrling & Thomas Czypionka, 2023. "Exploring the effectiveness of demand-side retail pharmaceutical expenditure reforms," International Journal of Health Economics and Management, Springer, vol. 23(1), pages 149-172, March.
    8. Giuseppe De Luca & Jan R. Magnus, 2011. "Bayesian model averaging and weighted-average least squares: Equivariance, stability, and numerical issues," Stata Journal, StataCorp LP, vol. 11(4), pages 518-544, December.
    9. Valentino Dardanoni & Giuseppe De Luca & Salvatore Modica & Franco Peracchi, 2012. "A generalized missing-indicator approach to regression with imputed covariates," Stata Journal, StataCorp LP, vol. 12(4), pages 575-604, December.
    10. Giuseppe De Luca & Jan Magnus & Franco Peracchi, 2022. "Asymptotic properties of the weighted average least squares (WALS) estimator," Tinbergen Institute Discussion Papers 22-022/III, Tinbergen Institute.
    11. Clarke, Judith A., 2008. "On weighted estimation in linear regression in the presence of parameter uncertainty," Economics Letters, Elsevier, vol. 100(1), pages 1-3, July.
    12. Moral-Benito, Enrique, 2010. "Model averaging in economics," MPRA Paper 26047, University Library of Munich, Germany.
    13. Berger, Michael & Pock, Markus & Reiss, Miriam & Röhrling, Gerald & Czypionka, Thomas, 2023. "Exploring the effectiveness of demand-side retail pharmaceutical expenditure reforms: cross-country evidence from weighted-average least squares estimation," LSE Research Online Documents on Economics 116928, London School of Economics and Political Science, LSE Library.
    14. Poghosyan, K., 2012. "Structural and reduced-form modeling and forecasting with application to Armenia," Other publications TiSEM ad1a24c3-15e6-4f04-b338-3, Tilburg University, School of Economics and Management.
    15. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    16. Aedın Doris & Donal O’Neill & Olive Sweetman, 2011. "GMM estimation of the covariance structure of longitudinal data on earnings," Stata Journal, StataCorp LP, vol. 11(3), pages 439-459, September.
    17. Rockey, James & Temple, Jonathan, 2016. "Growth econometrics for agnostics and true believers," European Economic Review, Elsevier, vol. 81(C), pages 86-102.
    18. Enrique Moral-Benito, 2015. "Model Averaging In Economics: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 46-75, February.
    19. Aiyar, Shekhar & Duval, Romain & Puy, Damien & Wu, Yiqun & Zhang, Longmei, 2018. "Growth slowdowns and the middle-income trap," Japan and the World Economy, Elsevier, vol. 48(C), pages 22-37.
    20. Liu, Chu-An, 2012. "A plug-in averaging estimator for regressions with heteroskedastic errors," MPRA Paper 41414, University Library of Munich, Germany.

    More about this item

    Keywords

    Model averaging; least squares; two stage least squares; priors; instrumental variables.;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vic:vicewp:1701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kali Moon (email available below). General contact details of provider: https://edirc.repec.org/data/devicca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.