IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Distribution Theory of the Least Squares Averaging Estimator

  • Liu, Chu-An

This paper derives the limiting distributions of least squares averaging estimators for linear regression models in a local asymptotic framework. We show that the averaging estimators with fixed weights are asymptotically normal and then develop a plug-in averaging estimator that minimizes the sample analog of the asymptotic mean squared error. We investigate the focused information criterion (Claeskens and Hjort, 2003), the plug-in averaging estimator, the Mallows model averaging estimator (Hansen, 2007), and the jackknife model averaging estimator (Hansen and Racine, 2012). We find that the asymptotic distributions of averaging estimators with data-dependent weights are nonstandard and cannot be approximated by simulation. To address this issue, we propose a simple procedure to construct valid confidence intervals with improved coverage probability. Monte Carlo simulations show that the plug-in averaging estimator generally has smaller expected squared error than other existing model averaging methods, and the coverage probability of proposed confidence intervals achieves the nominal level. As an empirical illustration, the proposed methodology is applied to cross-country growth regressions.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: https://mpra.ub.uni-muenchen.de/54201/1/MPRA_paper_54201.pdf
File Function: original version
Download Restriction: no

Paper provided by University Library of Munich, Germany in its series MPRA Paper with number 54201.

as
in new window

Length:
Date of creation: 23 Oct 2013
Date of revision:
Handle: RePEc:pra:mprapa:54201
Contact details of provider: Postal:
Ludwigstraße 33, D-80539 Munich, Germany

Phone: +49-(0)89-2180-2459
Fax: +49-(0)89-2180-992459
Web page: https://mpra.ub.uni-muenchen.de

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Douglas Staiger & James H. Stock, 1994. "Instrumental Variables Regression with Weak Instruments," NBER Technical Working Papers 0151, National Bureau of Economic Research, Inc.
  2. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, November.
  3. Pötscher, B.M., 1991. "Effects of Model Selection on Inference," Econometric Theory, Cambridge University Press, vol. 7(02), pages 163-185, June.
  4. Peter R. Hansen & Asger Lunde & James M. Nason, 2010. "The Model Confidence Set," CREATES Research Papers 2010-76, Department of Economics and Business Economics, Aarhus University.
  5. Leeb, Hannes & P tscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(02), pages 338-376, April.
  6. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-38, May.
  7. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-58, May.
  8. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2007. "Are any Growth Theories Robust?," University of Cyprus Working Papers in Economics 2-2007, University of Cyprus Department of Economics.
  9. Raftery A.E. & Zheng Y., 2003. "Discussion: Performance of Bayesian Model Averaging," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 931-938, January.
  10. Durlauf,S.N. & Johnson,P.A. & Temple,J.R.W., 2004. "Growth econometrics," Working papers 18, Wisconsin Madison - Social Systems.
    • Durlauf, Steven N. & Johnson, Paul A. & Temple, Jonathan R.W., 2005. "Growth Econometrics," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 1, chapter 8, pages 555-677 Elsevier.
  11. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
  12. Carmen Fernandez & Eduardo Ley & Mark Steel, 1999. "Model uncertainty in cross-country growth regressions," Econometrics 9903003, EconWPA, revised 06 Oct 2001.
  13. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
  14. Enrique Moral-Benito, 2011. "Model averaging in economics," Working Papers 1123, Banco de España;Working Papers Homepage.
  15. Hansen, Bruce E., 2010. "Averaging estimators for autoregressions with a near unit root," Journal of Econometrics, Elsevier, vol. 158(1), pages 142-155, September.
  16. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
  17. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 38(2), pages 112-134.
  18. Hannes Leeb & Benedikt M. Poetscher, 2000. "The Finite-Sample Distribution of Post-Model-Selection Estimators, and Uniform Versus Non-Uniform Approximations," Econometrics 0004001, EconWPA.
  19. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
  20. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, 07.
  21. Jonathan Temple, 2005. "Dual economy models: a primer for growth economists," Bristol Economics Discussion Papers 05/574, Department of Economics, University of Bristol, UK.
  22. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
  23. Andrews, Donald W. K., 1991. "Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 359-377, February.
  24. Lu, Xun & White, Halbert, 2014. "Robustness checks and robustness tests in applied economics," Journal of Econometrics, Elsevier, vol. 178(P1), pages 194-206.
  25. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
  26. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
  27. Kabaila, Paul, 1995. "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, Cambridge University Press, vol. 11(03), pages 537-549, June.
  28. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
  29. Leeb, Hannes & Pötscher, Benedikt M., 2012. "Testing in the Presence of Nuisance Parameters: Some Comments on Tests Post-Model-Selection and Random Critical Values," MPRA Paper 41459, University Library of Munich, Germany.
  30. Kabaila, Paul, 1998. "Valid Confidence Intervals In Regression After Variable Selection," Econometric Theory, Cambridge University Press, vol. 14(04), pages 463-482, August.
  31. Pötscher, Benedikt M., 2006. "The Distribution of Model Averaging Estimators and an Impossibility Result Regarding Its Estimation," MPRA Paper 73, University Library of Munich, Germany, revised Jul 2006.
  32. Yang, Yuhong, 2000. "Combining Different Procedures for Adaptive Regression," Journal of Multivariate Analysis, Elsevier, vol. 74(1), pages 135-161, July.
  33. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
  34. Jonathan R. W. Temple, 2005. "Growth and Wage Inequality in a Dual Economy," Bulletin of Economic Research, Wiley Blackwell, vol. 57(2), pages 145-169, 04.
  35. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
  36. Leeb, Hannes & P tscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(01), pages 21-59, February.
  37. Hansen, Bruce E., 2009. "Averaging Estimators For Regressions With A Possible Structural Break," Econometric Theory, Cambridge University Press, vol. 25(06), pages 1498-1514, December.
  38. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2013. "Complete subset regressions," Journal of Econometrics, Elsevier, vol. 177(2), pages 357-373.
  39. Francis J. DiTraglia, 2011. "Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM," PIER Working Paper Archive 14-037, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 04 Aug 2014.
  40. Gerda Claeskens & Raymond J. Carroll, 2007. "An asymptotic theory for model selection inference in general semiparametric problems," Biometrika, Biometrika Trust, vol. 94(2), pages 249-265.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:54201. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.