IDEAS home Printed from https://ideas.repec.org/p/siu/wpaper/11-2014.html
   My bibliography  Save this paper

Jackknife Model Averaging for Quantile Regressions

Author

Listed:
  • Xun Lu

    (Department of Finance, Hong Kong University of Science and Technology)

  • Liangjun Su

    (School of Economics, Singapore Management University, Singapore, 178903)

Abstract

In this paper we consider the problem of frequentist model averaging for quantile regression (QR) when all the M models under investigation are potentially misspecified and the number of parameters in some or all models is diverging with the sample size n. To allow for the dependence between the error terms and the regressors in the QR models, we propose a jackknife model averaging (JMA) estimator which selects the weights by minimizing a leave-one-out cross-validation criterion function and demonstrate that the jackknife selected weight vector is asymptotically optimal in terms of minimizing the out-of-sample final prediction error among the given set of weight vectors. We conduct Monte Carlo simulations to demonstrate the finite-sample performance of the proposed JMA QR estimator and compare it with other model selection and averaging methods. We find that in terms of out-of-sample forecasting, the JMA QR estimator can achieve significant efficiency gains over the other methods, especially for extreme quantiles. We apply our JMA method to forecast quantiles of excess stock returns and wages.

Suggested Citation

  • Xun Lu & Liangjun Su, 2014. "Jackknife Model Averaging for Quantile Regressions," Working Papers 11-2014, Singapore Management University, School of Economics.
  • Handle: RePEc:siu:wpaper:11-2014
    as

    Download full text from publisher

    File URL: https://mercury.smu.edu.sg/rsrchpubupload/20336/10-2014.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Qi Gao & Jingping Gu & Paula Hernandez-Verme, 2012. "A Semiparametric Time Trend Varying Coefficients Model: With An Application to Evaluate Credit Rationing in U.S. Credit Market," Annals of Economics and Finance, Society for AEF, vol. 13(1), pages 189-210, May.
    2. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    3. Hanno N. Lustig & Stijn G. Van Nieuwerburgh, 2005. "Housing Collateral, Consumption Insurance, and Risk Premia: An Empirical Perspective," Journal of Finance, American Finance Association, vol. 60(3), pages 1167-1219, June.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    5. Ait-Sahalia, Yacine & Duarte, Jefferson, 2003. "Nonparametric option pricing under shape restrictions," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 9-47.
    6. Hansen, Bruce E., 2010. "Averaging estimators for autoregressions with a near unit root," Journal of Econometrics, Elsevier, vol. 158(1), pages 142-155, September.
    7. Andrews, Donald W. K., 1991. "Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 47(2-3), pages 359-377, February.
    8. Racine, Jeffrey & Su, Liangjun & Ullah, Aman, 2014. "The Oxford Handbook of Applied Nonparametric and Semiparametric Econometrics and Statistics," OUP Catalogue, Oxford University Press, number 9780199857944, Decembrie.
    9. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    10. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    11. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    12. Cai, Zongwu & Fan, Jianqing & Yao, Qiwei, 2000. "Functional-coefficient regression models for nonlinear time series," LSE Research Online Documents on Economics 6314, London School of Economics and Political Science, LSE Library.
    13. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    14. Stefan Nagel & Kenneth J. Singleton, 2011. "Estimation and Evaluation of Conditional Asset Pricing Models," Journal of Finance, American Finance Association, vol. 66(3), pages 873-909, June.
    15. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    16. Roussanov, Nikolai, 2014. "Composition of wealth, conditioning information, and the cross-section of stock returns," Journal of Financial Economics, Elsevier, vol. 111(2), pages 352-380.
    17. Xiangdong Long & Liangjun Su & Aman Ullah, 2011. "Estimation and Forecasting of Dynamic Conditional Covariance: A Semiparametric Multivariate Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 109-125, January.
    18. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    19. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521608275.
    20. Li, Yan & Yang, Liyan, 2011. "Testing conditional factor models: A nonparametric approach," Journal of Empirical Finance, Elsevier, vol. 18(5), pages 972-992.
    21. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    22. Dybvig, Philip H & Ross, Stephen A, 1985. "The Analytics of Performance Measurement Using a Security Market Line," Journal of Finance, American Finance Association, vol. 40(2), pages 401-416, June.
    23. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    24. Ross, Stephen A, 1977. "The Capital Asset Pricing Model (CAPM), Short-Sale Restrictions and Related Issues," Journal of Finance, American Finance Association, vol. 32(1), pages 177-183, March.
    25. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    26. Liangjun Su & Irina Murtazashvili & Aman Ullah, 2013. "Local Linear GMM Estimation of Functional Coefficient IV Models With an Application to Estimating the Rate of Return to Schooling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 184-207, April.
    27. Su, Liangjun & Ullah, Aman, 2013. "A Nonparametric Goodness-Of-Fit-Based Test For Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 29(1), pages 187-212, February.
    28. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, August.
    29. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    30. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    31. Cochrane, John H, 1996. "A Cross-Sectional Test of an Investment-Based Asset Pricing Model," Journal of Political Economy, University of Chicago Press, vol. 104(3), pages 572-621, June.
    32. Pötscher, Benedikt M., 2006. "The Distribution of Model Averaging Estimators and an Impossibility Result Regarding Its Estimation," MPRA Paper 73, University Library of Munich, Germany, revised Jul 2006.
    33. Ang, Andrew & Kristensen, Dennis, 2012. "Testing conditional factor models," Journal of Financial Economics, Elsevier, vol. 106(1), pages 132-156.
    34. Park, Byeong U. & Mammen, Enno & Härdle, Wolfgang & Borak, Szymon, 2009. "Time Series Modelling With Semiparametric Factor Dynamics," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 284-298.
    35. Tong, Howell & Yao, Qiwei, 1998. "Cross-validatory bandwidth selection for regression estimation based on dependent data," LSE Research Online Documents on Economics 6380, London School of Economics and Political Science, LSE Library.
    36. Hansen, Bruce E., 2000. "Testing for structural change in conditional models," Journal of Econometrics, Elsevier, vol. 97(1), pages 93-115, July.
    37. Clifford M. Hurvich & Jeffrey S. Simonoff & Chih‐Ling Tsai, 1998. "Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(2), pages 271-293.
    38. Michael C. Jensen, 1968. "The Performance Of Mutual Funds In The Period 1945–1964," Journal of Finance, American Finance Association, vol. 23(2), pages 389-416, May.
    39. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037, Decembrie.
    40. Qingfeng Liu & Ryo Okui, 2013. "Heteroscedasticity‐robust C(p) model averaging," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 463-472, October.
    41. Fan, Yanqin & Ullah, Aman, 1999. "Asymptotic Normality of a Combined Regression Estimator," Journal of Multivariate Analysis, Elsevier, vol. 71(2), pages 191-240, November.
    42. Bollerslev, Tim & Engle, Robert F & Wooldridge, Jeffrey M, 1988. "A Capital Asset Pricing Model with Time-Varying Covariances," Journal of Political Economy, University of Chicago Press, vol. 96(1), pages 116-131, February.
    43. Bansal, Ravi & Viswanathan, S, 1993. "No Arbitrage and Arbitrage Pricing: A New Approach," Journal of Finance, American Finance Association, vol. 48(4), pages 1231-1262, September.
    44. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    45. Machado, José A.F., 1993. "Robust Model Selection and M-Estimation," Econometric Theory, Cambridge University Press, vol. 9(3), pages 478-493, June.
    46. Dybvig, Philip H & Ross, Stephen A, 1985. "Differential Information and Performance Measurement Using a Security Market Line," Journal of Finance, American Finance Association, vol. 40(2), pages 383-399, June.
    47. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    48. Martin Lettau & Sydney Ludvigson, 2001. "Resurrecting the (C)CAPM: A Cross-Sectional Test When Risk Premia Are Time-Varying," Journal of Political Economy, University of Chicago Press, vol. 109(6), pages 1238-1287, December.
    49. Szymon Borak & Rafał Weron, 2008. "A semiparametric factor model for electricity forward curve dynamics," SFB 649 Discussion Papers SFB649DP2008-050, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    50. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    51. Mishra, Santosh & Su, Liangjun & Ullah, Aman, 2010. "Semiparametric Estimator of Time Series Conditional Variance," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 256-274.
    52. Enrique Moral-Benito, 2015. "Model Averaging In Economics: An Overview," Journal of Economic Surveys, Wiley Blackwell, vol. 29(1), pages 46-75, February.
    53. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    54. Hurvich, Clifford M. & Tsai, Chih-Ling, 1990. "Model selection for least absolute deviations regression in small samples," Statistics & Probability Letters, Elsevier, vol. 9(3), pages 259-265, March.
    55. Guido Kuersteiner & Ryo Okui, 2010. "Constructing Optimal Instruments by First-Stage Prediction Averaging," Econometrica, Econometric Society, vol. 78(2), pages 697-718, March.
    56. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    57. Eric Ghysels, 1998. "On Stable Factor Structures in the Pricing of Risk: Do Time-Varying Betas Help or Hurt?," Journal of Finance, American Finance Association, vol. 53(2), pages 549-573, April.
    58. Jianhua Z. Huang & Haipeng Shen, 2004. "Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 515-534, December.
    59. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    60. Hwang, Eunju & Shin, Dong Wan, 2012. "Stationary bootstrap for kernel density estimators under ψ-weak dependence," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1581-1593.
    61. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    62. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    63. Ferson, Wayne E & Korajczyk, Robert A, 1995. "Do Arbitrage Pricing Models Explain the Predictability of Stock Returns?," The Journal of Business, University of Chicago Press, vol. 68(3), pages 309-349, July.
    64. Shanken, Jay, 1990. "Intertemporal asset pricing : An Empirical Investigation," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 99-120.
    65. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    66. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    67. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    68. Hansen, Bruce E., 2009. "Averaging Estimators For Regressions With A Possible Structural Break," Econometric Theory, Cambridge University Press, vol. 25(6), pages 1498-1514, December.
    69. Kevin Q. Wang, 2003. "Asset Pricing with Conditioning Information: A New Test," Journal of Finance, American Finance Association, vol. 58(1), pages 161-196, February.
    70. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    71. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    72. Yacine Aït-Sahalia & Andrew W. Lo, 1998. "Nonparametric Estimation of State-Price Densities Implicit in Financial Asset Prices," Journal of Finance, American Finance Association, vol. 53(2), pages 499-547, April.
    73. Elias Masry, 1996. "Multivariate Local Polynomial Regression For Time Series:Uniform Strong Consistency And Rates," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(6), pages 571-599, November.
    74. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan Li & Liangjun Su & Yuewu Xu, 2015. "A Combined Approach to the Inference of Conditional Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 203-220, April.
    2. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    3. Roussanov, Nikolai, 2014. "Composition of wealth, conditioning information, and the cross-section of stock returns," Journal of Financial Economics, Elsevier, vol. 111(2), pages 352-380.
    4. Aman Ullah & Huansha Wang, 2013. "Parametric and Nonparametric Frequentist Model Selection and Model Averaging," Econometrics, MDPI, vol. 1(2), pages 1-23, September.
    5. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    6. Stefano Gubellini, 2014. "Conditioning information and cross-sectional anomalies," Review of Quantitative Finance and Accounting, Springer, vol. 43(3), pages 529-569, October.
    7. Li, Yan & Yang, Liyan, 2011. "Testing conditional factor models: A nonparametric approach," Journal of Empirical Finance, Elsevier, vol. 18(5), pages 972-992.
    8. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    9. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    10. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    11. Boguth, Oliver & Carlson, Murray & Fisher, Adlai & Simutin, Mikhail, 2011. "Conditional risk and performance evaluation: Volatility timing, overconditioning, and new estimates of momentum alphas," Journal of Financial Economics, Elsevier, vol. 102(2), pages 363-389.
    12. Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
    13. Zongwu Cai & Yongmiao Hong, 2013. "Some Recent Developments in Nonparametric Finance," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    14. Qingfeng Liu & Ryo Okui & Arihiro Yoshimura, 2016. "Generalized Least Squares Model Averaging," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1692-1752, December.
    15. Aman Ullah & Alan T. K. Wan & Huansha Wang & Xinyu Zhang & Guohua Zou, 2017. "A semiparametric generalized ridge estimator and link with model averaging," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 370-384, March.
    16. Ang, Andrew & Kristensen, Dennis, 2012. "Testing conditional factor models," Journal of Financial Economics, Elsevier, vol. 106(1), pages 132-156.
    17. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    18. Alena Skolkova, 2023. "Model Averaging with Ridge Regularization," CERGE-EI Working Papers wp758, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    19. Liu, Chu-An, 2012. "A plug-in averaging estimator for regressions with heteroskedastic errors," MPRA Paper 41414, University Library of Munich, Germany.
    20. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.

    More about this item

    Keywords

    Final prediction error; High dimensionality; Model averaging; Model selection; Misspecification; Quantile regression;
    All these keywords.

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:siu:wpaper:11-2014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: QL THor (email available below). General contact details of provider: https://edirc.repec.org/data/sesmusg.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.