IDEAS home Printed from https://ideas.repec.org/p/ucr/wpaper/202313.html
   My bibliography  Save this paper

The Second-order Bias and Mean Squared Error of Quantile Regression Estimators

Author

Listed:
  • Tae-Hwy Lee

    (Department of Economics, University of California Riverside)

  • Aman Ullah

    (Department of Economics, University of California, Riverside)

  • He Wang

    (University of International Business and Economics, Beijing)

Abstract

The finite sample theory using higher order asymptotics provides better approximations of the bias and mean squared error (MSE) for a class of estimators. Rilston, Srivastava and Ullah (1996) provided the second-order bias results of conditional mean regression. This paper develops new analytical results on the second-order bias up to order O(N⠻¹) and MSE up to order O(N⠻²) of the conditional quantile regression estimators. First, we provide the general results on the second-order bias and MSE of conditional quantile estimators. The second-order bias result enables an improved bias correction and thus to obtain improved quantile estimation. In particular, we show that the second-order bias are much larger towards the tails of the conditional density than near the median, and therefore the benefit of the second order bias correction is greater when we are interested in the deeper tail quantiles, e.g., for the study of financial risk management. The higher order MSE result for the quantile estimation also enables us to better understand the sources of estimation uncertainty. Next, we consider three special cases of the general results, for the unconditional quantile estimation, for the conditional quantile regression with a binary covariate, and for the instrumental variable quantile regression (IVQR). For each of these special cases, we provide the second-order bias and MSE to illustrate their behavior which depends on certain parameters and distributional characteristics. The Monte Carlo simulation indicates that the bias is larger at the extreme low and high tail quantiles, and the second-order bias corrected estimator has better behavior than the uncorrected ones in both conditional and unconditional quantile estimation. The second-order bias corrected estimators are numerically much closer to the true parameters of the data generating processes. As the higher order bias and MSE decrease as the sample size increases or as the regression error variance decreases, the benefits of the finite sample theory are more apparent when there are larger sampling errors in estimation. The empirical application of the theory to the predictive quantile regression model in finance highlights the benefit of the proposed second-order bias reduction.

Suggested Citation

  • Tae-Hwy Lee & Aman Ullah & He Wang, 2023. "The Second-order Bias and Mean Squared Error of Quantile Regression Estimators," Working Papers 202313, University of California at Riverside, Department of Economics.
  • Handle: RePEc:ucr:wpaper:202313
    as

    Download full text from publisher

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/202313.pdf
    File Function: First version, 2023
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Komunjer, Ivana, 2005. "Quasi-maximum likelihood estimation for conditional quantiles," Journal of Econometrics, Elsevier, vol. 128(1), pages 137-164, September.
    2. Rilstone, Paul & Srivastava, V. K. & Ullah, Aman, 1996. "The second-order bias and mean squared error of nonlinear estimators," Journal of Econometrics, Elsevier, vol. 75(2), pages 369-395, December.
    3. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    4. Joel L. Horowitz, 1998. "Bootstrap Methods for Median Regression Models," Econometrica, Econometric Society, vol. 66(6), pages 1327-1352, November.
    5. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    6. Kaplan, David M. & Sun, Yixiao, 2017. "Smoothed Estimating Equations For Instrumental Variables Quantile Regression," Econometric Theory, Cambridge University Press, vol. 33(1), pages 105-157, February.
    7. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    8. Marcelo Fernandes & Emmanuel Guerre & Eduardo Horta, 2021. "Smoothing Quantile Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 338-357, January.
    9. Bao, Yong & Ullah, Aman, 2007. "The second-order bias and mean squared error of estimators in time-series models," Journal of Econometrics, Elsevier, vol. 140(2), pages 650-669, October.
    10. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    11. Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, September.
    12. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    13. Whang, Yoon-Jae, 2006. "Smoothed Empirical Likelihood Methods For Quantile Regression Models," Econometric Theory, Cambridge University Press, vol. 22(2), pages 173-205, April.
    14. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    15. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    16. Phillips, Peter C B, 1977. "A General Theorem in the Theory of Asymptotic Expansions as Approximations to the Finite Sample Distributions of Econometric Estimators," Econometrica, Econometric Society, vol. 45(6), pages 1517-1534, September.
    17. Phillips, P.C.B., 1991. "A Shortcut to LAD Estimator Asymptotics," Econometric Theory, Cambridge University Press, vol. 7(4), pages 450-463, December.
    18. Otsu, Taisuke, 2008. "Conditional empirical likelihood estimation and inference for quantile regression models," Journal of Econometrics, Elsevier, vol. 142(1), pages 508-538, January.
    19. Pollard, David, 1985. "New Ways to Prove Central Limit Theorems," Econometric Theory, Cambridge University Press, vol. 1(3), pages 295-313, December.
    20. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    2. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    3. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    4. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    5. Marcelo Fernandes & Emmanuel Guerre & Eduardo Horta, 2021. "Smoothing Quantile Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 338-357, January.
    6. Grigory Franguridi & Bulat Gafarov & Kaspar Wüthrich, 2021. "Conditional Quantile Estimators: A Small Sample Theory," CESifo Working Paper Series 9046, CESifo.
    7. Lee, Tae-Hwy & Ullah, Aman & Wang, He, 2018. "The second-order bias of quantile estimators," Economics Letters, Elsevier, vol. 173(C), pages 143-147.
    8. Kaplan, David M. & Sun, Yixiao, 2017. "Smoothed Estimating Equations For Instrumental Variables Quantile Regression," Econometric Theory, Cambridge University Press, vol. 33(1), pages 105-157, February.
    9. Bruins, Marianne & Duffy, James A. & Keane, Michael P. & Smith, Anthony A., 2018. "Generalized indirect inference for discrete choice models," Journal of Econometrics, Elsevier, vol. 205(1), pages 177-203.
    10. Dennis Kristensen & Bernard Salanié, 2010. "Higher Order Improvements for Approximate Estimators," CAM Working Papers 2010-04, University of Copenhagen. Department of Economics. Centre for Applied Microeconometrics.
    11. Philip Kostov, 2013. "Empirical likelihood estimation of the spatial quantile regression," Journal of Geographical Systems, Springer, vol. 15(1), pages 51-69, January.
    12. Otsu, Taisuke, 2008. "Conditional empirical likelihood estimation and inference for quantile regression models," Journal of Econometrics, Elsevier, vol. 142(1), pages 508-538, January.
    13. Komunjer, Ivana, 2005. "Quasi-maximum likelihood estimation for conditional quantiles," Journal of Econometrics, Elsevier, vol. 128(1), pages 137-164, September.
    14. Victor Chernozhukov & Christian Hansen & Kaspar Wuthrich, 2020. "Instrumental Variable Quantile Regression," Papers 2009.00436, arXiv.org.
    15. de Castro, Luciano & Galvao, Antonio F. & Montes-Rojas, Gabriel, 2020. "Quantile selection in non-linear GMM quantile models," Economics Letters, Elsevier, vol. 195(C).
    16. Escanciano, Juan Carlos & Velasco, Carlos, 2010. "Specification tests of parametric dynamic conditional quantiles," Journal of Econometrics, Elsevier, vol. 159(1), pages 209-221, November.
    17. Grigory Franguridi & Bulat Gafarov & Kaspar Wuthrich, 2020. "Bias correction for quantile regression estimators," Papers 2011.03073, arXiv.org, revised Jan 2024.
    18. repec:hal:journl:peer-00732534 is not listed on IDEAS
    19. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    20. Fan, Yanqin & Liu, Ruixuan, 2016. "A direct approach to inference in nonparametric and semiparametric quantile models," Journal of Econometrics, Elsevier, vol. 191(1), pages 196-216.
    21. Sungwon Lee & Joon H. Ro, 2020. "Nonparametric Tests for Conditional Quantile Independence with Duration Outcomes," Working Papers 2013, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy).

    More about this item

    Keywords

    Check-loss; Dirac delta function; Quantile regression; Second-order bias; MSE.;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucr:wpaper:202313. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelvin Mac (email available below). General contact details of provider: https://edirc.repec.org/data/deucrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.