IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v33y2025icp80-104.html
   My bibliography  Save this article

Testing the Predictive Ability of Possibly Persistent Variables under Asymmetric Loss

Author

Listed:
  • Demetrescu, Matei
  • Roling, Christoph

Abstract

Tests of no predictability under an asymmetric power loss function are considered. While this task does not pose difficulties for stationary predictors, non-standard limiting distributions may arise for standard inferential tools when the putative predictors are endogenous (i.e. there is contemporaneous dependence between the shocks of the regressor and of the dependent variable) and of high persistence (i.e. the predictor is reverting slowly to its long-run mean, if at all). It is argued that endogeneity should be interpreted in relation to the relevant loss-function; thus, no endogeneity under MSE loss does not imply, and is not implied by, lack of endogeneity under an asymmetric loss function. To deal with other loss functions than the MSE loss, an overidentified instrumental variable-based test is proposed. The test statistic uses an instrument of high persistence, yet exogenous, and a possibly endogenous one, yet less persistent. The statistic follows a limiting null chi-squared distribution irrespective of the actual degree of persistence of the predictor. The proposed methodology is applied with the forward premium puzzle by providing evidence that asymmetric losses are of empirical relevance and by subsequently conducting robust inference of the rational expectations hypothesis.

Suggested Citation

  • Demetrescu, Matei & Roling, Christoph, 2025. "Testing the Predictive Ability of Possibly Persistent Variables under Asymmetric Loss," Econometrics and Statistics, Elsevier, vol. 33(C), pages 80-104.
  • Handle: RePEc:eee:ecosta:v:33:y:2025:i:c:p:80-104
    DOI: 10.1016/j.ecosta.2021.09.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306221001118
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles

    File URL: https://libkey.io/10.1016/j.ecosta.2021.09.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Lewis, Karen K., 1995. "Puzzles in international financial markets," Handbook of International Economics, in: G. M. Grossman & K. Rogoff (ed.), Handbook of International Economics, edition 1, volume 3, chapter 37, pages 1913-1971, Elsevier.
    3. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    4. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    5. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037, Decembrie.
    6. Fritsche, Ulrich & Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2015. "Forecasting the Brazilian real and the Mexican peso: Asymmetric loss, forecast rationality, and forecaster herding," International Journal of Forecasting, Elsevier, vol. 31(1), pages 130-139.
    7. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    8. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    9. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    10. Michael Artis & Massimiliano Marcellino, 2001. "Fiscal forecasting: The track record of the IMF, OECD and EC," Econometrics Journal, Royal Economic Society, vol. 4(1), pages 20-36.
    11. Hansen, Bruce E., 1992. "Convergence to Stochastic Integrals for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 8(4), pages 489-500, December.
    12. Michael Frenkel & Jan-Christoph Rülke & Matthias Mauch, 2019. "Do foreign exchange forecasters apply asymmetric loss functions? Evidence from three major exchange rates," Applied Economics Letters, Taylor & Francis Journals, vol. 26(9), pages 731-735, May.
    13. Phillips, Peter C.B. & Lee, Ji Hyung, 2013. "Predictive regression under various degrees of persistence and robust long-horizon regression," Journal of Econometrics, Elsevier, vol. 177(2), pages 250-264.
    14. Peter C. B. Phillips, 2015. "Pitfalls and Possibilities in Predictive Regression," Cowles Foundation Discussion Papers 2003, Cowles Foundation for Research in Economics, Yale University.
    15. Elliott, Graham & Stock, James H., 1994. "Inference in Time Series Regression When the Order of Integration of a Regressor is Unknown," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 672-700, August.
    16. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    17. Lucas, André, 1995. "Unit Root Tests Based on M Estimators," Econometric Theory, Cambridge University Press, vol. 11(2), pages 331-346, February.
    18. Lee, Ji Hyung, 2016. "Predictive quantile regression with persistent covariates: IVX-QR approach," Journal of Econometrics, Elsevier, vol. 192(1), pages 105-118.
    19. Engel, Charles, 1996. "The forward discount anomaly and the risk premium: A survey of recent evidence," Journal of Empirical Finance, Elsevier, vol. 3(2), pages 123-192, June.
    20. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    21. Toda, Hiro Y. & Yamamoto, Taku, 1995. "Statistical inference in vector autoregressions with possibly integrated processes," Journal of Econometrics, Elsevier, vol. 66(1-2), pages 225-250.
    22. Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2012. "On the loss function of the Bank of Canada: A note," Economics Letters, Elsevier, vol. 115(2), pages 155-159.
    23. Liu, Wei & Maynard, Alex, 2005. "Testing forward rate unbiasedness allowing for persistent regressors," Journal of Empirical Finance, Elsevier, vol. 12(5), pages 613-628, December.
    24. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    25. Batchelor, Roy & Peel, David A., 1998. "Rationality testing under asymmetric loss," Economics Letters, Elsevier, vol. 61(1), pages 49-54, October.
    26. Marco Aiolfi & Marius Rodriguez & Allan Timmermann, 2010. "Understanding Analysts' Earnings Expectations: Biases, Nonlinearities, and Predictability," Journal of Financial Econometrics, Oxford University Press, vol. 8(3), pages 305-334, Summer.
    27. Christodoulakis, George & Mamatzakis, Emmanuel, 2013. "Behavioural asymmetries in the G7 foreign exchange market," International Review of Financial Analysis, Elsevier, vol. 29(C), pages 261-270.
    28. Campbell, Bryan & Dufour, Jean-Marie, 1995. "Exact Nonparametric Orthogonality and Random Walk Tests," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 1-16, February.
    29. Breitung, Jörg & Demetrescu, Matei, 2015. "Instrumental variable and variable addition based inference in predictive regressions," Journal of Econometrics, Elsevier, vol. 187(1), pages 358-375.
    30. Loukia Meligkotsidou & Ekaterini Panopoulou & Ioannis D. Vrontos & Spyridon D. Vrontos, 2014. "A Quantile Regression Approach to Equity Premium Prediction," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(7), pages 558-576, November.
    31. Ulrich K. Müller & Mark W. Watson, 2008. "Testing Models of Low-Frequency Variability," Econometrica, Econometric Society, vol. 76(5), pages 979-1016, September.
    32. Christian Pierdzioch & Jan-Christoph Rülke & Georg Stadtmann, 2012. "Exchange-rate forecasts and asymmetric loss: empirical evidence for the yen/dollar exchange rate," Applied Economics Letters, Taylor & Francis Journals, vol. 19(18), pages 1759-1763, December.
    33. Sin, C.Y. (Chor-yiu) & Lee, Cheng-Few, 2021. "Using heteroscedasticity-non-consistent or heteroscedasticity-consistent variances in linear regression," Econometrics and Statistics, Elsevier, vol. 18(C), pages 117-142.
    34. Mark A. Clatworthy & David A. Peel & Peter F. Pope, 2012. "Are Analysts' Loss Functions Asymmetric?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(8), pages 736-756, December.
    35. Julieta Caunedo & Riccardo Dicecio & Ivana Komunjer & Michael T. Owyang, 2020. "Asymmetry, Complementarities, and State Dependence in Federal Reserve Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 52(1), pages 205-228, February.
    36. G. A. Christodoulakis & E. C. Mamatzakis, 2009. "Assessing the prudence of economic forecasts in the EU," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 583-606.
    37. Marinucci, D. & Robinson, P. M., 2000. "Weak convergence of multivariate fractional processes," Stochastic Processes and their Applications, Elsevier, vol. 86(1), pages 103-120, March.
    38. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    39. Alex Maynard & Peter C. B. Phillips, 2001. "Rethinking an old empirical puzzle: econometric evidence on the forward discount anomaly," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(6), pages 671-708.
    40. Peter C. B. Phillips, 1998. "New Tools for Understanding Spurious Regressions," Econometrica, Econometric Society, vol. 66(6), pages 1299-1326, November.
    41. Mamatzakis, Emmanuel & Tsionas, Mike G., 2015. "How are market preferences shaped? The case of sovereign debt of stressed euro-area countries," Journal of Banking & Finance, Elsevier, vol. 61(C), pages 106-116.
    42. Matei Demetrescu & Christoph Roling & Anna Titova, 2021. "Reevaluating the prudence of economic forecasts in the EU: The role of instrument persistence," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 151-161, January.
    43. Alexandros Kostakis & Tassos Magdalinos & Michalis P. Stamatogiannis, 2015. "Robust Econometric Inference for Stock Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 28(5), pages 1506-1553.
    44. Saburo Ohno & Tomohiro Ando, 2018. "Stock return predictability: A factor-augmented predictive regression system with shrinkage method," Econometric Reviews, Taylor & Francis Journals, vol. 37(1), pages 29-60, January.
    45. Phillips, P.C.B., 1991. "A Shortcut to LAD Estimator Asymptotics," Econometric Theory, Cambridge University Press, vol. 7(4), pages 450-463, December.
    46. Fama, Eugene F., 1984. "Forward and spot exchange rates," Journal of Monetary Economics, Elsevier, vol. 14(3), pages 319-338, November.
    47. McDonald, James B. & Newey, Whitney K., 1988. "Partially Adaptive Estimation of Regression Models via the Generalized T Distribution," Econometric Theory, Cambridge University Press, vol. 4(3), pages 428-457, December.
    48. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Demetrescu, Matei & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Transformed regression-based long-horizon predictability tests," Journal of Econometrics, Elsevier, vol. 237(2).
    2. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2022. "Testing for episodic predictability in stock returns," Journal of Econometrics, Elsevier, vol. 227(1), pages 85-113.
    3. Demetrescu, Matei & Rodrigues, Paulo M.M., 2022. "Residual-augmented IVX predictive regression," Journal of Econometrics, Elsevier, vol. 227(2), pages 429-460.
    4. Demetrescu, Matei & Georgiev, Iliyan & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Extensions to IVX methods of inference for return predictability," Journal of Econometrics, Elsevier, vol. 237(2).
    5. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    6. Tu, Yundong & Xie, Xinling, 2023. "Penetrating sporadic return predictability," Journal of Econometrics, Elsevier, vol. 237(1).
    7. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    8. Matei Demetrescu & Christoph Roling & Anna Titova, 2021. "Reevaluating the prudence of economic forecasts in the EU: The role of instrument persistence," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(1), pages 151-161, January.
    9. Zongwu Cai & Haiqiang Chen & Xiaosai Liao, 2020. "A New Robust Inference for Predictive Quantile Regression," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202002, University of Kansas, Department of Economics, revised Feb 2020.
    10. Tsuchiya, Yoichi, 2016. "Asymmetric loss and rationality of Chinese renminbi forecasts: An implication for the trade between China and the US," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 44(C), pages 116-127.
    11. Cai, Zongwu & Chen, Haiqiang & Liao, Xiaosai, 2023. "A new robust inference for predictive quantile regression," Journal of Econometrics, Elsevier, vol. 234(1), pages 227-250.
    12. Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
    13. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    14. Maynard, Alex & Shimotsu, Katsumi & Kuriyama, Nina, 2024. "Inference in predictive quantile regressions," Journal of Econometrics, Elsevier, vol. 245(1).
    15. Yannick Hoga, 2024. "Persistence-Robust Break Detection in Predictive Quantile and CoVaR Regressions," Papers 2410.05861, arXiv.org.
    16. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    17. Zongwu Cai & Seong Yeon Chang, 2018. "A New Test In A Predictive Regression with Structural Breaks," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201811, University of Kansas, Department of Economics, revised Dec 2018.
    18. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    19. Alex Maynard, 2006. "The forward premium anomaly: statistical artefact or economic puzzle? New evidence from robust tests," Canadian Journal of Economics, Canadian Economics Association, vol. 39(4), pages 1244-1281, November.
    20. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.

    More about this item

    Keywords

    Loss function; Unknown persistence; Endogeneity; Robustness;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • F31 - International Economics - - International Finance - - - Foreign Exchange
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:33:y:2025:i:c:p:80-104. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.