IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v37y2021i2p881-898.html
   My bibliography  Save this article

Nonparametric tests for Optimal Predictive Ability

Author

Listed:
  • Arvanitis, Stelios
  • Post, Thierry
  • Potì, Valerio
  • Karabati, Selcuk

Abstract

A nonparametric method for comparing multiple forecast models is developed and implemented. The hypothesis of Optimal Predictive Ability generalizes the Superior Predictive Ability hypothesis from a single given loss function to an entire class of loss functions. Distinction is drawn between General Loss functions, Convex Loss functions, and Symmetric Convex Loss functions. The research hypothesis is formulated in terms of moment inequality conditions. The empirical moment conditions are reduced to an exact and finite system of linear inequalities based on piecewise-linear loss functions. The hypothesis can be tested in a statistically consistent way using a blockwise Empirical Likelihood Ratio test statistic. A computationally feasible test procedure computes the test statistic using Convex Optimization methods, and estimates conservative, data-dependent critical values using a majorizing chi-square limit distribution and a moment selection method. An empirical application to inflation forecasting reveals that a very large majority of thousands of forecast models are redundant, leaving predominantly Phillips Curve-type models, when convexity and symmetry are assumed.

Suggested Citation

  • Arvanitis, Stelios & Post, Thierry & Potì, Valerio & Karabati, Selcuk, 2021. "Nonparametric tests for Optimal Predictive Ability," International Journal of Forecasting, Elsevier, vol. 37(2), pages 881-898.
  • Handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:881-898
    DOI: 10.1016/j.ijforecast.2020.10.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020301564
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.10.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fishburn, Peter C., 1974. "Convex stochastic dominance with continuous distribution functions," Journal of Economic Theory, Elsevier, vol. 7(2), pages 143-158, February.
    2. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    3. Bawa, Vijay S, et al, 1985. "On Determination of Stochastic Dominance Optimal Sets," Journal of Finance, American Finance Association, vol. 40(2), pages 417-431, June.
    4. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 735-765.
    5. Allen, Jason & Gregory, Allan W. & Shimotsu, Katsumi, 2011. "Empirical likelihood block bootstrapping," Journal of Econometrics, Elsevier, vol. 161(2), pages 110-121, April.
    6. Russell Davidson & Jean-Yves Duclos, 2013. "Testing for Restricted Stochastic Dominance," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 84-125, January.
    7. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    8. Brown, Bryan W & Newey, Whitney K, 2002. "Generalized Method of Moments, Efficient Bootstrapping, and Improved Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 507-517, October.
    9. El Ghouch, Anouar & Van Keilegom, Ingrid & McKeague, Ian W., 2011. "Empirical Likelihood Confidence Intervals For Dependent Duration Data," Econometric Theory, Cambridge University Press, vol. 27(1), pages 178-198, February.
    10. Thierry Post, 2003. "Empirical Tests for Stochastic Dominance Efficiency," Journal of Finance, American Finance Association, vol. 58(5), pages 1905-1932, October.
    11. Russell Davidson, 2009. "Testing for Restricted Stochastic Dominance: Some Further Results," Review of Economic Analysis, Digital Initiatives at the University of Waterloo Library, vol. 1(1), pages 34-59, September.
    12. Daniel J. Nordman & Helle Bunzel & Soumendra N. Lahiri, 2012. "A Non-standard Empirical Likelihood for Time Series," CREATES Research Papers 2012-55, Department of Economics and Business Economics, Aarhus University.
    13. G. Hanoch & H. Levy, 1969. "The Efficiency Analysis of Choices Involving Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 36(3), pages 335-346.
    14. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2019. "Robust optimization of forecast combinations," International Journal of Forecasting, Elsevier, vol. 35(3), pages 910-926.
    15. Jochen Gorski & Frank Pfeuffer & Kathrin Klamroth, 2007. "Biconvex sets and optimization with biconvex functions: a survey and extensions," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 66(3), pages 373-407, December.
    16. Thierry Post, 2003. "Empirical Tests for Stochastic Dominance Efficiency," Journal of Finance, American Finance Association, vol. 58(5), pages 1905-1931, October.
    17. Thierry Post, 2017. "Empirical Tests for Stochastic Dominance Optimality," Review of Finance, European Finance Association, vol. 21(2), pages 793-810.
    18. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    19. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2018. "Portfolio optimization based on stochastic dominance and empirical likelihood," Journal of Econometrics, Elsevier, vol. 206(1), pages 167-186.
    20. Hadar, Josef & Russell, William R, 1969. "Rules for Ordering Uncertain Prospects," American Economic Review, American Economic Association, vol. 59(1), pages 25-34, March.
    21. Gordon Anderson & Thierry Post, 2018. "Increasing discriminatory power in well-being analysis using convex stochastic dominance," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 51(3), pages 551-561, October.
    22. Jenish, Nazgul & Prucha, Ingmar R., 2012. "On spatial processes and asymptotic inference under near-epoch dependence," Journal of Econometrics, Elsevier, vol. 170(1), pages 178-190.
    23. Kroll, Yoram & Levy, Haim, 1980. "Sampling Errors and Portfolio Efficient Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 15(3), pages 655-688, September.
    24. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    25. Grant Hillier & Mark Armstrong, 1999. "The Density of the Maximum Likelihood Estimator," Econometrica, Econometric Society, vol. 67(6), pages 1459-1470, November.
    26. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    27. Canay, Ivan A., 2010. "EL inference for partially identified models: Large deviations optimality and bootstrap validity," Journal of Econometrics, Elsevier, vol. 156(2), pages 408-425, June.
    28. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    29. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
    30. Jin, Sainan & Corradi, Valentina & Swanson, Norman R., 2017. "Robust Forecast Comparison," Econometric Theory, Cambridge University Press, vol. 33(6), pages 1306-1351, December.
    31. Yuichi Kitamura, 2001. "Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 69(6), pages 1661-1672, November.
    32. Rothschild, Michael & Stiglitz, Joseph E., 1970. "Increasing risk: I. A definition," Journal of Economic Theory, Elsevier, vol. 2(3), pages 225-243, September.
    33. El Ghouch, Anouar & Van Keilegom, Ingrid & McKeague, Ian W., 2011. "Empirical likelihood confidence intervals for dependent duration data," LIDAM Reprints ISBA 2011006, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    34. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    35. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(5), pages 849-866, December.
    36. Ray D. Nelson & Rulon D. Pope, 1991. "Bootstrapped Insights into Empirical Applications of Stochastic Dominance," Management Science, INFORMS, vol. 37(9), pages 1182-1194, September.
    37. Thierry Post & Valerio Potì, 2017. "Portfolio Analysis Using Stochastic Dominance, Relative Entropy, and Empirical Likelihood," Management Science, INFORMS, vol. 63(1), pages 153-165, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stelios Arvanitis & Thierry Post, 2024. "Stochastic Arbitrage Opportunities: Set Estimation and Statistical Testing," Mathematics, MDPI, vol. 12(4), pages 1-19, February.
    2. Valentina Corradi & Sainan Jin & Norman R. Swanson, 2023. "Robust forecast superiority testing with an application to assessing pools of expert forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 596-622, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kolokolova, Olga & Le Courtois, Olivier & Xu, Xia, 2022. "Is the index efficient? A worldwide tour with stochastic dominance," Journal of Financial Markets, Elsevier, vol. 59(PB).
    2. Thierry Post & Iňaki Rodríguez Longarela, 2021. "Risk Arbitrage Opportunities for Stock Index Options," Operations Research, INFORMS, vol. 69(1), pages 100-113, January.
    3. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2018. "Portfolio optimization based on stochastic dominance and empirical likelihood," Journal of Econometrics, Elsevier, vol. 206(1), pages 167-186.
    4. Stelios Arvanitis & Thierry Post, 2024. "Stochastic Arbitrage Opportunities: Set Estimation and Statistical Testing," Mathematics, MDPI, vol. 12(4), pages 1-19, February.
    5. Stelios Arvanitis & Thierry Post & Nikolas Topaloglou, 2021. "Stochastic Bounds for Reference Sets in Portfolio Analysis," Management Science, INFORMS, vol. 67(12), pages 7737-7754, December.
    6. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2019. "Robust optimization of forecast combinations," International Journal of Forecasting, Elsevier, vol. 35(3), pages 910-926.
    7. Liesiö, Juuso & Xu, Peng & Kuosmanen, Timo, 2020. "Portfolio diversification based on stochastic dominance under incomplete probability information," European Journal of Operational Research, Elsevier, vol. 286(2), pages 755-768.
    8. Andrey Lizyayev, 2012. "Stochastic dominance efficiency analysis of diversified portfolios: classification, comparison and refinements," Annals of Operations Research, Springer, vol. 196(1), pages 391-410, July.
    9. Post, Thierry & Kopa, Miloš, 2013. "General linear formulations of stochastic dominance criteria," European Journal of Operational Research, Elsevier, vol. 230(2), pages 321-332.
    10. Duc Khuong Nguyen & Nikolas Topaloglou & Thomas Walther, 2020. "Asset Classes and Portfolio Diversification: Evidence from a Stochastic Spanning Approach," Working Papers 2020-009, Department of Research, Ipag Business School.
    11. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2022. "Stochastic dominance spanning and augmenting the human development index with institutional quality," Annals of Operations Research, Springer, vol. 315(1), pages 341-369, August.
    12. Jin, Sainan & Corradi, Valentina & Swanson, Norman R., 2017. "Robust Forecast Comparison," Econometric Theory, Cambridge University Press, vol. 33(6), pages 1306-1351, December.
    13. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    14. Thierry Post & Miloš Kopa, 2017. "Portfolio Choice Based on Third-Degree Stochastic Dominance," Management Science, INFORMS, vol. 63(10), pages 3381-3392, October.
    15. Post, G.T., 2001. "Testing for Stochastic Dominance with Diversification Possibilities," ERIM Report Series Research in Management ERS-2001-38-F&A, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    16. Thierry Post & Valerio Potì, 2017. "Portfolio Analysis Using Stochastic Dominance, Relative Entropy, and Empirical Likelihood," Management Science, INFORMS, vol. 63(1), pages 153-165, January.
    17. Wang, Ming-Hui & Ke, Mei-Chu & Liang Liao, Tung & Chiang, Yi-Chein & Hsu, Chuan-Hao, 2020. "Alternative estimation method of earnings growth rate for PEGR strategy," The North American Journal of Economics and Finance, Elsevier, vol. 53(C).
    18. Al-Khazali, Osamah & Lean, Hooi Hooi & Samet, Anis, 2014. "Do Islamic stock indexes outperform conventional stock indexes? A stochastic dominance approach," Pacific-Basin Finance Journal, Elsevier, vol. 28(C), pages 29-46.
    19. Egozcue, Martin & Wong, Wing-Keung, 2010. "Gains from diversification on convex combinations: A majorization and stochastic dominance approach," European Journal of Operational Research, Elsevier, vol. 200(3), pages 893-900, February.
    20. Fang, Yi & Post, Thierry, 2017. "Higher-degree stochastic dominance optimality and efficiency," European Journal of Operational Research, Elsevier, vol. 261(3), pages 984-993.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:881-898. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.