IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v272y2019i1p389-405.html
   My bibliography  Save this article

Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements

Author

Listed:
  • Sung, Ming-Chien
  • McDonald, David C.J.
  • Johnson, Johnnie E.V.
  • Tai, Chung-Ching
  • Cheah, Eng-Tuck

Abstract

We examine the impact of price trends on the accuracy of forecasts from prediction markets. In particular, we study an electronic betting exchange market and construct independent variables from market price (odds) time series from 6058 individual markets (a dataset consisting of over 8.4 million price points). Using a conditional logit model, we find that a systematic relationship exists between trends in odds and the accuracy of odds-implied event probabilities; the relationship is consistent with participants over-reacting to price movements. In particular, in different time segments of the market, increasing and decreasing odds lead, respectively, to under- and over-estimation of odds-implied probabilities. We develop a methodology to detect and correct the erroneous forecasts associated with these trends in odds in order to considerably improve the quality of forecasts generated in prediction markets.

Suggested Citation

  • Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
  • Handle: RePEc:eee:ejores:v:272:y:2019:i:1:p:389-405
    DOI: 10.1016/j.ejor.2018.06.024
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221718305575
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Forrest, 2017. "Sports corruption and developments in betting markets," Chapters, in: Plácido Rodríguez & Brad R. Humphreys & Robert Simmons (ed.),The Economics of Sports Betting, chapter 10, pages 162-182, Edward Elgar Publishing.
    2. Figlewski, Stephen, 1979. "Subjective Information and Market Efficiency in a Betting Market," Journal of Political Economy, University of Chicago Press, vol. 87(1), pages 75-88, February.
    3. Colin F. Camerer, 1998. "Can Asset Markets Be Manipulated? A Field Experiment with Racetrack Betting," Journal of Political Economy, University of Chicago Press, vol. 106(3), pages 457-482, June.
    4. David Edelman, 2000. "On the Financial Value of Information," Annals of Operations Research, Springer, vol. 100(1), pages 123-132, December.
    5. McHale, Ian & Morton, Alex, 2011. "A Bradley-Terry type model for forecasting tennis match results," International Journal of Forecasting, Elsevier, vol. 27(2), pages 619-630, April.
    6. Marco Cipriani & Antonio Guarino, 2009. "Herd Behavior in Financial Markets: An Experiment with Financial Market Professionals," Journal of the European Economic Association, MIT Press, vol. 7(1), pages 206-233, March.
    7. John Gandar & Richard Zuber & R. Stafford Johnson, 2001. "Searching for the favourite-longshot bias down under: an examination of the New Zealand pari-mutuel betting market," Applied Economics, Taylor & Francis Journals, vol. 33(13), pages 1621-1629.
    8. Harrison Hong & Jeremy C. Stein, 1999. "A Unified Theory of Underreaction, Momentum Trading, and Overreaction in Asset Markets," Journal of Finance, American Finance Association, vol. 54(6), pages 2143-2184, December.
    9. Ruth N. Bolton & Randall G. Chapman, 2008. "Searching For Positive Returns At The Track: A Multinomial Logit Model For Handicapping Horse Races," World Scientific Book Chapters, in: Donald B Hausch & Victor SY Lo & William T Ziemba (ed.),Efficiency Of Racetrack Betting Markets, chapter 17, pages 151-171, World Scientific Publishing Co. Pte. Ltd..
    10. Erik Snowberg & Justin Wolfers, 2010. "Explaining the Favorite-Long Shot Bias: Is it Risk-Love or Misperceptions?," Journal of Political Economy, University of Chicago Press, vol. 118(4), pages 723-746, August.
    11. Lakonishok, Josef & Shleifer, Andrei & Vishny, Robert W., 1992. "The impact of institutional trading on stock prices," Journal of Financial Economics, Elsevier, vol. 32(1), pages 23-43, August.
    12. D. J. Johnstone, 2011. "Economic Interpretation of Probabilities Estimated by Maximum Likelihood or Score," Management Science, INFORMS, vol. 57(2), pages 308-314, February.
    13. Paul W. Rhode & Koleman Strumpf, 2008. "Historical Political Futures Markets: An International Perspective," NBER Working Papers 14377, National Bureau of Economic Research, Inc.
    14. Franck, Egon & Verbeek, Erwin & Nüesch, Stephan, 2010. "Prediction accuracy of different market structures -- bookmakers versus a betting exchange," International Journal of Forecasting, Elsevier, vol. 26(3), pages 448-459, July.
    15. Sveinung Arnesen & Ole Bergfjord, 2014. "Prediction markets vs polls – an examination of accuracy for the 2008 and 2012 elections," Journal of Prediction Markets, University of Buckingham Press, vol. 8(3), pages 24-33.
    16. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V., 2016. "Probabilistic forecasting with discrete choice models: Evaluating predictions with pseudo-coefficients of determination," European Journal of Operational Research, Elsevier, vol. 248(3), pages 1021-1030.
    17. Newton Paul K & Aslam Kamran, 2009. "Monte Carlo Tennis: A Stochastic Markov Chain Model," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 5(3), pages 1-44, July.
    18. Bruno J.D. Jacobs & Bas Donkers & Dennis Fok, 2016. "Model-Based Purchase Predictions for Large Assortments," Marketing Science, INFORMS, vol. 35(3), pages 389-404, May.
    19. repec:hrv:faseco:33077905 is not listed on IDEAS
    20. Robin Hanson, 2007. "Logarithmic Market Scoring Rules for Modular Combinatorial Information Aggregation," Journal of Prediction Markets, University of Buckingham Press, vol. 1(1), pages 3-15, February.
    21. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    22. Berkowitz, Jason P. & Depken, Craig A. & Gandar, John M., 2017. "A favorite-longshot bias in fixed-odds betting markets: Evidence from college basketball and college football," The Quarterly Review of Economics and Finance, Elsevier, vol. 63(C), pages 233-239.
    23. Asch, Peter & Malkiel, Burton G. & Quandt, Richard E., 1982. "Racetrack betting and informed behavior," Journal of Financial Economics, Elsevier, vol. 10(2), pages 187-194, July.
    24. Marco Cipriani & Antonio Guarino, 2005. "Herd Behavior in a Laboratory Financial Market," American Economic Review, American Economic Association, vol. 95(5), pages 1427-1443, December.
    25. Goodfellow, Christiane & Bohl, Martin T. & Gebka, Bartosz, 2009. "Together we invest? Individual and institutional investors' trading behaviour in Poland," International Review of Financial Analysis, Elsevier, vol. 18(4), pages 212-221, September.
    26. Michael A. Smith & David Paton & Leighton Vaughan Williams, 2006. "Market Efficiency in Person‐to‐Person Betting," Economica, London School of Economics and Political Science, vol. 73(292), pages 673-689, November.
    27. Graefe, Andreas & Armstrong, J. Scott, 2011. "Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task," International Journal of Forecasting, Elsevier, vol. 27(1), pages 183-195, January.
    28. L. C. MacLean & W. T. Ziemba & G. Blazenko, 1992. "Growth Versus Security in Dynamic Investment Analysis," Management Science, INFORMS, vol. 38(11), pages 1562-1585, November.
    29. Uri Simonsohn & Dan Ariely, 2008. "When Rational Sellers Face Nonrational Buyers: Evidence from Herding on eBay," Management Science, INFORMS, vol. 54(9), pages 1624-1637, September.
    30. David Marginson, 2010. "Symposium - Market Inefficiency in Person-to-Person Betting: Examining ‘Known Loser’ Insider Trading on the Exchanges," Southern Economic Journal, Southern Economic Association, vol. 76(4), pages 932-952, April.
    31. Lessmann, Stefan & Sung, Ming-Chien & Johnson, Johnnie E.V., 2010. "Alternative methods of predicting competitive events: An application in horserace betting markets," International Journal of Forecasting, Elsevier, vol. 26(3), pages 518-536, July.
    32. Raymond Sauer, 2005. "The state of research on markets for sports betting and suggested future directions," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 29(3), pages 416-426, September.
    33. Marshall Gramm & Douglas H. Owens, 2006. "Efficiency in Pari-Mutuel Betting Markets across Wagering Pools in the Simulcast Era," Southern Economic Journal, Southern Economic Association, vol. 72(4), pages 926-937, April.
    34. Avery, Christopher & Zemsky, Peter, 1998. "Multidimensional Uncertainty and Herd Behavior in Financial Markets," American Economic Review, American Economic Association, vol. 88(4), pages 724-748, September.
    35. Donald B. Hausch & William T. Ziemba & Mark Rubinstein, 1981. "Efficiency of the Market for Racetrack Betting," Management Science, INFORMS, vol. 27(12), pages 1435-1452, December.
    36. Hsiu-Hsin Ko, 2016. "Exchange Rate Predictability in Finite Samples," The Japanese Economic Review, Japanese Economic Association, vol. 67(3), pages 361-378, September.
    37. Demirer, RIza & Kutan, Ali M., 2006. "Does herding behavior exist in Chinese stock markets?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 16(2), pages 123-142, April.
    38. Schnytzer, Adi & Shilony, Yuval, 1995. "Inside Information in a Betting Market," Economic Journal, Royal Economic Society, vol. 105(431), pages 963-971, July.
    39. Koessler, Frédéric & Noussair, Charles & Ziegelmeyer, Anthony, 2012. "Information aggregation and belief elicitation in experimental parimutuel betting markets," Journal of Economic Behavior & Organization, Elsevier, vol. 83(2), pages 195-208.
    40. Braun, Sebastian & Kvasnicka, Michael, 2013. "National Sentiment and Economic Behavior: Evidence From Online Betting on European Football," EconStor Open Access Articles, ZBW - Leibniz Information Centre for Economics, pages 45-64.
    41. Johnnie E. V. Johnson & Owen Jones & Leilei Tang, 2006. "Exploring Decision Makers' Use of Price Information in a Speculative Market," Management Science, INFORMS, vol. 52(6), pages 897-908, June.
    42. Lessmann, Stefan & Sung, Ming-Chien & Johnson, Johnnie E.V. & Ma, Tiejun, 2012. "A new methodology for generating and combining statistical forecasting models to enhance competitive event prediction," European Journal of Operational Research, Elsevier, vol. 218(1), pages 163-174.
    43. Richard N. Rosett, 1965. "Gambling and Rationality," Journal of Political Economy, University of Chicago Press, vol. 73, pages 595-595.
    44. Adi Schnytzer & Avichai Snir, 2008. "Herding in Imperfect Betting Markets with Inside Traders," Journal of Gambling Business and Economics, University of Buckingham Press, vol. 2(2), pages 1-15, September.
    45. Ron Bird & Michael Mccrae, 2008. "Tests Of The Efficiency Of Racetrack Betting Using Bookmaker Odds," World Scientific Book Chapters, in: Donald B Hausch & Victor SY Lo & William T Ziemba (ed.),Efficiency Of Racetrack Betting Markets, chapter 59, pages 593-603, World Scientific Publishing Co. Pte. Ltd..
    46. Meulbroek, Lisa K, 1992. "An Empirical Analysis of Illegal Insider Trading," Journal of Finance, American Finance Association, vol. 47(5), pages 1661-1699, December.
    47. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    48. Leighton Vaughan Williams & David Paton, 1998. "Why are some favourite-longshot biases positive and others negative?," Applied Economics, Taylor & Francis Journals, vol. 30(11), pages 1505-1510.
    49. Raymond D. Sauer, 1998. "The Economics of Wagering Markets," Journal of Economic Literature, American Economic Association, vol. 36(4), pages 2021-2064, December.
    50. Shin, Hyun Song, 1991. "Optimal Betting Odds against Insider Traders," Economic Journal, Royal Economic Society, vol. 101(408), pages 1179-1185, September.
    51. Richard S. Dale & Johnnie E. V. Johnson & Leilei Tang, 2005. "Financial markets can go mad: evidence of irrational behaviour during the South Sea Bubble," Economic History Review, Economic History Society, vol. 58(2), pages 233-271, May.
    52. Charles R. Plott & Jorgen Wit & Winston C. Yang, 2003. "Parimutuel betting markets as information aggregation devices: experimental results," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 22(2), pages 311-351, September.
    53. Adi Schnytzer & Guy Weinberg, 2008. "Testing for Home Team and Favorite Biases in the Australian Rules Football Fixed-Odds and Point Spread Betting Markets," Journal of Sports Economics, , vol. 9(2), pages 173-190, April.
    54. Karen Croxson & J. James Reade, 2014. "Information and Efficiency: Goal Arrival in Soccer Betting," Economic Journal, Royal Economic Society, vol. 124(575), pages 62-91, March.
    55. Ma, Tiejun & Tang, Leilei & McGroarty, Frank & Sung, Ming-Chien & Johnson, Johnnie E. V, 2016. "Time is money: Costing the impact of duration misperception in market prices," European Journal of Operational Research, Elsevier, vol. 255(2), pages 397-410.
    56. Lessmann, Stefan & Sung, Ming-Chien & Johnson, Johnnie E.V., 2009. "Identifying winners of competitive events: A SVM-based classification model for horserace prediction," European Journal of Operational Research, Elsevier, vol. 196(2), pages 569-577, July.
    57. Shih-Wei Wu & Johnnie E.V. Johnson & Ming-Chien Sung, 2008. "Overconfidence in Judgements: the Evidence, the Implications and the Limitations," Journal of Prediction Markets, University of Buckingham Press, vol. 2(1), pages 73-90, May.
    58. Lin, Hsiou-Wei William & Lo, Huai-Chun & Wu, Ruei-Shian, 2016. "Modeling default prediction with earnings management," Pacific-Basin Finance Journal, Elsevier, vol. 40(PB), pages 306-322.
    59. A D Fitt & C J Howls & M Kabelka, 2006. "Valuation of soccer spread bets," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 975-985, August.
    60. Demirer, Riza & Kutan, Ali M. & Chen, Chun-Da, 2010. "Do investors herd in emerging stock markets?: Evidence from the Taiwanese market," Journal of Economic Behavior & Organization, Elsevier, vol. 76(2), pages 283-295, November.
    61. Robin Hanson, 2009. "On Market Maker Functions," Journal of Prediction Markets, University of Buckingham Press, vol. 3(1), pages 61-63, April.
    62. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    63. Richard W. Sias, 2004. "Institutional Herding," Review of Financial Studies, Society for Financial Studies, vol. 17(1), pages 165-206.
    64. Stephen Dobson & John Goddard, 2017. "Evaluating probabilities for a football in-play betting market," Chapters, in: Plácido Rodríguez & Brad R. Humphreys & Robert Simmons (ed.),The Economics of Sports Betting, chapter 4, pages 52-70, Edward Elgar Publishing.
    65. Robin Hanson, 2003. "Combinatorial Information Market Design," Information Systems Frontiers, Springer, vol. 5(1), pages 107-119, January.
    66. Shleifer, Andrei & Summers, Lawrence H, 1990. "The Noise Trader Approach to Finance," Journal of Economic Perspectives, American Economic Association, vol. 4(2), pages 19-33, Spring.
    67. Russ Wermers, 1999. "Mutual Fund Herding and the Impact on Stock Prices," Journal of Finance, American Finance Association, vol. 54(2), pages 581-622, April.
    68. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    69. Marco Ottaviani & Peter Norman Sorensen, 2010. "Noise, Information, and the Favorite-Longshot Bias in Parimutuel Predictions," American Economic Journal: Microeconomics, American Economic Association, vol. 2(1), pages 58-85, February.
    70. Hongjun Yan, 2010. "Is Noise Trading Cancelled Out by Aggregation?," Management Science, INFORMS, vol. 56(7), pages 1047-1059, July.
    71. Crafts, Nicholas F R, 1985. "Some Evidence of Insider Knowledge in Horse Race Betting in Britain," Economica, London School of Economics and Political Science, vol. 52(27), pages 295-304, August.
    72. David Forrest & Robert Simmons, 2008. "Sentiment in the betting market on Spanish football," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 119-126.
    73. Hyun Song Shin, 2008. "Prices Of State Contingent Claims With Insider Traders, And The Favourite-Longshot Bias," World Scientific Book Chapters, in: Donald B Hausch & Victor SY Lo & William T Ziemba (ed.),Efficiency Of Racetrack Betting Markets, chapter 34, pages 343-352, World Scientific Publishing Co. Pte. Ltd..
    74. Hsieh, Shu-Fan, 2013. "Individual and institutional herding and the impact on stock returns: Evidence from Taiwan stock market," International Review of Financial Analysis, Elsevier, vol. 29(C), pages 175-188.
    75. Smith, Michael A. & Paton, David & Williams, Leighton Vaughan, 2009. "Do bookmakers possess superior skills to bettors in predicting outcomes?," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 539-549, August.
    76. Berg, Joyce E. & Nelson, Forrest D. & Rietz, Thomas A., 2008. "Prediction market accuracy in the long run," International Journal of Forecasting, Elsevier, vol. 24(2), pages 285-300.
    77. Dixon, Mark J. & Pope, Peter F., 2004. "The value of statistical forecasts in the UK association football betting market," International Journal of Forecasting, Elsevier, vol. 20(4), pages 697-711.
    78. Gębka, Bartosz & Wohar, Mark E., 2013. "International herding: Does it differ across sectors?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 23(C), pages 55-84.
    79. Michael Abramowicz, 2007. "The Hidden Beauty of the Quadratic Market Scoring Rule: A Uniform Liquidity Market Maker, with Variations," Journal of Prediction Markets, University of Buckingham Press, vol. 1(2), pages 111-125, July.
    80. Joyce E. Berg & John Geweke & Thomas A. Rietz, 2010. "Memoirs of an indifferent trader: Estimating forecast distributions from prediction markets," Quantitative Economics, Econometric Society, vol. 1(1), pages 163-186, July.
    81. Spiwoks, Markus & Bizer, Kilian & Hein, Oliver, 2008. "Informational cascades: A mirage?," Journal of Economic Behavior & Organization, Elsevier, vol. 67(1), pages 193-199, July.
    82. Raymond Sauer & J. Waller & Jahn Hakes, 2010. "The progress of the betting in a baseball game," Public Choice, Springer, vol. 142(3), pages 297-313, March.
    83. Easton, Stephen & Uylangco, Katherine, 2010. "Forecasting outcomes in tennis matches using within-match betting markets," International Journal of Forecasting, Elsevier, vol. 26(3), pages 564-575, July.
    84. Kim, Gi H. & Li, Haitao & Zhang, Weina, 2016. "CDS-bond basis and bond return predictability," Journal of Empirical Finance, Elsevier, vol. 38(PA), pages 307-337.
    85. Caldeira, João F. & Moura, Guilherme V. & Santos, André A.P., 2016. "Predicting the yield curve using forecast combinations," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 79-98.
    86. Devenow, Andrea & Welch, Ivo, 1996. "Rational herding in financial economics," European Economic Review, Elsevier, vol. 40(3-5), pages 603-615, April.
    87. McHale, Ian & Morton, Alex, 2011. "A Bradley-Terry type model for forecasting tennis match results," International Journal of Forecasting, Elsevier, vol. 27(2), pages 619-630.
    88. Thomas S. Gruca & Joyce E. Berg & Michael Cipriano, 2008. "Incentive and Accuracy Issues in Movie Prediction Markets," Journal of Prediction Markets, University of Buckingham Press, vol. 2(1), pages 29-43, May.
    89. Goddard, John, 2005. "Regression models for forecasting goals and match results in association football," International Journal of Forecasting, Elsevier, vol. 21(2), pages 331-340.
    90. Law, David & Peel, David A, 2002. "Insider Trading, Herding Behaviour and Market Plungers in the British Horse-Race Betting Market," Economica, London School of Economics and Political Science, vol. 69(274), pages 327-338, May.
    91. Paul W. Rhode & Koleman S. Strumpf, 2004. "Historical Presidential Betting Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 127-141, Spring.
    92. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, Oxford University Press, vol. 107(3), pages 797-817.
    93. Terrell, Dek & Farmer, Amy, 1996. "Optimal Betting and Efficiency in Parimutuel Betting Markets with Information Costs," Economic Journal, Royal Economic Society, vol. 106(437), pages 846-868, July.
    94. Colin Camerer, 1998. "Can asset markets be manipulated? A field experiment with racetrack betting," Natural Field Experiments 00222, The Field Experiments Website.
    95. Asch, Peter & Malkiel, Burton G & Quandt, Richard E, 1984. "Market Efficiency in Racetrack Betting," The Journal of Business, University of Chicago Press, vol. 57(2), pages 165-175, April.
    Full references (including those not matched with items on IDEAS)

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:272:y:2019:i:1:p:389-405. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: http://www.elsevier.com/locate/eor .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.