IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v222y2021i1p561-578.html
   My bibliography  Save this article

The wisdom of the crowd and prediction markets

Author

Listed:
  • Dai, Min
  • Jia, Yanwei
  • Kou, Steven

Abstract

Thanks to digital innovation, the wisdom of the crowd, which aims at gathering information (e.g. Wikipedia) and making a prediction (e.g. using prediction markets) from a group’s aggregated inputs, has been widely appreciated. An innovative survey design, based on a Bayesian learning framework, called the Bayesian truth serum (BTS), was proposed previously to reduce the bias in the simple majority rule by asking additional survey questions. A natural question is whether we can extend the BTS framework to prediction markets (not just polls). To do so, this paper proposes two estimators, one based on a prediction market alone and the other based on both the market and a poll question. We show that both estimators are consistent within the BTS framework, under different sets of regularity conditions. Simulations are conducted to examine the convergence of different estimators. A real data set of sports betting is used to demonstrate the effectiveness of one estimator.

Suggested Citation

  • Dai, Min & Jia, Yanwei & Kou, Steven, 2021. "The wisdom of the crowd and prediction markets," Journal of Econometrics, Elsevier, vol. 222(1), pages 561-578.
  • Handle: RePEc:eee:econom:v:222:y:2021:i:1:p:561-578
    DOI: 10.1016/j.jeconom.2020.07.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407620302062
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2020.07.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    2. repec:feb:framed:0074 is not listed on IDEAS
    3. Hanemann, W Michael, 1984. "Discrete-Continuous Models of Consumer Demand," Econometrica, Econometric Society, vol. 52(3), pages 541-561, May.
    4. Berg, Joyce & Forsythe, Robert & Nelson, Forrest & Rietz, Thomas, 2008. "Results from a Dozen Years of Election Futures Markets Research," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 80, pages 742-751, Elsevier.
    5. Plott, Charles R & Sunder, Shyam, 1988. "Rational Expectations and the Aggregation of Diverse Information in Laboratory Security Markets," Econometrica, Econometric Society, vol. 56(5), pages 1085-1118, September.
    6. Kou, S. G. & Sobel, Michael E., 2004. "Forecasting the Vote: A Theoretical Comparison of Election Markets and Public Opinion Polls," Political Analysis, Cambridge University Press, vol. 12(3), pages 277-295, July.
    7. Marco Ottaviani & Peter Norman Sørensen, 2015. "Price Reaction to Information with Heterogeneous Beliefs and Wealth Effects: Underreaction, Momentum, and Reversal," American Economic Review, American Economic Association, vol. 105(1), pages 1-34, January.
    8. Martin Spann & Bernd Skiera, 2003. "Internet-Based Virtual Stock Markets for Business Forecasting," Management Science, INFORMS, vol. 49(10), pages 1310-1326, October.
    9. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    10. Binswanger, Hans P, 1981. "Attitudes toward Risk: Theoretical Implications of an Experiment in Rural India," Economic Journal, Royal Economic Society, vol. 91(364), pages 867-890, December.
    11. Galí, Jordi & Gertler, Mark, 1999. "Inflation Dynamics: A Structural Economic Analysis," CEPR Discussion Papers 2246, C.E.P.R. Discussion Papers.
    12. Hanson, Robin & Oprea, Ryan & Porter, David, 2006. "Information aggregation and manipulation in an experimental market," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 449-459, August.
    13. Justin Wolfers & Eric Zitzewitz, 2004. "Prediction Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 107-126, Spring.
    14. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, March.
    15. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    16. Reiss, Peter C. & Wolak, Frank A., 2007. "Structural Econometric Modeling: Rationales and Examples from Industrial Organization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 64, Elsevier.
    17. Wolfers, Justin & Zitzewitz, Eric, 2006. "Interpreting Prediction Market Prices as Probabilities," IZA Discussion Papers 2092, Institute of Labor Economics (IZA).
    18. Jakša Cvitanić & Dražen Prelec & Blake Riley & Benjamin Tereick, 2019. "Honesty via Choice-Matching," American Economic Review: Insights, American Economic Association, vol. 1(2), pages 179-192, September.
    19. Forsythe, Robert & Forrest Nelson & George R. Neumann & Jack Wright, 1992. "Anatomy of an Experimental Political Stock Market," American Economic Review, American Economic Association, vol. 82(5), pages 1142-1161, December.
    20. Gali, Jordi & Gertler, Mark, 1999. "Inflation dynamics: A structural econometric analysis," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 195-222, October.
    21. Morris, Stephen, 1995. "The Common Prior Assumption in Economic Theory," Economics and Philosophy, Cambridge University Press, vol. 11(2), pages 227-253, October.
    22. Halpern, Joseph Y., 2002. "Characterizing the Common Prior Assumption," Journal of Economic Theory, Elsevier, vol. 106(2), pages 316-355, October.
    23. Forsythe, Robert & Rietz, Thomas A. & Ross, Thomas W., 1999. "Wishes, expectations and actions: a survey on price formation in election stock markets," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 83-110, May.
    24. Forsythe, Robert & Lundholm, Russell, 1990. "Information Aggregation in an Experimental Market," Econometrica, Econometric Society, vol. 58(2), pages 309-347, March.
    25. Bohm, Peter & Sonnegard, Joakim, 1999. " Political Stock Markets and Unreliable Polls," Scandinavian Journal of Economics, Wiley Blackwell, vol. 101(2), pages 205-222, June.
    26. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    27. Dražen Prelec & H. Sebastian Seung & John McCoy, 2017. "A solution to the single-question crowd wisdom problem," Nature, Nature, vol. 541(7638), pages 532-535, January.
    28. Peter Bohm & Joakim Sonnegard, 1999. "Political Stock Markets and Unreliable Polls," Scandinavian Journal of Economics, Wiley Blackwell, vol. 101(2), pages 205-222, June.
    29. Garthwaite, Paul H. & Kadane, Joseph B. & O'Hagan, Anthony, 2005. "Statistical Methods for Eliciting Probability Distributions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 680-701, June.
    30. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    31. P. J. Lamberson & Scott E. Page, 2012. "Optimal Forecasting Groups," Management Science, INFORMS, vol. 58(4), pages 805-810, April.
    32. Rust, John, 2010. "Comments on: "Structural vs. atheoretic approaches to econometrics" by Michael Keane," Journal of Econometrics, Elsevier, vol. 156(1), pages 21-24, May.
    33. Kay-Yut Chen & Leslie R. Fine & Bernardo A. Huberman, 2004. "Eliminating Public Knowledge Biases in Information-Aggregation Mechanisms," Management Science, INFORMS, vol. 50(7), pages 983-994, July.
    34. Paul W. Rhode & Koleman S. Strumpf, 2004. "Historical Presidential Betting Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 127-141, Spring.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hamed Amini & Maxim Bichuch & Zachary Feinstein, 2023. "Decentralized Prediction Markets and Sports Books," Papers 2307.08768, arXiv.org, revised Aug 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul J. Healy & Sera Linardi & J. Richard Lowery & John O. Ledyard, 2010. "Prediction Markets: Alternative Mechanisms for Complex Environments with Few Traders," Management Science, INFORMS, vol. 56(11), pages 1977-1996, November.
    2. RYan Oprea & David Porter & Chris Hibbert & Robin Hanson & Dorina Tila, 2008. "Can Manipulators Mislead Prediction Market Observers?," Working Papers 08-01, Chapman University, Economic Science Institute.
    3. Dorina Tila & David Porter, 2008. "Group Prediction in Information Markets With and Without Trading Information and Price Manipulation Incentives," Working Papers 08-06, Chapman University, Economic Science Institute.
    4. Snowberg, Erik & Wolfers, Justin & Zitzewitz, Eric, 2013. "Prediction Markets for Economic Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 657-687, Elsevier.
    5. Forsell, Eskil & Viganola, Domenico & Pfeiffer, Thomas & Almenberg, Johan & Wilson, Brad & Chen, Yiling & Nosek, Brian A. & Johannesson, Magnus & Dreber, Anna, 2019. "Predicting replication outcomes in the Many Labs 2 study," Journal of Economic Psychology, Elsevier, vol. 75(PA).
    6. Lawrence Choo & Todd R. Kaplan & Ro’i Zultan, 2019. "Information aggregation in Arrow–Debreu markets: an experiment," Experimental Economics, Springer;Economic Science Association, vol. 22(3), pages 625-652, September.
    7. Mikuláš Gangur & Miroslav Plevný, 2014. "Tools for Consumer Rights Protection in the Prediction of Electronic Virtual Market and Technological Changes," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 16(36), pages 578-578, May.
    8. Coulomb, Renaud & Sangnier, Marc, 2014. "The impact of political majorities on firm value: Do electoral promises or friendship connections matter?," Journal of Public Economics, Elsevier, vol. 115(C), pages 158-170.
    9. Bennouri, Moez & Gimpel, Henner & Robert, Jacques, 2011. "Measuring the impact of information aggregation mechanisms: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 78(3), pages 302-318, May.
    10. Justin Wolfers & Eric Zitzewitz, 2004. "Prediction Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 107-126, Spring.
    11. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    12. van Bruggen, G.H. & Spann, M. & Lilien, G.L. & Skiera, B., 2006. "Institutional Forecasting: The Performance of Thin Virtual Stock Markets," ERIM Report Series Research in Management ERS-2006-028-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    13. Hanson, Robin & Oprea, Ryan & Porter, David, 2006. "Information aggregation and manipulation in an experimental market," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 449-459, August.
    14. Bergemann, Dirk & Ottaviani, Marco, 2021. "Information Markets and Nonmarkets," CEPR Discussion Papers 16459, C.E.P.R. Discussion Papers.
    15. Hedtrich, F. & Loy, J.-P. & Müller, R.A.E., 2010. "Prognosen auf Agrarmärkten: Prediction Markets – eine innovative Prognosemethode auch für die Landwirtschaft?," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 45, March.
    16. Andrea Albertazzi & Friederike Mengel & Ronald Peeters, 2021. "Benchmarking information aggregation in experimental markets," Economic Inquiry, Western Economic Association International, vol. 59(4), pages 1500-1516, October.
    17. Edoardo Gaffeo, 2013. "Using information markets in grantmaking. An assessment of the issues involved and an application to Italian banking foundations," DEM Discussion Papers 2013/08, Department of Economics and Management.
    18. Joyce E. Berg & John Geweke & Thomas A. Rietz, 2010. "Memoirs of an indifferent trader: Estimating forecast distributions from prediction markets," Quantitative Economics, Econometric Society, vol. 1(1), pages 163-186, July.
    19. Coulomb, Renaud & Sangnier, Marc, 2014. "The impact of political majorities on firm value: Do electoral promises or friendship connections matter?," Journal of Public Economics, Elsevier, vol. 115(C), pages 158-170.
    20. Marco Ottaviani & Peter Norman Sørensen, 2015. "Price Reaction to Information with Heterogeneous Beliefs and Wealth Effects: Underreaction, Momentum, and Reversal," American Economic Review, American Economic Association, vol. 105(1), pages 1-34, January.

    More about this item

    Keywords

    Prediction markets; Public opinion polls; Information aggregation;
    All these keywords.

    JEL classification:

    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:222:y:2021:i:1:p:561-578. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.