IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v31y2015i3p980-991.html
   My bibliography  Save this article

Forecasting elections with non-representative polls

Author

Listed:
  • Wang, Wei
  • Rothschild, David
  • Goel, Sharad
  • Gelman, Andrew

Abstract

Election forecasts have traditionally been based on representative polls, in which randomly sampled individuals are asked who they intend to vote for. While representative polling has historically proven to be quite effective, it comes at considerable costs of time and money. Moreover, as response rates have declined over the past several decades, the statistical benefits of representative sampling have diminished. In this paper, we show that, with proper statistical adjustment, non-representative polls can be used to generate accurate election forecasts, and that this can often be achieved faster and at a lesser expense than traditional survey methods. We demonstrate this approach by creating forecasts from a novel and highly non-representative survey dataset: a series of daily voter intention polls for the 2012 presidential election conducted on the Xbox gaming platform. After adjusting the Xbox responses via multilevel regression and poststratification, we obtain estimates which are in line with the forecasts from leading poll analysts, which were based on aggregating hundreds of traditional polls conducted during the election cycle. We conclude by arguing that non-representative polling shows promise not only for election forecasting, but also for measuring public opinion on a broad range of social, economic and cultural issues.

Suggested Citation

  • Wang, Wei & Rothschild, David & Goel, Sharad & Gelman, Andrew, 2015. "Forecasting elections with non-representative polls," International Journal of Forecasting, Elsevier, vol. 31(3), pages 980-991.
  • Handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:980-991
    DOI: 10.1016/j.ijforecast.2014.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207014000879
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2014.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Reilly C. & Gelman A. & Katz J., 2001. "Poststratification Without Population Level Information on the Poststratifying Variable With Application to Political Polling," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1-11, March.
    2. Park, David K. & Gelman, Andrew & Bafumi, Joseph, 2004. "Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls," Political Analysis, Cambridge University Press, vol. 12(4), pages 375-385.
    3. Justin Wolfers & Eric Zitzewitz, 2004. "Prediction Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 107-126, Spring.
    4. Gelman, Andrew & King, Gary, 1993. "Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable?," British Journal of Political Science, Cambridge University Press, vol. 23(4), pages 409-451, October.
    5. Yair Ghitza & Andrew Gelman, 2013. "Deep Interactions with MRP: Election Turnout and Voting Patterns Among Small Electoral Subgroups," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 762-776, July.
    6. Lock, Kari & Gelman, Andrew, 2010. "Bayesian Combination of State Polls and Election Forecasts," Political Analysis, Cambridge University Press, vol. 18(3), pages 337-348, July.
    7. M. Keith Chen & Jonathan E. Ingersoll, Jr. & Edward H. Kaplan, 2008. "Modeling a Presidential Prediction Market," Management Science, INFORMS, vol. 54(8), pages 1381-1394, August.
    8. Jeffrey R. Lax & Justin H. Phillips, 2009. "How Should We Estimate Public Opinion in The States?," American Journal of Political Science, John Wiley & Sons, vol. 53(1), pages 107-121, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher Claassen & Richard Traunmüller, 2020. "Improving and Validating Survey Estimates of Religious Demography Using Bayesian Multilevel Models and Poststratification," Sociological Methods & Research, , vol. 49(3), pages 603-636, August.
    2. Montalvo, José G. & Papaspiliopoulos, Omiros & Stumpf-Fétizon, Timothée, 2019. "Bayesian forecasting of electoral outcomes with new parties’ competition," European Journal of Political Economy, Elsevier, vol. 59(C), pages 52-70.
    3. José Garcia Montalvo & Omiros Papaspiliopoulos & Timothée Stumpf-Fétizon, 2018. "Bayesian forecasting of electoral outcomes with new parties' competition," Economics Working Papers 1624, Department of Economics and Business, Universitat Pompeu Fabra.
    4. José García-Montalvo & Omiros Papaspiliopoulos & Timothée Stumpf-Fétizon, 2018. "Bayesian Forecasting of Electoral Outcomes with new Parties' Competition," Working Papers 1065, Barcelona School of Economics.
    5. Laura C. Dawkins & Daniel B. Williamson & Stewart W. Barr & Sally R. Lampkin, 2020. "‘What drives commuter behaviour?': a Bayesian clustering approach for understanding opposing behaviours in social surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 251-280, January.
    6. Marina Christofoletti & Tânia R. B. Benedetti & Felipe G. Mendes & Humberto M. Carvalho, 2021. "Using Multilevel Regression and Poststratification to Estimate Physical Activity Levels from Health Surveys," IJERPH, MDPI, vol. 18(14), pages 1-16, July.
    7. Khan, Urmee & Lieli, Robert P., 2018. "Information flow between prediction markets, polls and media: Evidence from the 2008 presidential primaries," International Journal of Forecasting, Elsevier, vol. 34(4), pages 696-710.
    8. Lauderdale, Benjamin E. & Bailey, Delia & Blumenau, Jack & Rivers, Douglas, 2020. "Model-based pre-election polling for national and sub-national outcomes in the US and UK," International Journal of Forecasting, Elsevier, vol. 36(2), pages 399-413.
    9. Margaret Weden & Christine Peterson & Jeremy Miles & Regina Shih, 2015. "Evaluating Linearly Interpolated Intercensal Estimates of Demographic and Socioeconomic Characteristics of U.S. Counties and Census Tracts 2001–2009," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 34(4), pages 541-559, August.
    10. Facchini, Giovanni & Hatton, Timothy J. & Steinhardt, Max F., 2024. "Opening Heaven’s Door: Public Opinion and Congressional Votes on the 1965 Immigration Act," The Journal of Economic History, Cambridge University Press, vol. 84(1), pages 232-270, March.
    11. Caldarulo, Mattia & Mossberger, Karen & Howell, Anthony, 2023. "Community-wide broadband adoption and student academic achievement," Telecommunications Policy, Elsevier, vol. 47(1).
    12. Roberto Cerina & Raymond Duch, 2021. "Polling India via regression and post-stratification of non-probability online samples," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-34, November.
    13. Cerina, Roberto & Duch, Raymond, 2020. "Measuring public opinion via digital footprints," International Journal of Forecasting, Elsevier, vol. 36(3), pages 987-1002.
    14. Munzert, Simon, 2017. "Forecasting elections at the constituency level: A correction–combination procedure," International Journal of Forecasting, Elsevier, vol. 33(2), pages 467-481.
    15. repec:cup:judgdm:v:15:y:2020:i:5:p:863-880 is not listed on IDEAS
    16. Temporão, Mickael & Dufresne, Yannick & Savoie, Justin & Linden, Clifton van der, 2019. "Crowdsourcing the vote: New horizons in citizen forecasting," International Journal of Forecasting, Elsevier, vol. 35(1), pages 1-10.
    17. Andrew Gelman & Jessica Hullman & Christopher Wlezien & George Elliott Morris, 2020. "Information, incentives, and goals in election forecasts," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(5), pages 863-880, September.
    18. Yonatan Ben-Shalom & Ignacio Martinez & Mariel Finucane, "undated". "Risk of Workforce Exit Due to Disability: State Differences in 2003–2016," Mathematica Policy Research Reports 8aed03744a06419dbda68be8c, Mathematica Policy Research.
    19. Wiśniowski, Arkadiusz & Bijak, Jakub & Forster, Jonathan J. & Smith, Peter W.F., 2019. "Hierarchical model for forecasting the outcomes of binary referenda," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 90-103.
    20. Berg, Joyce E. & Nelson, Forrest D. & Rietz, Thomas A., 2008. "Prediction market accuracy in the long run," International Journal of Forecasting, Elsevier, vol. 24(2), pages 285-300.
    21. Nicholas Beauchamp, 2017. "Predicting and Interpolating State‐Level Polls Using Twitter Textual Data," American Journal of Political Science, John Wiley & Sons, vol. 61(2), pages 490-503, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:980-991. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.