IDEAS home Printed from https://ideas.repec.org/a/bla/socsci/v102y2021i2p939-954.html

Effects of Nonresponse, Measurement, and Coverage Bias in Survey Estimates of Voting

Author

Listed:
  • Philip S. Brenner

Abstract

Objective The objective is to estimate the relative contributions of nonresponse, coverage, and measurement biases in survey estimates of voting. Methods We survey 3,000 Boston‐area households sampled from an address‐based frame matched, when possible, to telephone numbers. A two‐phase sampling design was used to follow up nonrespondents from phone interviews with personal interviews. All cases were then linked to voting records. Results Nonresponse, coverage, and measurement‐biased survey estimates at varying stages of the study design. Coverage error linked to missing telephone numbers biased estimates that excluded nonphone households. Overall estimates including nonphone households and nonrespondent interviews include 25 percent relative bias equally attributable to measurement and nonresponse. Conclusion Bias in voting measures is not limited to measurement bias. Researchers should also assess the potential for nonresponse and coverage biases.

Suggested Citation

  • Philip S. Brenner, 2021. "Effects of Nonresponse, Measurement, and Coverage Bias in Survey Estimates of Voting," Social Science Quarterly, Southwestern Social Science Association, vol. 102(2), pages 939-954, March.
  • Handle: RePEc:bla:socsci:v:102:y:2021:i:2:p:939-954
    DOI: 10.1111/ssqu.12935
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/ssqu.12935
    Download Restriction: no

    File URL: https://libkey.io/10.1111/ssqu.12935?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dahlgaard, Jens Olav & Hansen, Jonas Hedegaard & Hansen, Kasper M. & Bhatti, Yosef, 2019. "Bias in Self-reported Voting and How it Distorts Turnout Models: Disentangling Nonresponse Bias and Overreporting Among Danish Voters," Political Analysis, Cambridge University Press, vol. 27(4), pages 590-598, October.
    2. Hans Andersson & Donald Granberg, 1997. "On the validity and reliability of self-reported vote: validity without reliability?," Quality & Quantity: International Journal of Methodology, Springer, vol. 31(2), pages 127-140, May.
    3. Nada Wasi & Aaron Flaaen, 2015. "Record linkage using Stata: Preprocessing, linking, and reviewing utilities," Stata Journal, StataCorp LLC, vol. 15(3), pages 672-697, September.
    4. David R. Johnson & Jared L. Peifer, 2017. "How Public Confidence in Higher Education Varies by Social Context," The Journal of Higher Education, Taylor & Francis Journals, vol. 88(4), pages 619-644, July.
    5. Atkeson, Lonna Rae & Adams, Alex N. & Alvarez, R. Michael, 2014. "Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys," Political Analysis, Cambridge University Press, vol. 22(3), pages 304-320, July.
    6. Burden, Barry C., 2000. "Voter Turnout and the National Election Studies," Political Analysis, Cambridge University Press, vol. 8(4), pages 389-398, July.
    7. Robert Voogt & Hetty Van Kempen, 2002. "Nonresponse Bias and Stimulus Effects in the Dutch National Election Study," Quality & Quantity: International Journal of Methodology, Springer, vol. 36(4), pages 325-345, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tom W. Smith & Jibum Kim, 2013. "An Assessment of the Multi-level Integrated Database Approach," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 185-221, January.
    2. Amuedo Dorantes, Catalina & Arenas-Arroyo, Esther & Mahajan, Parag & Schmidpeter, Bernhard, 2023. "Low-wage jobs, foreign-born workers, and firm performance," Ruhr Economic Papers 1040, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    3. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    4. Rhys Bidder & John Krainer & Adam Shapiro, 2021. "De-leveraging or de-risking? How banks cope with loss," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 39, pages 100-127, January.
    5. Emmanuel Chavez, 2020. "The Effects of Public R&D Subsidies on Private R&D Activities in Mexico," Working Papers halshs-02355106, HAL.
    6. Davis, Yehuda & Govindaraj, Suresh & Suslava, Kate, 2024. "Does the stock market anticipate events and supreme court decisions in corporate cases?," Global Finance Journal, Elsevier, vol. 60(C).
    7. Charles Pattie & Patrick Seyd & Paul Whiteley, 2003. "Citizenship and Civic Engagement: Attitudes and Behaviour in Britain," Political Studies, Political Studies Association, vol. 51(3), pages 443-468, October.
    8. Valev, Neven, 2004. "No pain, no gain: market reform, unemployment, and politics in Bulgaria," Journal of Comparative Economics, Elsevier, vol. 32(3), pages 409-425, September.
    9. Stocké, Volker & Stark, Tobias, 2005. "Stichprobenverzerrung durch Item-Nonresponse in der international vergleichenden Politikwissenschaft," Sonderforschungsbereich 504 Publications 05-43, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    10. Ghaly, Mohamed & Kostakis, Alexandros & Stathopoulos, Konstantinos, 2021. "The (non-) effect of labor unionization on firm risk: Evidence from the options market," Journal of Corporate Finance, Elsevier, vol. 66(C).
    11. Arin, K. Peren & Devereux, Kevin & Methorst, Joel & Thum, Marcel, 2025. "Flooding the vote: Heterogeneous voting responses to a natural disaster in Germany," European Journal of Political Economy, Elsevier, vol. 89(C).
    12. Richard B. Freeman, 2003. "What, Me Vote?," NBER Working Papers 9896, National Bureau of Economic Research, Inc.
    13. Arpita Ghosh & Brendon McConnell & Jaime Millán-Quijano, 2024. "Do Homebuyers Value Energy Efficiency? Evidence From an Information Shock," Discussion Papers 2402, University of Exeter, Department of Economics.
    14. Emmanuel Chavez, 2020. "The Effects of R&D Tax Credits and Subsidies onPrivate R&D in Mexico (Chapter 2)," PSE Working Papers halshs-02652063, HAL.
    15. Daniel H. Weinberg & John M. Abowd & Robert F. Belli & Noel Cressie & David C. Folch & Scott H. Holan & Margaret C. Levenstein & Kristen M. Olson & Jerome P. Reiter & Matthew D. Shapiro & Jolene Smyth, 2017. "Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Improve the U.S. Statistical System?," Working Papers 17-59r, Center for Economic Studies, U.S. Census Bureau.
    16. Bryan A. Stuart, 2022. "The Long-Run Effects of Recessions on Education and Income," American Economic Journal: Applied Economics, American Economic Association, vol. 14(1), pages 42-74, January.
    17. Stocké, Volker & Stark, Tobias, 2005. "Stichprobenverzerrung durch Item-Nonresponse in der international vergleichenden Politikwissenschaft," Papers 05-43, Sonderforschungsbreich 504.
    18. Lyons, Jacqueline & Konara, Palitha & Shirodkar, Vikrant, 2025. "Family business legitimacy and foreign subsidiary establishment mode choice: An institutional and mixed gamble approach," International Business Review, Elsevier, vol. 34(2).
    19. Becker, Sascha O. & Francisco J. Pino & Vidal-Robert, Jordi, 2021. "Freedom of the Press? Catholic Censorship during the Counter-Reformation," The Warwick Economics Research Paper Series (TWERPS) 1356, University of Warwick, Department of Economics.
    20. Amilon, Anna & Hansen, Kasper M. & Kjær, Agnete Aslaug & Steffensen, Tinne, 2021. "Estimating disability prevalence and disability-related inequalities: Does the choice of measure matter?," Social Science & Medicine, Elsevier, vol. 272(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:socsci:v:102:y:2021:i:2:p:939-954. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0038-4941 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.