IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/gyz3h.html
   My bibliography  Save this paper

Reducing Attrition in Phone-based Panel Surveys: A Web Application to Facilitate Best Practices and Semi-Automate Survey Workflow

Author

Listed:
  • Alrababah, Ala
  • Casalis, Marine
  • Masterson, Daniel

    (University of California, Santa Barbara)

  • Hangartner, Dominik
  • Wehrli,

    (ETH Zürich)

  • Weinstein, Jeremy

Abstract

Panel surveys and phone-based data collection are essential tools for survey research and are often used together due to the practical advantages of conducting repeated interviews over the phone. These tools are particularly critical for research in dynamic or high-risk settings, as highlighted by researchers' responses to the COVID-19 crisis. However, maintaining low attrition is a major problem with panel surveys. Current solutions focus on statistical fixes to address attrition ex post but often overlook a preferable solution: minimizing attrition in the first place. Building on a review of political science panel studies and a systematic overview of best practices, we propose a framework for reducing attrition and present an online platform to facilitate the logistics of survey implementation. The web application semi-automates scheduling survey calls and enumerator workflows, which helps reduce panel attrition while also increasing data quality and minimizing enumerator errors. Applying the proposed framework to a panel study of Syrian refugees in Lebanon, we are able to maintain participant retention at 67% around three and a half years after the baseline survey. We conclude by offering guidelines for transparently reporting panel studies and comprehensively describing their designs.

Suggested Citation

  • Alrababah, Ala & Casalis, Marine & Masterson, Daniel & Hangartner, Dominik & Wehrli, & Weinstein, Jeremy, 2023. "Reducing Attrition in Phone-based Panel Surveys: A Web Application to Facilitate Best Practices and Semi-Automate Survey Workflow," OSF Preprints gyz3h, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:gyz3h
    DOI: 10.31219/osf.io/gyz3h
    as

    Download full text from publisher

    File URL: https://osf.io/download/6544bbb5b1613d0093b7a9aa/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/gyz3h?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthew S. Levendusky, 2013. "Why Do Partisan Media Polarize Viewers?," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 611-623, July.
    2. Margalit, Yotam, 2013. "Explaining Social Policy Preferences: Evidence from the Great Recession," American Political Science Review, Cambridge University Press, vol. 107(1), pages 80-103, February.
    3. James L. Gibson & Gregory A. Caldeira, 2009. "Confirmation Politics and The Legitimacy of the U.S. Supreme Court: Institutional Loyalty, Positivity Bias, and the Alito Nomination," American Journal of Political Science, John Wiley & Sons, vol. 53(1), pages 139-155, January.
    4. Dino P. Christenson & David M. Glick, 2015. "Chief Justice Roberts's Health Care Decision Disrobed: The Microfoundations of the Supreme Court's Legitimacy," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 403-418, February.
    5. Scacco, Alexandra & Warren, Shana S., 2018. "Can Social Contact Reduce Prejudice and Discrimination? Evidence from a Field Experiment in Nigeria," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 112(3), pages 654-677.
    6. Butler, Daniel M. & Hassell, Hans J.G., 2018. "On the Limits of Officials’ Ability to Change Citizens’ Priorities: A Field Experiment in Local Politics," American Political Science Review, Cambridge University Press, vol. 112(4), pages 860-873, November.
    7. Hale, Henry E. & Colton, Timothy J., 2017. "Who Defects? Unpacking a Defection Cascade from Russia's Dominant Party 2008–12," American Political Science Review, Cambridge University Press, vol. 111(2), pages 322-337, May.
    8. Kevin B. Smith & John R. Alford & John R. Hibbing & Nicholas G. Martin & Peter K. Hatemi, 2017. "Intuitive Ethics and Political Orientations: Testing Moral Foundations as a Theory of Political Ideology," American Journal of Political Science, John Wiley & Sons, vol. 61(2), pages 424-437, April.
    9. Holbein, John B. & Hillygus, D. Sunshine & Lenard, Matthew A. & Gibson-Davis, Christina & Hill, Darryl V., 2020. "The Development of Students’ Engagement in School, Community and Democracy," British Journal of Political Science, Cambridge University Press, vol. 50(4), pages 1439-1457, October.
    10. David E. Campbell & Geoffrey C. Layman & John C. Green & Nathanael G. Sumaktoyo, 2018. "Putting Politics First: The Impact of Politics on American Religious and Secular Orientations," American Journal of Political Science, John Wiley & Sons, vol. 62(3), pages 551-565, July.
    11. Julia Elad-Strenger & Brian J Hall & Stevan E Hobfoll & Daphna Canetti, 2021. "Explaining public support for violence against politicians during conflict: Evidence from a panel study in Israel," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(3), pages 417-432, May.
    12. Paul A. Djupe & Jacob R. Neiheisel & Anand E. Sokhey, 2018. "Reconsidering the Role of Politics in Leaving Religion: The Importance of Affiliation," American Journal of Political Science, John Wiley & Sons, vol. 62(1), pages 161-175, January.
    13. Steven E. Finkel & Amy Erica Smith, 2011. "Civic Education, Political Discussion, and the Social Transmission of Democratic Knowledge and Values in a New Democracy: Kenya 2002," American Journal of Political Science, John Wiley & Sons, vol. 55(2), pages 417-435, April.
    14. Horowitz, Jeremy, 2019. "Ethnicity and the Swing Vote in Africa’s Emerging Democracies: Evidence from Kenya," British Journal of Political Science, Cambridge University Press, vol. 49(3), pages 901-921, July.
    15. Goodwin, Matthew & Hix, Simon & Pickup, Mark, 2020. "For and Against Brexit: A Survey Experiment of the Impact of Campaign Effects on Public Attitudes toward EU Membership," British Journal of Political Science, Cambridge University Press, vol. 50(2), pages 481-495, April.
    16. Layman, Geoffrey C. & Carsey, Thomas M. & Green, John C. & Herrera, Richard & Cooperman, Rosalyn, 2010. "Activists and Conflict Extension in American Party Politics," American Political Science Review, Cambridge University Press, vol. 104(2), pages 324-346, May.
    17. Kalla, Joshua L. & Broockman, David E., 2022. "“Outside Lobbying” over the Airwaves: A Randomized Field Experiment on Televised Issue Ads," American Political Science Review, Cambridge University Press, vol. 116(3), pages 1126-1132, August.
    18. Searing, Donald D. & Jacoby, William G. & Tyner, Andrew H., 2019. "The Endurance of Politicians’ Values Over Four Decades: A Panel Study," American Political Science Review, Cambridge University Press, vol. 113(1), pages 226-241, February.
    19. Hirsch-Hoefler, Sivan & Canetti, Daphna & Rapaport, Carmit & Hobfoll, Stevan E., 2016. "Conflict will Harden your Heart: Exposure to Violence, Psychological Distress, and Peace Barriers in Israel and Palestine," British Journal of Political Science, Cambridge University Press, vol. 46(4), pages 845-859, October.
    20. Gonzã Lez, Tanja Artiga & Granic, Georg D., 2020. "Spatial Voting Meets Spatial Policy Positions: An Experimental Appraisal," American Political Science Review, Cambridge University Press, vol. 114(1), pages 285-290, February.
    21. Ayoub, Phillip M. & Page, Douglas & Whitt, Sam, 2021. "Pride amid Prejudice: The Influence of LGBT+ Rights Activism in a Socially Conservative Society," American Political Science Review, Cambridge University Press, vol. 115(2), pages 467-485, May.
    22. Mutz, Diana C. & Kim, Eunji, 2017. "The Impact of In-group Favoritism on Trade Preferences," International Organization, Cambridge University Press, vol. 71(4), pages 827-850, October.
    23. Suzanne L. Parker & Glenn R. Parker & James A. McCann, 2008. "Opinion Taking within Friendship Networks," American Journal of Political Science, John Wiley & Sons, vol. 52(2), pages 412-420, April.
    24. Beath, Andrew & Christia, Fotini & Enikolopov, Ruben, 2013. "Empowering Women through Development Aid: Evidence from a Field Experiment in Afghanistan," American Political Science Review, Cambridge University Press, vol. 107(3), pages 540-557, August.
    25. Lasse Laustsen & Michael Bang Petersen, 2020. "Online Tallies and the Context of Politics: How Online Tallies Make Dominant Candidates Appear Competent in Contexts of Conflict," American Journal of Political Science, John Wiley & Sons, vol. 64(2), pages 240-255, April.
    26. Jardina, Ashley & Piston, Spencer, 2022. "The Effects of Dehumanizing Attitudes about Black People on Whites’ Voting Decisions," British Journal of Political Science, Cambridge University Press, vol. 52(3), pages 1076-1098, July.
    27. Martin Bisgaard & Rune Slothuus, 2018. "Partisan Elites as Culprits? How Party Cues Shape Partisan Perceptual Gaps," American Journal of Political Science, John Wiley & Sons, vol. 62(2), pages 456-469, April.
    28. Bert Ingelaere & Marijke Verpoorten, 2020. "Trust in the aftermath of genocide: Insights from Rwandan life histories," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(4), pages 521-535, July.
    29. Agrawal, Arun & Chhatre, Ashwini & Gerber, Elisabeth R., 2015. "Motivational Crowding in Sustainable Development Interventions," American Political Science Review, Cambridge University Press, vol. 109(3), pages 470-487, August.
    30. Shineman, Victoria Anne, 2018. "If You Mobilize Them, They Will Become Informed: Experimental Evidence that Information Acquisition Is Endogenous to Costs and Incentives to Participate," British Journal of Political Science, Cambridge University Press, vol. 48(1), pages 189-211, January.
    31. Anaïd Flesken, 2018. "Ethnic Parties, Ethnic Tensions? Results of an Original Election Panel Study," American Journal of Political Science, John Wiley & Sons, vol. 62(4), pages 967-981, October.
    32. Peter K. Hatemi & Charles Crabtree & Kevin B. Smith, 2019. "Ideology Justifies Morality: Political Beliefs Predict Moral Foundations," American Journal of Political Science, John Wiley & Sons, vol. 63(4), pages 788-806, October.
    33. Taylor C. Boas & F. Daniel Hidalgo & Marcus André Melo, 2019. "Norms versus Action: Why Voters Fail to Sanction Malfeasance in Brazil," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 385-400, April.
    34. Andy Baker & Barry Ames & Lucio R. Renno, 2006. "Social Context and Campaign Volatility in New Democracies: Networks and Neighborhoods in Brazil's 2002 Elections," American Journal of Political Science, John Wiley & Sons, vol. 50(2), pages 382-399, April.
    35. Guess, Andrew & Coppock, Alexander, 2020. "Does Counter-Attitudinal Information Cause Backlash? Results from Three Large Survey Experiments – CORRIGENDUM," British Journal of Political Science, Cambridge University Press, vol. 50(4), pages 1517-1517, October.
    36. Schmitt-Beck, Rüdiger & Partheymüller, Julia, 2016. "A Two-Stage Theory of Discussant Influence on Vote Choice in Multiparty Systems," British Journal of Political Science, Cambridge University Press, vol. 46(2), pages 321-348, April.
    37. Hale, Henry E., 2022. "Authoritarian Rallying as Reputational Cascade? Evidence from Putin’s Popularity Surge after Crimea," American Political Science Review, Cambridge University Press, vol. 116(2), pages 580-594, May.
    38. Shigeo Hirano & Gabriel S. Lenz & Maksim Pinkovskiy & James M. Snyder, 2015. "Voter Learning in State Primary Elections," American Journal of Political Science, John Wiley & Sons, vol. 59(1), pages 91-108, January.
    39. Lilla V. Orr & Gregory A. Huber, 2020. "The Policy Basis of Measured Partisan Animosity in the United States," American Journal of Political Science, John Wiley & Sons, vol. 64(3), pages 569-586, July.
    40. Scacco, Alexandra & Warren, Shana S., 2018. "Can Social Contact Reduce Prejudice and Discrimination? Evidence from a Field Experiment in Nigeria," American Political Science Review, Cambridge University Press, vol. 112(3), pages 654-677, August.
    41. Hopkins, Daniel J., 2023. "Stable Views in a Time of Tumult: Assessing Trends in US Public Opinion, 2007–20," British Journal of Political Science, Cambridge University Press, vol. 53(1), pages 297-307, January.
    42. Krzysztof Krakowski, 2022. "Adjustments to gang exposure in early adolescence," Journal of Peace Research, Peace Research Institute Oslo, vol. 59(3), pages 337-352, May.
    43. Bush, Sarah Sunn & Prather, Lauren, 2020. "Foreign Meddling and Mass Attitudes Toward International Economic Engagement," International Organization, Cambridge University Press, vol. 74(3), pages 584-609, July.
    44. Jens Hainmueller & Daniel J. Hopkins, 2015. "The Hidden American Immigration Consensus: A Conjoint Analysis of Attitudes toward Immigrants," American Journal of Political Science, John Wiley & Sons, vol. 59(3), pages 529-548, July.
    45. Guess, Andrew & Coppock, Alexander, 2020. "Does Counter-Attitudinal Information Cause Backlash? Results from Three Large Survey Experiments," British Journal of Political Science, Cambridge University Press, vol. 50(4), pages 1497-1515, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ximeng Fang & Sven Heuser & Lasse S. Stötzer, 2023. "How In-Person Conversations Shape Political Polarization: Quasi-Experimental Evidence from a Nationwide Initiative," ECONtribute Discussion Papers Series 270, University of Bonn and University of Cologne, Germany.
    2. Zhuravskaya, Ekaterina & Miho, Antonela & Jarotschkin, Alexandra, 2019. "Diffusion of Gender Norms: Evidence from Stalin's Ethnic Deportations," CEPR Discussion Papers 13865, C.E.P.R. Discussion Papers.
    3. Humphreys, Macartan & Scacco, Alexandra, 2020. "The aggregation challenge," World Development, Elsevier, vol. 127(C).
    4. Andrea Tesei & Filipe Campante & Ruben Durante, 2022. "Media and Social Capital," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 69-91, August.
    5. Sania Ashraf & Cristina Bicchieri & Upasak Das & Tanu Gupta & Alex Shpenev, 2024. "Learning from diversity: ``jati" fractionalization, social expectations and improved sanitation practices in India," Discussion Papers 24-01, Indian Statistical Institute, Delhi.
    6. Pedro C. Vicente & Ines Vilela, 2020. "Preventing violent Islamic radicalization: experimental evidence on anti-social behavior," NOVAFRICA Working Paper Series wp2008, Universidade Nova de Lisboa, Nova School of Business and Economics, NOVAFRICA.
    7. Vicente, Pedro C. & Vilela, Inês, 2022. "Preventing Islamic radicalization: Experimental evidence on anti-social behavior," Journal of Comparative Economics, Elsevier, vol. 50(2), pages 474-485.
    8. Ben M. Tappin & Adam J. Berinsky & David G. Rand, 2023. "Partisans’ receptivity to persuasive messaging is undiminished by countervailing party leader cues," Nature Human Behaviour, Nature, vol. 7(4), pages 568-582, April.
    9. Smith, Amy Erica, 2017. "Democratic Talk in Church: Religion and Political Socialization in the Context of Urban Inequality," World Development, Elsevier, vol. 99(C), pages 441-451.
    10. Sonia Bhalotra & Irma Clots-Figueras & Lakshmi Iyer & Joseph Vecci, 2023. "Leader Identity and Coordination," The Review of Economics and Statistics, MIT Press, vol. 105(1), pages 175-189, January.
    11. Matthew Lowe, 2020. "Types of Contact: A Field Experiment on Collaborative and Adversarial Caste Integration," CESifo Working Paper Series 8089, CESifo.
    12. Heidi Kaila & Saurabh Singhal & Divya Tuteja, 2017. "Do fences make good neighbours?: Evidence from an insurgency in India," WIDER Working Paper Series wp-2017-158, World Institute for Development Economic Research (UNU-WIDER).
    13. Mironova, Vera & Whitt, Sam, 2021. "Conflict and parochialism among combatants and civilians: Evidence from Ukraine," Journal of Economic Psychology, Elsevier, vol. 86(C).
    14. Leiter, Debra & Murr, Andreas & Rascón Ramírez, Ericka & Stegmaier, Mary, 2018. "Social networks and citizen election forecasting: The more friends the better," International Journal of Forecasting, Elsevier, vol. 34(2), pages 235-248.
    15. Astghik Mavisakalyan & Yashar Tarverdi, 2023. "Identity and support for policies towards Indigenous people: evidence from Australia," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 167(1), pages 535-570, June.
    16. Jan Feld & Edwin Ip & Andreas Leibbrandt & Joseph Vecci, 2022. "Identifying and Overcoming Gender Barriers in Tech: A Field Experiment on Inaccurate Statistical Discrimination," CESifo Working Paper Series 9970, CESifo.
    17. Robin Bayes, 2022. "Moral Convictions and Threats to Science," The ANNALS of the American Academy of Political and Social Science, , vol. 700(1), pages 86-96, March.
    18. Humphreys, Macartan & Scacco, Alexandra, 2020. "The aggregation challenge," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 127, pages 1-3.
    19. Eric Groenendyk & Yanna Krupnikov, 2021. "What Motivates Reasoning? A Theory of Goal‐Dependent Political Evaluation," American Journal of Political Science, John Wiley & Sons, vol. 65(1), pages 180-196, January.
    20. Sanjaya, Muhammad Ryan, 2023. "Antisocial behavior in experiments: What have we learned from the past two decades?," Research in Economics, Elsevier, vol. 77(1), pages 104-115.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:gyz3h. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.