IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/24069.html
   My bibliography  Save this paper

Can cheap panel-based internet surveys substitute costly in-person interviews in CV surveys?

Author

Listed:
  • Lindhjem, Henrik
  • Navrud, Ståle

Abstract

With the current growth in broadband penetration, Internet is likely to be the data collection mode of choice for stated preference research in the not so distant future. However, little is known about how this survey mode may influence data quality and welfare estimates. In a first controlled field experiment to date as part of a national contingent valuation (CV) survey estimating willingness to pay (WTP) for biodiversity protection plans, we assign two groups sampled from the same panel of respondents either to an Internet or in-person (in-house) interview mode. Our design is better able than previous studies to isolate measurement effects from sample composition effects. We find little evidence of social desirability bias in the in-person interview setting or satisficing (shortcutting the response process) in the Internet survey. The share of “don’t knows”, zeros and protest responses to the WTP question with a payment card is very similar between modes. Equality of mean WTP between samples cannot be rejected. Considering equivalence, we can reject that mean WTP from the in-person sample is more than 30% higher. Results are quite encouraging for the use of Internet in CV as stated preferences do not seem to be significantly different or biased compared to in-person interviews.

Suggested Citation

  • Lindhjem, Henrik & Navrud, Ståle, 2010. "Can cheap panel-based internet surveys substitute costly in-person interviews in CV surveys?," MPRA Paper 24069, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:24069
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/24069/1/MPRA_paper_24069.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anna Alberini & James R. Kahn (ed.), 2006. "Handbook on Contingent Valuation," Books, Edward Elgar Publishing, number 1893.
    2. Darren Hudson & Lee-Hong Seah & Diane Hite & Tim Haab, 2004. "Telephone presurveys, self-selection, and non-response bias to mail and Internet surveys in economic research," Applied Economics Letters, Taylor & Francis Journals, vol. 11(4), pages 237-240.
    3. Hui Li & R. P. Berrens & A. K. Bohara & H. C. Jenkins-Smith & C. L. Silva & L. Weimer, 2004. "Telephone versus Internet samples for a national advisory referendum: are the underlying stated preferences the same?," Applied Economics Letters, Taylor & Francis Journals, vol. 11(3), pages 173-176.
    4. Christopher G. Leggett & Naomi S. Kleckner & Kevin J. Boyle & John W. Dufield & Robert Cameron Mitchell, 2003. "Social Desirability Bias in Contingent Valuation Surveys Administered Through In-Person Interviews," Land Economics, University of Wisconsin Press, vol. 79(4), pages 561-575.
    5. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.
    6. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    7. Davis, Jennifer, 2004. "Assessing Community Preferences for Development Projects: Are Willingness-to-Pay Studies Robust to Mode Effects?," World Development, Elsevier, vol. 32(4), pages 655-672, April.
    8. Dadi Kristofersson & Ståle Navrud, 2005. "Validity Tests of Benefit Transfer – Are We Performing the Wrong Tests?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 279-286, March.
    9. Bateman, Ian J. & Mawby, James, 2004. "First impressions count: interviewer appearance and information effects in stated preference studies," Ecological Economics, Elsevier, vol. 49(1), pages 47-55, May.
    10. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    11. Alvarez, R. Michael & Sherman, Robert P. & VanBeselaere, Carla, 2003. "Subject Acquisition for Web-Based Surveys," Political Analysis, Cambridge University Press, vol. 11(1), pages 23-43, January.
    12. Fredrik Carlsson, 2010. "Design of Stated Preference Surveys: Is There More to Learn from Behavioral Economics?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(2), pages 167-177, June.
    13. Marta-Pedroso, Cristina & Freitas, Helena & Domingos, Tiago, 2007. "Testing for the survey mode effect on contingent valuation data quality: A case study of web based versus in-person interviews," Ecological Economics, Elsevier, vol. 62(3-4), pages 388-398, May.
    14. David J. Bjornstad & James R. Kahn (ed.), 1996. "The Contingent Valuation of Environmental Resources," Books, Edward Elgar Publishing, number 731.
    15. Robert G. Ethier & Gregory L. Poe & William D. Schulze & Jeremy Clark, 2000. "Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-Pricing Electricity Programs," Land Economics, University of Wisconsin Press, vol. 76(1), pages 54-67.
    16. Judith Covey & Angela Robinson & Michael Jones-Lee & Graham Loomes, 2010. "Responsibility, scale and the valuation of rail safety," Journal of Risk and Uncertainty, Springer, vol. 40(1), pages 85-108, February.
    17. H. Spencer Banzhaf & Dallas Burtraw & David Evans & Alan Krupnick, 2006. "Valuation of Natural Resource Improvements in the Adirondacks," Land Economics, University of Wisconsin Press, vol. 82(3), pages 445-464.
    18. Nielsen, Jytte Seested, 2011. "Use of the Internet for willingness-to-pay surveys: A comparison of face-to-face and web-based interviews," Resource and Energy Economics, Elsevier, vol. 33(1), pages 119-129, January.
    19. Bateman, Ian J. & Cole, Matthew & Cooper, Philip & Georgiou, Stavros & Hadley, David & Poe, Gregory L., 2004. "On visible choice sets and scope sensitivity," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 71-93, January.
    20. MacMillan, Douglas & Hanley, Nick & Lienhoop, Nele, 2006. "Contingent valuation: Environmental polling or preference engine?," Ecological Economics, Elsevier, vol. 60(1), pages 299-307, November.
    21. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    22. McFadden, Daniel, 1999. "Rationality for Economists?," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 73-105, December.
    23. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank C. & Silva, Carol L. & Weimer, David L., 2004. "Information and effort in contingent valuation surveys: application to global climate change using national internet samples," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 331-363, March.
    24. Li, Hui & Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank C. & Silva, Carol L. & Weimer, David L., 2005. "Testing for Budget Constraint Effects in a National Advisory Referendum Survey on the Kyoto Protocol," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 30(2), pages 1-17, August.
    25. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    26. Henrik Lindhjem & Ståle Navrud, 2009. "Asking for Individual or Household Willingness to Pay for Environmental Goods?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(1), pages 11-29, May.
    27. Cameron, Trudy Ann & Huppert, Daniel D., 1989. "OLS versus ML estimation of non-market resource values with payment card interval data," Journal of Environmental Economics and Management, Elsevier, vol. 17(3), pages 230-246, November.
    28. Mariah D. Ehmke & Jayson L. Lusk & John A. List, 2008. "Is Hypothetical Bias a Universal Phenomenon? A Multinational Investigation," Land Economics, University of Wisconsin Press, vol. 84(3), pages 489-500.
    29. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank & Silva, Carol & Weimer, David L., 2003. "The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples," Political Analysis, Cambridge University Press, vol. 11(1), pages 1-22, January.
    30. Mark L. Messonnier & John C. Bergstrom & Christopher M. Cornwell & R. Jeff Teasley & H. Ken Cordell, 2000. "Survey Response-Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(2), pages 438-450.
    31. van der Heide, C. Martijn & van den Bergh, Jeroen C.J.M. & van Ierland, Ekko C. & Nunes, Paulo A.L.D., 2008. "Economic valuation of habitat defragmentation: A study of the Veluwe, the Netherlands," Ecological Economics, Elsevier, vol. 67(2), pages 205-216, September.
    32. Lynn, Peter & Jäckle, Annette & Roberts, Caroline, 2006. "Telephone versus face-to-face interviewing: mode effects on data quality and likely causes: report on phase II of the ESS-Gallup mixed mode methodology project," ISER Working Paper Series 2006-41, Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jason Bell & Joel Huber & W. Kip Viscusi, 2011. "Survey Mode Effects on Valuation of Environmental Goods," IJERPH, MDPI, vol. 8(4), pages 1-22, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lindhjem, Henrik & Navrud, Ståle, 2008. "Internet CV surveys – a cheap, fast way to get large samples of biased values?," MPRA Paper 11471, University Library of Munich, Germany.
    2. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    3. Lindhjem, Henrik & Navrud, Ståle, 2011. "Are Internet surveys an alternative to face-to-face interviews in contingent valuation?," Ecological Economics, Elsevier, vol. 70(9), pages 1628-1637, July.
    4. Kevin J. Boyle & Mark Morrison & Darla Hatton MacDonald & Roderick Duncan & John Rose, 2016. "Investigating Internet and Mail Implementation of Stated-Preference Surveys While Controlling for Differences in Sample Frames," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 64(3), pages 401-419, July.
    5. Menegaki, Angeliki, N. & Olsen, Søren Bøye & Tsagarakis, Konstantinos P., 2016. "Towards a common standard – A reporting checklist for web-based stated preference valuation surveys and a critique for mode surveys," Journal of choice modelling, Elsevier, vol. 18(C), pages 18-50.
    6. Nielsen, Jytte Seested, 2011. "Use of the Internet for willingness-to-pay surveys: A comparison of face-to-face and web-based interviews," Resource and Energy Economics, Elsevier, vol. 33(1), pages 119-129, January.
    7. Guimarães, Maria Helena & Nunes, Luís Catela & Madureira, Lívia & Santos, José Lima & Boski, Tomasz & Dentinho, Tomaz, 2015. "Measuring birdwatchers preferences: A case for using online networks and mixed-mode surveys," Tourism Management, Elsevier, vol. 46(C), pages 102-113.
    8. Hui Li & Robert P. Berrens & Alok K. Bohara & Hank C. Jenkins-Smith & Carol L. Silva & David L. Weimer, 2005. "Exploring the Beta Model Using Proportional Budget Information in a Contingent Valuation Study," Economics Bulletin, AccessEcon, vol. 17(8), pages 1-9.
    9. Maria Loureiro & Justus Lotade, 2005. "Interviewer Effects on the Valuation of Goods with Ethical and Environmental Attributes," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(1), pages 49-72, January.
    10. Mozumder, Pallab & Vásquez, William F. & Marathe, Achla, 2011. "Consumers' preference for renewable energy in the southwest USA," Energy Economics, Elsevier, vol. 33(6), pages 1119-1126.
    11. Liao, Shu-Yi & Tseng, Wei-Chun & Chen, Chi-Chung, 2010. "Eliciting public preference for nuclear energy against the backdrop of global warming," Energy Policy, Elsevier, vol. 38(11), pages 7054-7069, November.
    12. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    13. Olivier Beaumais & Anne Briand & Katrin Millock & Céline Nauges, 2010. "What are Households Willing to Pay for Better Tap Water Quality? A Cross-Country Valuation Study," Documents de travail du Centre d'Economie de la Sorbonne 10051, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    14. Michael Ahlheim & Benchaphun Ekasingh & Oliver Frör & Jirawan Kitchaicharoen & Andreas Neef & Chapika Sangkapitux & Nopasom Sinphurmsukskul, 2008. "Better than their reputation - A case for mail surveys in contingent valuation," Diskussionspapiere aus dem Institut für Volkswirtschaftslehre der Universität Hohenheim 297/2008, Department of Economics, University of Hohenheim, Germany.
    15. Murakami, Kayo & Ida, Takanori & Tanaka, Makoto & Friedman, Lee, 2015. "Consumers' willingness to pay for renewable and nuclear energy: A comparative analysis between the US and Japan," Energy Economics, Elsevier, vol. 50(C), pages 178-189.
    16. Jason Bell & Joel Huber & W. Kip Viscusi, 2011. "Survey Mode Effects on Valuation of Environmental Goods," IJERPH, MDPI, vol. 8(4), pages 1-22, April.
    17. Li, Hui & Jenkins-Smith, Hank C. & Silva, Carol L. & Berrens, Robert P. & Herron, Kerry G., 2009. "Public support for reducing US reliance on fossil fuels: Investigating household willingness-to-pay for energy research and development," Ecological Economics, Elsevier, vol. 68(3), pages 731-742, January.
    18. Börger, Tobias, 2013. "Keeping up appearances: Motivations for socially desirable responding in contingent valuation interviews," Ecological Economics, Elsevier, vol. 87(C), pages 155-165.
    19. Jed J. Cohen & Johannes Reichl, 2022. "Comparing Internet and phone survey mode effects across countries and research contexts," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(1), pages 44-71, January.
    20. Marta-Pedroso, Cristina & Freitas, Helena & Domingos, Tiago, 2007. "Testing for the survey mode effect on contingent valuation data quality: A case study of web based versus in-person interviews," Ecological Economics, Elsevier, vol. 62(3-4), pages 388-398, May.

    More about this item

    Keywords

    Internet; contingent valuation; interviews; survey mode; willingness to pay;
    All these keywords.

    JEL classification:

    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:24069. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.