IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/11471.html
   My bibliography  Save this paper

Internet CV surveys – a cheap, fast way to get large samples of biased values?

Author

Listed:
  • Lindhjem, Henrik
  • Navrud, Ståle

Abstract

With the current growth in broadband penetration, Internet is likely to be the data collection mode of choice for contingent valuation (CV) and stated preference research in the not so distant future. However, little is known about how this survey mode may influence data quality and welfare estimates. In a controlled field experiment as part of a large national CV survey estimating willingness to pay (WTP) for biodiversity protection plans, we assign two groups sampled from the same panel of respondents, either to an Internet or in-person interview mode. Our design is better able than previous mode comparison studies to isolate measurement effects from sample composition effects. Looking in particular for indications of social desirability bias and satisficing (shortcutting the response process) we find little evidence in our data. We find that the extent of “don’t know”, zeros and protest responses to the WTP question (with a payment card) is very similar between modes. Mean WTP is somewhat higher in the interview sample, though we cannot reject equality on the 10 percent level. We also consider equivalence, i.e. whether the WTP difference is larger than a practically trivial predetermined bound. We can reject that the difference is larger than 30 percent, but fail to reject an equivalency bound of 20 percent on the 10 percent level. Results are quite encouraging for the use of Internet as values do not seem to be significantly different or substantially biased compared to in-person interviews.

Suggested Citation

  • Lindhjem, Henrik & Navrud, Ståle, 2008. "Internet CV surveys – a cheap, fast way to get large samples of biased values?," MPRA Paper 11471, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:11471
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/11471/1/MPRA_paper_11471.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kevin C. Urama & Ian Hodge, 2006. "Participatory Environmental Education and Willingness to Pay for River Basin Management: Empirical Evidence from Nigeria," Land Economics, University of Wisconsin Press, vol. 82(4), pages 542-561.
    2. Maria Loureiro & Justus Lotade, 2005. "Interviewer Effects on the Valuation of Goods with Ethical and Environmental Attributes," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(1), pages 49-72, January.
    3. Darren Hudson & Lee-Hong Seah & Diane Hite & Tim Haab, 2004. "Telephone presurveys, self-selection, and non-response bias to mail and Internet surveys in economic research," Applied Economics Letters, Taylor & Francis Journals, vol. 11(4), pages 237-240.
    4. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    5. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.
    6. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    7. Davis, Jennifer, 2004. "Assessing Community Preferences for Development Projects: Are Willingness-to-Pay Studies Robust to Mode Effects?," World Development, Elsevier, vol. 32(4), pages 655-672, April.
    8. Payne, John W & Bettman, James R & Schkade, David A, 1999. "Measuring Constructed Preferences: Towards a Building Code," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 243-270, December.
    9. Dadi Kristofersson & Ståle Navrud, 2005. "Validity Tests of Benefit Transfer – Are We Performing the Wrong Tests?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 279-286, March.
    10. Blomquist, Glenn C. & Whitehead, John C., 1998. "Resource quality information and validity of willingness to pay in contingent valuation," Resource and Energy Economics, Elsevier, vol. 20(2), pages 179-196, June.
    11. Andreoni, James, 1990. "Impure Altruism and Donations to Public Goods: A Theory of Warm-Glow Giving?," Economic Journal, Royal Economic Society, vol. 100(401), pages 464-477, June.
    12. Bateman, Ian J. & Mawby, James, 2004. "First impressions count: interviewer appearance and information effects in stated preference studies," Ecological Economics, Elsevier, vol. 49(1), pages 47-55, May.
    13. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    14. Alvarez, R. Michael & Sherman, Robert P. & VanBeselaere, Carla, 2003. "Subject Acquisition for Web-Based Surveys," Political Analysis, Cambridge University Press, vol. 11(1), pages 23-43, January.
    15. Marta-Pedroso, Cristina & Freitas, Helena & Domingos, Tiago, 2007. "Testing for the survey mode effect on contingent valuation data quality: A case study of web based versus in-person interviews," Ecological Economics, Elsevier, vol. 62(3-4), pages 388-398, May.
    16. David J. Bjornstad & James R. Kahn (ed.), 1996. "The Contingent Valuation of Environmental Resources," Books, Edward Elgar Publishing, number 731.
    17. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta‐Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2‐3), pages 221-248, June.
    18. Robert G. Ethier & Gregory L. Poe & William D. Schulze & Jeremy Clark, 2000. "Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-Pricing Electricity Programs," Land Economics, University of Wisconsin Press, vol. 76(1), pages 54-67.
    19. H. Spencer Banzhaf & Dallas Burtraw & David Evans & Alan Krupnick, 2006. "Valuation of Natural Resource Improvements in the Adirondacks," Land Economics, University of Wisconsin Press, vol. 82(3), pages 445-464.
    20. R. K. Blamey & J. W. Bennett & M. D. Morrison, 1999. "Yea-Saying in Contingent Valuation Surveys," Land Economics, University of Wisconsin Press, vol. 75(1), pages 126-141.
    21. Bateman, Ian J. & Cole, Matthew & Cooper, Philip & Georgiou, Stavros & Hadley, David & Poe, Gregory L., 2004. "On visible choice sets and scope sensitivity," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 71-93, January.
    22. Robert Johnston, 2007. "Choice experiments, site similarity and benefits transfer," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 38(3), pages 331-351, November.
    23. repec:cup:judgdm:v:2:y:2007:i::p:96-106 is not listed on IDEAS
    24. MacMillan, Douglas & Hanley, Nick & Lienhoop, Nele, 2006. "Contingent valuation: Environmental polling or preference engine?," Ecological Economics, Elsevier, vol. 60(1), pages 299-307, November.
    25. Timothy C. Haab & Kenneth E. McConnell, 2002. "Valuing Environmental and Natural Resources," Books, Edward Elgar Publishing, number 2427.
    26. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    27. McFadden, Daniel, 1999. "Rationality for Economists?," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 73-105, December.
    28. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank C. & Silva, Carol L. & Weimer, David L., 2004. "Information and effort in contingent valuation surveys: application to global climate change using national internet samples," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 331-363, March.
    29. Li, Hui & Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank C. & Silva, Carol L. & Weimer, David L., 2005. "Testing for Budget Constraint Effects in a National Advisory Referendum Survey on the Kyoto Protocol," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 30(2), pages 1-17, August.
    30. STÅLE Navrud & GERALD Pruckner, 1997. "Environmental Valuation – To Use or Not to Use? A Comparative Study of the United States and Europe," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(1), pages 1-26, July.
    31. Lindberg, Kreg & Johnson, Rebecca L. & Berrens, Robert P., 1997. "Contingent Valuation Of Rural Tourism Development With Tests Of Scope And Mode Stability," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 22(1), pages 1-17, July.
    32. Cameron, Trudy Ann & Huppert, Daniel D., 1989. "OLS versus ML estimation of non-market resource values with payment card interval data," Journal of Environmental Economics and Management, Elsevier, vol. 17(3), pages 230-246, November.
    33. Schwappach, David L.B. & Strasmann, Thomas J., 2006. ""Quick and dirty numbers"?: The reliability of a stated-preference technique for the measurement of preferences for resource allocation," Journal of Health Economics, Elsevier, vol. 25(3), pages 432-448, May.
    34. Steven F. Edwards & Glen D. Anderson, 1987. "Overlooked Biases in Contingent Valuation Surveys: Some Considerations," Land Economics, University of Wisconsin Press, vol. 63(2), pages 168-178.
    35. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank & Silva, Carol & Weimer, David L., 2003. "The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples," Political Analysis, Cambridge University Press, vol. 11(1), pages 1-22, January.
    36. Mark L. Messonnier & John C. Bergstrom & Christopher M. Cornwell & R. Jeff Teasley & H. Ken Cordell, 2000. "Survey Response-Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(2), pages 438-450.
    37. Ian J. Bateman & Richard T. Carson & Brett Day & Michael Hanemann & Nick Hanley & Tannis Hett & Michael Jones-Lee & Graham Loomes, 2002. "Economic Valuation with Stated Preference Techniques," Books, Edward Elgar Publishing, number 2639.
    38. David A. Harpman & Michael P. Welsh & DEdward W. Sparling, 2004. "Unit Non-Response Bias in the Interval Data Model," Land Economics, University of Wisconsin Press, vol. 80(3), pages 448-462.
    39. Whittington, Dale & Smith, V. Kerry & Okorafor, Apia & Okore, Augustine & Liu, Jin Long & McPhail, Alexander, 1992. "Giving respondents time to think in contingent valuation studies: A developing country application," Journal of Environmental Economics and Management, Elsevier, vol. 22(3), pages 205-225, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olivier Beaumais & Anne Briand & Katrin Millock & Céline Nauges, 2010. "What are Households Willing to Pay for Better Tap Water Quality ? A Cross-Country Valuation Study," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00497453, HAL.
    2. Katrin Millock & Céline Nauges, 2010. "Household Adoption of Water-Efficient Equipment: The Role of Socio-Economic Factors, Environmental Attitudes and Policy," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(4), pages 539-565, August.
    3. Tran Huu Tuan & Henrik Lindhjem, 2008. "Meta-analysis of nature conservation values in Asia & Oceania: Data heterogeneity and benefit transfer issues," EEPSEA Research Report rr2008072, Economy and Environment Program for Southeast Asia (EEPSEA), revised Jul 2008.
    4. Nielsen, Jytte Seested, 2011. "Use of the Internet for willingness-to-pay surveys: A comparison of face-to-face and web-based interviews," Resource and Energy Economics, Elsevier, vol. 33(1), pages 119-129, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lindhjem, Henrik & Navrud, Ståle, 2010. "Can cheap panel-based internet surveys substitute costly in-person interviews in CV surveys?," MPRA Paper 24069, University Library of Munich, Germany.
    2. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Tuan, Tran Huu & Navrud, Stale, 2009. "Applying the dissonance-minimising format to value cultural heritage in developing countries," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 53(3), pages 1-17.
    5. Michael Ahlheim & Benchaphun Ekasingh & Oliver Frör & Jirawan Kitchaicharoen & Andreas Neef & Chapika Sangkapitux & Nopasom Sinphurmsukskul, 2008. "Better than their reputation - A case for mail surveys in contingent valuation," Diskussionspapiere aus dem Institut für Volkswirtschaftslehre der Universität Hohenheim 297/2008, Department of Economics, University of Hohenheim, Germany.
    6. Longo, Alberto & Markandya, Anil & Petrucci, Marta, 2008. "The internalization of externalities in the production of electricity: Willingness to pay for the attributes of a policy for renewable energy," Ecological Economics, Elsevier, vol. 67(1), pages 140-152, August.
    7. Halkos, George, 2012. "The use of contingent valuation in assessing marine and coastal ecosystems’ water quality: A review," MPRA Paper 42183, University Library of Munich, Germany.
    8. Maria Loureiro & Justus Lotade, 2005. "Interviewer Effects on the Valuation of Goods with Ethical and Environmental Attributes," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(1), pages 49-72, January.
    9. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    10. Nielsen, Jytte Seested, 2011. "Use of the Internet for willingness-to-pay surveys: A comparison of face-to-face and web-based interviews," Resource and Energy Economics, Elsevier, vol. 33(1), pages 119-129, January.
    11. Tisdell, Clem & Wilson, Clevo & Swarna Nantha, Hemanath, 2008. "Contingent valuation as a dynamic process," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(4), pages 1443-1458, August.
    12. Oerlemans, Leon A.G. & Chan, Kai-Ying & Volschenk, Jako, 2016. "Willingness to pay for green electricity: A review of the contingent valuation literature and its sources of error," Renewable and Sustainable Energy Reviews, Elsevier, vol. 66(C), pages 875-885.
    13. Liao, Shu-Yi & Tseng, Wei-Chun & Chen, Chi-Chung, 2010. "Eliciting public preference for nuclear energy against the backdrop of global warming," Energy Policy, Elsevier, vol. 38(11), pages 7054-7069, November.
    14. Damigos, D. & Tourkolias, C. & Diakoulaki, D., 2009. "Households' willingness to pay for safeguarding security of natural gas supply in electricity generation," Energy Policy, Elsevier, vol. 37(5), pages 2008-2017, May.
    15. Lindhjem, Henrik & Navrud, Ståle, 2011. "Are Internet surveys an alternative to face-to-face interviews in contingent valuation?," Ecological Economics, Elsevier, vol. 70(9), pages 1628-1637, July.
    16. Olivier Beaumais & Anne Briand & Katrin Millock & Céline Nauges, 2010. "What are Households Willing to Pay for Better Tap Water Quality? A Cross-Country Valuation Study," Documents de travail du Centre d'Economie de la Sorbonne 10051, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    17. Lindhjem, Henrik & Navrud, Ståle, 2008. "Asking for Individual or Household Willingness to Pay for Environmental Goods? Implication for aggregate welfare measures," MPRA Paper 11469, University Library of Munich, Germany.
    18. Malte Welling & Ewa Zawojska & Julian Sagebiel, 2022. "Information, Consequentiality and Credibility in Stated Preference Surveys: A Choice Experiment on Climate Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(1), pages 257-283, May.
    19. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    20. Ahlheim, Michael & Frör, Oliver & Heinke, Antonia & Duc, Nguyen Minh & Dinh, Pham Van, 2010. "Labour as a utility measure in contingent valuation studies: how good is it really?," FZID Discussion Papers 13-2010, University of Hohenheim, Center for Research on Innovation and Services (FZID).

    More about this item

    Keywords

    Internet; contingent valuation; interviews; mode; willingness to pay;
    All these keywords.

    JEL classification:

    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:11471. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.