IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v129y2016icp50-61.html
   My bibliography  Save this article

Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos

Author

Listed:
  • Sandorf, Erlend Dancke
  • Aanesen, Margrethe
  • Navrud, Ståle

Abstract

We compare two discrete choice experiments eliciting willingness-to-pay (WTP) for increased cold-water coral protection in Norway using valuation workshops and an internet panel survey with videos. The video presentation provides the same visual presentation of information about the good and valuation task as in the valuation workshop. In doing so, we are the first to compare these survey modes. The two survey modes perform equally well with respect to sampling, but the internet survey gives significantly lower WTP estimates. We identify a large number of status quo (SQ) choosers in the internet survey that partly explain this result. Furthermore, respondents who speed through the survey questionnaire, and believe the survey to be inconsequential are more likely to be SQ choosers. While an internet survey is a fast and cost-effective way of obtaining a representative population sample, the potential biases in the valuation of complex and unknown environmental goods outlined here should be carefully addressed in future internet panel surveys.

Suggested Citation

  • Sandorf, Erlend Dancke & Aanesen, Margrethe & Navrud, Ståle, 2016. "Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos," Ecological Economics, Elsevier, vol. 129(C), pages 50-61.
  • Handle: RePEc:eee:ecolec:v:129:y:2016:i:c:p:50-61
    DOI: 10.1016/j.ecolecon.2016.06.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S092180091530389X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ecolecon.2016.06.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    2. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    3. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    4. Christopher G. Leggett & Naomi S. Kleckner & Kevin J. Boyle & John W. Dufield & Robert Cameron Mitchell, 2003. "Social Desirability Bias in Contingent Valuation Surveys Administered Through In-Person Interviews," Land Economics, University of Wisconsin Press, vol. 79(4), pages 561-575.
    5. Jobstvogt, Niels & Hanley, Nick & Hynes, Stephen & Kenter, Jasper & Witte, Ursula, 2014. "Twenty thousand sterling under the sea: Estimating the value of protecting deep-sea biodiversity," Ecological Economics, Elsevier, vol. 97(C), pages 10-19.
    6. Jill Windle & John Rolfe, 2011. "Comparing Responses from Internet and Paper-Based Collection Methods in more Complex Stated Preference Environmental Valuation Surveys," Economic Analysis and Policy, Elsevier, vol. 41(1), pages 83-97, March.
    7. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    8. Lindhjem, Henrik & Navrud, Ståle, 2011. "Are Internet surveys an alternative to face-to-face interviews in contingent valuation?," Ecological Economics, Elsevier, vol. 70(9), pages 1628-1637, July.
    9. Alvarez-Farizo, Begona & Hanley, Nick & Barberan, Ramon & Lazaro, Angelina, 2007. "Choice modeling at the "market stall": Individual versus collective interest in environmental valuation," Ecological Economics, Elsevier, vol. 60(4), pages 743-751, February.
    10. Ulf Liebe & Jürgen Meyerhoff & Volkmar Hartje, 2012. "Test–Retest Reliability of Choice Experiments in Environmental Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(3), pages 389-407, November.
    11. Scarpa, R. & Thiene, M. & Train, K., 2008. "Appendix to Utility in WTP space: a tool to address confounding random scale effects in destination choice to the Alps," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 90(4), pages 1-9, January.
    12. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    13. Macmillan, Douglas C. & Philip, Lorna & Hanley, Nick & Alvarez-Farizo, Begona, 2002. "Valuing the non-market benefits of wild goose conservation: a comparison of interview and group based approaches," Ecological Economics, Elsevier, vol. 43(1), pages 49-59, November.
    14. Adamowicz W. & Louviere J. & Williams M., 1994. "Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities," Journal of Environmental Economics and Management, Elsevier, vol. 26(3), pages 271-292, May.
    15. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387.
    16. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    17. David A. Hensher & William H. Greene, 2011. "Valuation of Travel Time Savings in WTP and Preference Space in the Presence of Taste and Scale Heterogeneity," Journal of Transport Economics and Policy, University of Bath, vol. 45(3), pages 505-525, September.
    18. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    19. Denzil G. Fiebig & Michael P. Keane & Jordan Louviere & Nada Wasi, 2010. "The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity," Marketing Science, INFORMS, vol. 29(3), pages 393-421, 05-06.
    20. MacMillan, Douglas & Hanley, Nick & Lienhoop, Nele, 2006. "Contingent valuation: Environmental polling or preference engine?," Ecological Economics, Elsevier, vol. 60(1), pages 299-307, November.
    21. LaRiviere, Jacob & Czajkowski, Mikołaj & Hanley, Nick & Aanesen, Margrethe & Falk-Petersen, Jannike & Tinch, Dugald, 2014. "The value of familiarity: Effects of knowledge and objective signals on willingness to pay for a public good," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 376-389.
    22. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    23. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    24. Aanesen, Margrethe & Armstrong, Claire & Czajkowski, Mikołaj & Falk-Petersen, Jannike & Hanley, Nick & Navrud, Ståle, 2015. "Willingness to pay for unfamiliar public goods: Preserving cold-water coral in Norway," Ecological Economics, Elsevier, vol. 112(C), pages 53-67.
    25. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    26. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, vol. 94(3), pages 741-752, June.
    27. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    28. F. Bailey Norwood & Jayson L. Lusk, 2011. "Social Desirability Bias in Real, Hypothetical, and Inferred Valuation Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(2), pages 528-534.
    29. LaRiviere, Jacob & Czajkowski, Mikolaj & Hanley, Nick & Aanesen, Margrethe & Falk-Peterson, Jannike & Tinch, Dugald, 2014. "Effects of Experience, Knowledge and Signals on Willingness to Pay for a Public Good," SIRE Discussion Papers 2014-008, Scottish Institute for Research in Economics (SIRE).
    30. Begoña Álvarez-Farizo & Nick Hanley, 2006. "Improving the Process of Valuing Non-Market Benefits: Combining Citizens’ Juries with Choice Modelling," Land Economics, University of Wisconsin Press, vol. 82(3), pages 465-478.
    31. Andrew Daly & Stephane Hess & Kenneth Train, 2012. "Assuring finite moments for willingness to pay in random coefficient models," Transportation, Springer, vol. 39(1), pages 19-31, January.
    32. Bhat, Chandra R., 2003. "Simulation estimation of mixed discrete choice models using randomized and scrambled Halton sequences," Transportation Research Part B: Methodological, Elsevier, vol. 37(9), pages 837-855, November.
    33. Correia, Gonçalo & Viegas, José Manuel, 2011. "Carpooling and carpool clubs: Clarifying concepts and assessing value enhancement possibilities through a Stated Preference web survey in Lisbon, Portugal," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(2), pages 81-90, February.
    34. Riccardo Scarpa & Mara Thiene & Kenneth Train, 2008. "Utility in Willingness to Pay Space: A Tool to Address Confounding Random Scale Effects in Destination Choice to the Alps," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(4), pages 994-1010.
    35. Glenn, H. & Wattage, P. & Mardle, S. & Rensburg, T. Van & Grehan, A. & Foley, N., 2010. "Marine protected areas--substantiating their worth," Marine Policy, Elsevier, vol. 34(3), pages 421-430, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zawojska, Ewa & Czajkowski, Mikotaj, 2017. "Are preferences stated in web vs. personal interviews different? A comparison of willingness to pay results for a large multi-country study of the Baltic Sea eutrophication reduction," Annual Meeting, 2017, June 18-21, Montreal, Canada 258604, Canadian Agricultural Economics Society.
    2. John C. Whitehead, "undated". "A Comment on “An Adding Up Test on Contingent Valuations of River and Lake Quality”," Working Papers 17-01_R, Department of Economics, Appalachian State University.
    3. Imamura, Kohei & Takano, Kohei Takenaka & Kumagai, Naoki H. & Yoshida, Yumi & Yamano, Hiroya & Fujii, Masahiko & Nakashizuka, Tohru & Managi, Shunsuke, 2020. "Valuation of coral reefs in Japan: Willingness to pay for conservation and the effect of information," Ecosystem Services, Elsevier, vol. 46(C).
    4. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Dugstad, Anders & Grimsrud, Kristine & Kipperberg, Gorm & Lindhjem, Henrik & Navrud, Ståle, 2020. "Acceptance of wind power development and exposure – Not-in-anybody's-backyard," Energy Policy, Elsevier, vol. 147(C).
    6. Anders Dugstad & Kristine Grimsrud & Gorm Kipperberg & Henrik Lindhjem & Ståle Navrud, 2020. "Acceptance of national wind power development and exposure. A case-control choice experiment approach," Discussion Papers 933, Statistics Norway, Research Department.
    7. Erlend Dancke Sandorf, 2019. "Did You Miss Something? Inattentive Respondents in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(4), pages 1197-1235, August.
    8. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    9. Melo, Grace & Sanhueza, Dérgica & Morales, Sarahi & Pena-Levano, Luis, 2021. "What does the Pandemic Mean for Experiential Learning? Lessons from Latin America," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 3(3), September.
    10. Sandorf, Erlend Dancke & Campbell, Danny & Hanley, Nick, 2017. "Disentangling the influence of knowledge on attribute non-attendance," Journal of choice modelling, Elsevier, vol. 24(C), pages 36-50.
    11. Mikołaj Czajkowski & Ewa Zawojska & Norman Meade & Ronaldo Seroa da Motta & Mike Welsh & Ramon Arigoni Ortiz, 2022. "On the inference about willingness to pay distribution using contingent valuation data," Working Papers 2022-08, Faculty of Economic Sciences, University of Warsaw.
    12. Zawojska, Ewa & Gastineau, Pascal & Mahieu, Pierre-Alexandre & Cheze, Benoit & Paris, Anthony, 2021. "Measuring policy consequentiality perceptions in stated preference surveys," 2021 Annual Meeting, August 1-3, Austin, Texas 313977, Agricultural and Applied Economics Association.
    13. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    14. Skeie, Magnus Aa. & Lindhjem, Henrik & Skjeflo, Sofie & Navrud, Ståle, 2019. "Smartphone and tablet effects in contingent valuation web surveys – No reason to worry?," Ecological Economics, Elsevier, vol. 165(C), pages 1-1.
    15. Oleg Sheremet & John R. Healey & Christopher P. Quine & Nick Hanley, 2017. "Public Preferences and Willingness to Pay for Forest Disease Control in the UK," Journal of Agricultural Economics, Wiley Blackwell, vol. 68(3), pages 781-800, September.
    16. Erlend Dancke Sandorf & Kristine Grimsrud & Henrik Lindhjem, 2022. "Ponderous, Proficient or Professional? Survey Experience and Smartphone Effects in Stated Preference Research," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 81(4), pages 807-832, April.
    17. Ruokamo, Enni & Kopsakangas-Savolainen, Maria & Meriläinen, Teemu & Svento, Rauli, 2019. "Towards flexible energy demand – Preferences for dynamic contracts, services and emissions reductions," Energy Economics, Elsevier, vol. 84(C).
    18. Klauer, Bernd & Bartkowski, Bartosz & Manstetten, Reiner & Petersen, Thomas, 2017. "Sustainability as a Fair Bequest: An Evaluation Challenge," Ecological Economics, Elsevier, vol. 141(C), pages 136-143.
    19. Bartkowski, Bartosz, 2017. "Are diverse ecosystems more valuable? Economic value of biodiversity as result of uncertainty and spatial interactions in ecosystem service provision," Ecosystem Services, Elsevier, vol. 24(C), pages 50-57.
    20. Wanek, Eva & Bartkowski, Bartosz & Bourgeois-Gironde, Sacha & Schaafsma, Marije, 2023. "Deliberately vague or vaguely deliberative: A review of motivation and design choices in deliberative monetary valuation studies," Ecological Economics, Elsevier, vol. 208(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Sandorf, Erlend Dancke & Campbell, Danny & Hanley, Nick, 2017. "Disentangling the influence of knowledge on attribute non-attendance," Journal of choice modelling, Elsevier, vol. 24(C), pages 36-50.
    3. Aanesen, Margrethe & Armstrong, Claire & Czajkowski, Mikołaj & Falk-Petersen, Jannike & Hanley, Nick & Navrud, Ståle, 2015. "Willingness to pay for unfamiliar public goods: Preserving cold-water coral in Norway," Ecological Economics, Elsevier, vol. 112(C), pages 53-67.
    4. Makriyannis, Christos & Johnston, Robert, 2016. "Welfare Analysis for Climate Risk Reductions: Are Current Treatments of Outcome Uncertainty Sufficient?," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235532, Agricultural and Applied Economics Association.
    5. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    6. Erlend Dancke Sandorf, 2019. "Did You Miss Something? Inattentive Respondents in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(4), pages 1197-1235, August.
    7. Malte Welling & Ewa Zawojska & Julian Sagebiel, 2022. "Information, Consequentiality and Credibility in Stated Preference Surveys: A Choice Experiment on Climate Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(1), pages 257-283, May.
    8. Tobias Börger & Oliver Frör & Sören Weiß, 2017. "The relationship between perceived difficulty and randomness in discrete choice experiments: Investigating reasons for and consequences of difficulty," Discussion Papers in Environment and Development Economics 2017-03, University of St. Andrews, School of Geography and Sustainable Development.
    9. Nick Hanley & Mikołaj Czajkowski, 2017. "Stated Preference valuation methods: an evolving tool for understanding choices and informing policy," Working Papers 2017-01, Faculty of Economic Sciences, University of Warsaw.
    10. Holland, Benedict M. & Johnston, Robert J., 2017. "Optimized quantity-within-distance models of spatial welfare heterogeneity," Journal of Environmental Economics and Management, Elsevier, vol. 85(C), pages 110-129.
    11. Gillespie Rob & Kragt Marit E., 2012. "Accounting for Nonmarket Impacts in a Benefit-Cost Analysis of Underground Coal Mining in New South Wales, Australia," Journal of Benefit-Cost Analysis, De Gruyter, vol. 3(2), pages 1-29, May.
    12. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    13. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    14. Ajayi, V. & Reiner, D., 2020. "Consumer Willingness to Pay for Reducing the Environmental Footprint of Green Plastics," Cambridge Working Papers in Economics 20110, Faculty of Economics, University of Cambridge.
    15. Zhifeng Gao & Lisa A. House & Jing Xie, 2016. "Online Survey Data Quality and Its Implication for Willingness-to-Pay: A Cross-Country Comparison," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(2), pages 199-221, June.
    16. repec:sss:wpaper:201404 is not listed on IDEAS
    17. Czajkowski, Mikołaj & Vossler, Christian A. & Budziński, Wiktor & Wiśniewska, Aleksandra & Zawojska, Ewa, 2017. "Addressing empirical challenges related to the incentive compatibility of stated preferences methods," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 47-63.
    18. Soliño, M. & Alía, R. & Agúndez, D., 2020. "Citizens' preferences for research programs on forest genetic resources: A case applied to Pinus pinaster Ait. in Spain," Forest Policy and Economics, Elsevier, vol. 118(C).
    19. Zemo, Kahsay Haile & Termansen, Mette, 2018. "Farmers’ willingness to participate in collective biogas investment: A discrete choice experiment study," Resource and Energy Economics, Elsevier, vol. 52(C), pages 87-101.
    20. Mikołaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2016. "Controlling for the Effects of Information in a Public Goods Discrete Choice Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(3), pages 523-544, March.
    21. Liebe, Ulf & Glenk, Klaus & Oehlmann, Malte & Meyerhoff, Jürgen, 2015. "Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?," Journal of choice modelling, Elsevier, vol. 14(C), pages 17-31.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:129:y:2016:i:c:p:50-61. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.