IDEAS home Printed from https://ideas.repec.org/p/sss/wpaper/2017-03.html
   My bibliography  Save this paper

The relationship between perceived difficulty and randomness in discrete choice experiments: Investigating reasons for and consequences of difficulty

Author

Listed:
  • Tobias Börger

    (School of Geography and Sustainable Development, University of St. Andrews)

  • Oliver Frör

    (Institute of Environmental Sciences, University of Koblenz-Landau, Germany)

  • Sören Weiß

    (Institute of Environmental Sciences, University of Koblenz-Landau, Germany)

Abstract

Discrete choice experiments to value environmental goods and services constitute a complex and demanding task for survey respondents. This study looks at the effect of perceived difficulty with the choice tasks on choice consistency and preferences. The choice data come from two parallel surveys valuing river management outcomes in Germany. Results show that perceived difficulty decreases response scale, an indicator of the relative weight of the explained over the random component of indirect utility of a choice alternative. The reasons for this effect have more to do with the design of the actual task in the choice experiment than with the content and topic of the valuation exercise. Results also show only a very limited effect on preferences and willingness to pay for aspects of river management. The proposed econometric strategy manages to effectively separate the effect of difficulty on inter-individual differences of preference and scale. Based on these results, we recommend (i) to rigorously test the attribute design to allow only meaningful trade-offs as perceived by respondents and (ii)to put greater emphasis on the explanation of the choice tasks.

Suggested Citation

  • Tobias Börger & Oliver Frör & Sören Weiß, 2017. "The relationship between perceived difficulty and randomness in discrete choice experiments: Investigating reasons for and consequences of difficulty," Discussion Papers in Environment and Development Economics 2017-03, University of St. Andrews, School of Geography and Sustainable Development.
  • Handle: RePEc:sss:wpaper:2017-03
    as

    Download full text from publisher

    File URL: http://www.st-andrews.ac.uk/media/dept-of-geography-and-sustainable-development/pdf-s/DP%202017-03%20Borger%20et%20al.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Czajkowski, Mikołaj & Kądziela, Tadeusz & Hanley, Nick, 2014. "We want to sort! Assessing households’ preferences for sorting waste," Resource and Energy Economics, Elsevier, vol. 36(1), pages 290-306.
    2. Sandorf, Erlend Dancke & Campbell, Danny & Hanley, Nick, 2017. "Disentangling the influence of knowledge on attribute non-attendance," Journal of choice modelling, Elsevier, vol. 24(C), pages 36-50.
    3. Boxall, Peter C. & Adamowicz, Wiktor L. & Moon, Amanda, 2009. "Complexity in choice experiments: choice of the status quo alternative and implications for welfare measurement," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 53(4), pages 1-17.
    4. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
    5. Nick Hanley & Robert Wright & Vic Adamowicz, 1998. "Using Choice Experiments to Value the Environment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 11(3), pages 413-428, April.
    6. Börger, Tobias & Hattam, Caroline & Burdon, Daryl & Atkins, Jonathan P. & Austen, Melanie C., 2014. "Valuing conservation benefits of an offshore marine protected area," Ecological Economics, Elsevier, vol. 108(C), pages 229-241.
    7. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    8. K. G. Mäler & J. R. Vincent (ed.), 2005. "Handbook of Environmental Economics," Handbook of Environmental Economics, Elsevier, edition 1, volume 3, number 3.
    9. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    10. Jobstvogt, Niels & Hanley, Nick & Hynes, Stephen & Kenter, Jasper & Witte, Ursula, 2014. "Twenty thousand sterling under the sea: Estimating the value of protecting deep-sea biodiversity," Ecological Economics, Elsevier, vol. 97(C), pages 10-19.
    11. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    12. Erik Meijer & Jan Rouwendal, 2006. "Measuring welfare effects in models with random coefficients," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(2), pages 227-244, March.
    13. Norton, Daniel & Hynes, Stephen, 2014. "Valuing the non-market benefits arising from the implementation of the EU Marine Strategy Framework Directive," Ecosystem Services, Elsevier, vol. 10(C), pages 84-96.
    14. Fredrik Carlsson & Peter Martinsson, 2008. "How Much is Too Much?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 40(2), pages 165-176, June.
    15. Beck, Matthew J. & Rose, John M. & Hensher, David A., 2013. "Consistently inconsistent: The role of certainty, acceptability and scale in choice," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 56(C), pages 81-93.
    16. Carson, Richard T. & Czajkowski, Mikołaj, 2019. "A new baseline model for estimating willingness to pay from discrete choice models," Journal of Environmental Economics and Management, Elsevier, vol. 95(C), pages 57-61.
    17. David A. Hensher, 2004. "Identifying the Influence of Stated Choice Design Dimensionality on Willingness to Pay for Travel Time Savings," Journal of Transport Economics and Policy, University of Bath, vol. 38(3), pages 425-446, September.
    18. Rose, John M. & Hensher, David A. & Caussade, Sebastian & Ortúzar, Juan de Dios & Jou, Rong-Chang, 2009. "Identifying differences in willingness to pay due to dimensionality in stated choice experiments: a cross country analysis," Journal of Transport Geography, Elsevier, vol. 17(1), pages 21-29.
    19. Heiner, Ronald A, 1983. "The Origin of Predictable Behavior," American Economic Review, American Economic Association, vol. 73(4), pages 560-595, September.
    20. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    21. McVittie, Alistair & Moran, Dominic, 2010. "Valuing the non-use benefits of marine conservation zones: An application to the UK Marine Bill," Ecological Economics, Elsevier, vol. 70(2), pages 413-424, December.
    22. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    23. Mikolaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2015. "The Effects of Experience on Preferences: Theory and Empirics for Environmental Public Goods," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(1), pages 333-351.
    24. Arentze, Theo & Borgers, Aloys & Timmermans, Harry & DelMistro, Romano, 2003. "Transport stated choice responses: effects of task complexity, presentation format and literacy," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 39(3), pages 229-244, May.
    25. Jette Jacobsen & John Boiesen & Bo Thorsen & Niels Strange, 2008. "What’s in a name? The use of quantitative measures versus ‘Iconised’ species when valuing biodiversity," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 39(3), pages 247-263, March.
    26. Adamowicz W. & Louviere J. & Williams M., 1994. "Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities," Journal of Environmental Economics and Management, Elsevier, vol. 26(3), pages 271-292, May.
    27. Riccardo Scarpa & Mara Thiene, 2005. "Destination Choice Models for Rock Climbing in the Northeastern Alps: A Latent-Class Approach Based on Intensity of Preferences," Land Economics, University of Wisconsin Press, vol. 81(3).
    28. Wiktor Adamowicz & Peter Boxall & Michael Williams & Jordan Louviere, 1998. "Stated Preference Approaches for Measuring Passive Use Values: Choice Experiments and Contingent Valuation," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(1), pages 64-75.
    29. Denzil G. Fiebig & Michael P. Keane & Jordan Louviere & Nada Wasi, 2010. "The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity," Marketing Science, INFORMS, vol. 29(3), pages 393-421, 05-06.
    30. Campbell, Danny, 2007. "Combining mixed logit models and random effects models to identify the determinants of willingness to pay for rural landscape improvements," 81st Annual Conference, April 2-4, 2007, Reading University, UK 7975, Agricultural Economics Society.
    31. Danny Campbell, 2007. "Willingness to Pay for Rural Landscape Improvements: Combining Mixed Logit and Random‐Effects Models," Journal of Agricultural Economics, Wiley Blackwell, vol. 58(3), pages 467-483, September.
    32. Mikołaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2016. "Controlling for the Effects of Information in a Public Goods Discrete Choice Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(3), pages 523-544, March.
    33. Stephane Hess & John Rose, 2012. "Can scale and coefficient heterogeneity be separated in random coefficients models?," Transportation, Springer, vol. 39(6), pages 1225-1239, November.
    34. LaRiviere, Jacob & Czajkowski, Mikołaj & Hanley, Nick & Aanesen, Margrethe & Falk-Petersen, Jannike & Tinch, Dugald, 2014. "The value of familiarity: Effects of knowledge and objective signals on willingness to pay for a public good," Journal of Environmental Economics and Management, Elsevier, vol. 68(2), pages 376-389.
    35. Arne Risa Hole, 2007. "Fitting mixed logit models by using maximum simulated likelihood," Stata Journal, StataCorp LP, vol. 7(3), pages 388-401, September.
    36. Boxall, Peter C. & Adamowicz, Wiktor L. & Swait, Joffre & Williams, Michael & Louviere, Jordan, 1996. "A comparison of stated preference methods for environmental valuation," Ecological Economics, Elsevier, vol. 18(3), pages 243-253, September.
    37. Aanesen, Margrethe & Armstrong, Claire & Czajkowski, Mikołaj & Falk-Petersen, Jannike & Hanley, Nick & Navrud, Ståle, 2015. "Willingness to pay for unfamiliar public goods: Preserving cold-water coral in Norway," Ecological Economics, Elsevier, vol. 112(C), pages 53-67.
    38. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    39. Yuanyuan Gu & Arne Risa Hole & Stephanie Knox, 2013. "Fitting the generalized multinomial logit model in Stata," Stata Journal, StataCorp LP, vol. 13(2), pages 382-397, June.
    40. LaRiviere, Jacob & Czajkowski, Mikolaj & Hanley, Nick & Aanesen, Margrethe & Falk-Peterson, Jannike & Tinch, Dugald, 2014. "Effects of Experience, Knowledge and Signals on Willingness to Pay for a Public Good," SIRE Discussion Papers 2014-008, Scottish Institute for Research in Economics (SIRE).
    41. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    42. Yao, Richard T. & Scarpa, Riccardo & Turner, James A. & Barnard, Tim D. & Rose, John M. & Palma, João H.N. & Harrison, Duncan R., 2014. "Valuing biodiversity enhancement in New Zealand's planted forests: Socioeconomic and spatial determinants of willingness-to-pay," Ecological Economics, Elsevier, vol. 98(C), pages 90-101.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Enni Ruokamo & Mikołaj Czajkowski & Nick Hanley & Artti Juutinen & Rauli Svento, 2016. "Linking perceived choice complexity with scale heterogeneity in discrete choice experiments: home heating in Finland," Working Papers 2016-30, Faculty of Economic Sciences, University of Warsaw.
    3. Tobias Börger & Joseph Cook, 2016. "Giving respondents “time to think” reduces response randomness in repeated discrete choice tasks," Discussion Papers in Environment and Development Economics 2016-13, University of St. Andrews, School of Geography and Sustainable Development.
    4. Nick Hanley & Mikołaj Czajkowski, 2017. "Stated Preference valuation methods: an evolving tool for understanding choices and informing policy," Working Papers 2017-01, Faculty of Economic Sciences, University of Warsaw.
    5. Sever, Ivan & Verbič, Miroslav & Klarić Sever, Eva, 2019. "Cost attribute in health care DCEs: Just adding another attribute or a trigger of change in the stated preferences?," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    6. Jürgen Meyerhoff & Malte Oehlmann & Priska Weller, 2015. "The Influence of Design Dimensions on Stated Choices in an Environmental Context," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 61(3), pages 385-407, July.
    7. Börger, Tobias & Hattam, Caroline, 2017. "Motivations matter: Behavioural determinants of preferences for remote and unfamiliar environmental goods," Ecological Economics, Elsevier, vol. 131(C), pages 64-74.
    8. Mikołaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2016. "Controlling for the Effects of Information in a Public Goods Discrete Choice Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(3), pages 523-544, March.
    9. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    10. Sandorf, Erlend Dancke & Aanesen, Margrethe & Navrud, Ståle, 2016. "Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos," Ecological Economics, Elsevier, vol. 129(C), pages 50-61.
    11. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    12. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    13. Ahtiainen, Heini & Tienhaara, Annika & Pouta, Eija & Czajkowski, Mikolaj, 2017. "Role of information in the valuation of unfamiliar goods – the case of genetic resources in agriculture," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 261423, European Association of Agricultural Economists.
    14. Faccioli, Michela & Czajkowski, Mikołaj & Glenk, Klaus & Martin-Ortega, Julia, 2020. "Environmental attitudes and place identity as determinants of preferences for ecosystem services," Ecological Economics, Elsevier, vol. 174(C).
    15. Börger, Tobias & Hattam, Caroline & Burdon, Daryl & Atkins, Jonathan P. & Austen, Melanie C., 2014. "Valuing conservation benefits of an offshore marine protected area," Ecological Economics, Elsevier, vol. 108(C), pages 229-241.
    16. Yang, Jui-Chen & Johnson, F. Reed & Kilambi, Vikram & Mohamed, Ateesha F., 2015. "Sample size and utility-difference precision in discrete-choice experiments: A meta-simulation approach," Journal of choice modelling, Elsevier, vol. 16(C), pages 50-57.
    17. Weng, Weizhe & Morrison, Mark D. & Boyle, Kevin J. & Boxall, Peter C. & Rose, John, 2021. "Effects of the number of alternatives in public good discrete choice experiments," Ecological Economics, Elsevier, vol. 182(C).
    18. repec:sss:wpaper:201404 is not listed on IDEAS
    19. Barbara Cavalletti & Matteo Corsi & Elena Lagomarsino, 2021. "Marine Sites and the Drivers of Wellbeing: Ecosystem vs. Anthropic Services," Sustainability, MDPI, vol. 13(22), pages 1-14, November.
    20. Catalina M. Torres Figuerola & Antoni Riera Font, 2009. "Defining environmental attributes as external costs in choice experiments: A discussion," CRE Working Papers (Documents de treball del CRE) 2009/1, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    21. Rulleau, Bénédicte & Dachary-Bernard, Jeanne, 2012. "Preferences, rational choices and economic valuation: Some empirical tests," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 41(2), pages 198-206.

    More about this item

    Keywords

    Discrete choice experiment; scale heterogeneity; perceived difficulty; river management;
    All these keywords.

    JEL classification:

    • H4 - Public Economics - - Publicly Provided Goods
    • Q25 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - Water
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sss:wpaper:2017-03. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Laure Kuhfuss (email available below). General contact details of provider: https://edirc.repec.org/data/eestauk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.