IDEAS home Printed from https://ideas.repec.org/a/taf/teepxx/v6y2017i1p17-35.html
   My bibliography  Save this article

Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents

Author

Listed:
  • Danny Campbell
  • Morten Raun Mørkbak
  • Søren Bøye Olsen

Abstract

In this paper, we use paradata relating to the length of time respondents required in a self-administered online stated preference surveys. Although this issue has been previously explored, there is little guidance on how to identify and deal with ‘fast’ and ‘slow’ respondents. In this paper, we use scale-adjusted latent class models to address preference and variance heterogeneity and explore how class membership varies with response latency. To test our methodology, we use stated choice data collected via an online survey to establish German anglers’ preferences for fishing site attributes in Denmark. Results from our analysis corroborate that response latency has a bearing on the estimates of utility coefficients and the error variance. Although the results highlight the non-triviality of identifying fast and slow respondents, they signal the need to estimate a large number of candidate models to identify the most appropriate ‘fast’ and ‘slow’ thresholds. Not doing so is likely to lead to an inferior model and has repercussions for marginal willingness to pay estimates and choice predictions.

Suggested Citation

  • Danny Campbell & Morten Raun Mørkbak & Søren Bøye Olsen, 2017. "Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 17-35, January.
  • Handle: RePEc:taf:teepxx:v:6:y:2017:i:1:p:17-35
    DOI: 10.1080/21606544.2016.1167632
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/21606544.2016.1167632
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/21606544.2016.1167632?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    2. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    3. Joseph Cook & Marc Jeuland & Brian Maskery & Dale Whittington, 2012. "Giving Stated Preference Respondents “Time to Think”: Results From Four Countries," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 473-496, April.
    4. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    5. Brown, Thomas C. & Kingsley, David & Peterson, George L. & Flores, Nicholas E. & Clarke, Andrea & Birjulin, Andrej, 2008. "Reliability of individual valuations of public and private goods: Choice consistency, response time, and preference refinement," Journal of Public Economics, Elsevier, vol. 92(7), pages 1595-1606, July.
    6. Danny Campbell & David A. Hensher & Riccardo Scarpa, 2011. "Non-attendance to attributes in environmental choice analysis: a latent class specification," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 54(8), pages 1061-1076, December.
    7. MacMillan, Douglas & Hanley, Nick & Lienhoop, Nele, 2006. "Contingent valuation: Environmental polling or preference engine?," Ecological Economics, Elsevier, vol. 60(1), pages 299-307, November.
    8. John Rose & Iain Black, 2006. "Means matter, but variance matter too: Decomposing response latency influences on variance heterogeneity in stated preference experiments," Marketing Letters, Springer, vol. 17(4), pages 295-310, December.
    9. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    10. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    11. Arvin B. Vista & Randall S. Rosenberger & Alan R. Collins, 2009. "If You Provide It, Will They Read It? Response Time Effects in a Choice Experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 57(3), pages 365-377, September.
    12. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pauline Laille & Marianne Lefebvre & Masha Maslianskaia-Pautrel, 2020. "Individual preferences regarding pesticide-free management of green-spaces: a discret choice experiment with French citizens," Working Papers hal-02867639, HAL.
    2. Sandorf, Erlend Dancke & Persson, Lars & Broberg, Thomas, 2020. "Using an integrated choice and latent variable model to understand the impact of “professional” respondents in a stated preference survey," Resource and Energy Economics, Elsevier, vol. 61(C).
    3. D. Fang & R. M. Nayga & H. A. Snell & G. H. West & C. Bazzani, 2019. "Evaluating USA’s New Nutrition and Supplement Facts Label: Evidence from a Non-hypothetical Choice Experiment," Journal of Consumer Policy, Springer, vol. 42(4), pages 545-562, December.
    4. Tobias Holmsgaard Larsen & Thomas Lundhede & Søren Bøye Olsen & Brian H. Jacobsen, 2021. "Incorporating time lags and uncertainty in cost-benefit analysis of water quality improvements – a case study of Limfjorden, Denmark," IFRO Working Paper 2021/01, University of Copenhagen, Department of Food and Resource Economics.
    5. Tobias Holmsgaard Larsen & Thomas Lundhede & Søren Bøye Olsen, 2020. "Assessing the value of surface water and groundwater quality improvements when time lags and outcome uncertainty exist: Results from a choice experiment survey across four different countries," IFRO Working Paper 2020/12, University of Copenhagen, Department of Food and Resource Economics.
    6. Marianne Lefebvre & Masha Maslianskaia Pautrel & Pauline Laille, 2018. "Public preferences for pesticide-free urban green spaces: a socio-economic survey [Acceptation du "Zéro-pesticides" dans les espaces publics : Étude socio-économique]," Working Papers hal-02519184, HAL.
    7. Campbell, Danny & Mørkbak, Morten Raun & Olsen, Søren Bøye, 2018. "The link between response time and preference, variance and processing heterogeneity in stated choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 18-34.
    8. Erlend Dancke Sandorf & Kristine Grimsrud & Henrik Lindhjem, 2022. "Ponderous, Proficient or Professional? Survey Experience and Smartphone Effects in Stated Preference Research," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 81(4), pages 807-832, April.
    9. Jang, Sunghoon & Rasouli, Soora & Timmermans, Harry, 2022. "The effect of task complexity on stated choice processes: The moderating role of cognitive ability," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 163(C).
    10. Marianne Lefebvre & Pauline Laille & Masha Maslianskaia-Pautrel, 2020. "Individual preferences regarding pesticide-free management of green-spaces: a discret choice experiment with French citizens," Working Papers 2020.02, FAERE - French Association of Environmental and Resource Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Campbell, Danny & Mørkbak, Morten Raun & Olsen, Søren Bøye, 2018. "The link between response time and preference, variance and processing heterogeneity in stated choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 18-34.
    2. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    3. Erlend Dancke Sandorf & Danny Campbell, 2019. "Accommodating satisficing behaviour in stated choice experiments," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(1), pages 133-162.
    4. Chen, Xuqi & Shen, Meng & Gao, Zhifeng, 2017. "Impact of Intra-respondent Variations in Attribute Attendance on Consumer Preference in Food Choice," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258509, Agricultural and Applied Economics Association.
    5. Jacob LaRiviere & Mikolaj Czajkowski & Nick Hanley & Katherine Simpson, 2016. "What is the Causal Impact of Knowledge on Preferences in Stated Preference Studies?," Working Papers 2016-12, Faculty of Economic Sciences, University of Warsaw.
    6. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    7. Johannes Lohse & Timo Goeschl & Johannes H. Diederich, 2017. "Giving is a Question of Time: Response Times and Contributions to an Environmental Public Good," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 67(3), pages 455-477, July.
    8. Mikołaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2016. "Controlling for the Effects of Information in a Public Goods Discrete Choice Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(3), pages 523-544, March.
    9. Gianna Lotito & Matteo Migheli & Guido Ortona, 2013. "Is cooperation instinctive? Evidence from the response times in a public goods game," Journal of Bioeconomics, Springer, vol. 15(2), pages 123-133, July.
    10. Migheli, Matteo, 2014. "Reaction Times in a Field Experiment: Is Really All about Instinctiveness," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201424, University of Turin.
    11. repec:sss:wpaper:201404 is not listed on IDEAS
    12. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    13. Tobias Börger & Joseph Cook, 2016. "Giving respondents “time to think” reduces response randomness in repeated discrete choice tasks," Discussion Papers in Environment and Development Economics 2016-13, University of St. Andrews, School of Geography and Sustainable Development.
    14. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    15. Sandorf, Erlend Dancke & Aanesen, Margrethe & Navrud, Ståle, 2016. "Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos," Ecological Economics, Elsevier, vol. 129(C), pages 50-61.
    16. Lindhjem, Henrik & Navrud, Ståle, 2011. "Are Internet surveys an alternative to face-to-face interviews in contingent valuation?," Ecological Economics, Elsevier, vol. 70(9), pages 1628-1637, July.
    17. Kelvin Balcombe & Michail Bitzios & Iain Fraser & Janet Haddock-Fraser, 2014. "Using Attribute Importance Rankings Within Discrete Choice Experiments: An Application to Valuing Bread Attributes," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(2), pages 446-462, June.
    18. Yamada, Katsunori & Sato, Masayuki, 2013. "Another avenue for anatomy of income comparisons: Evidence from hypothetical choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 35-57.
    19. Zawojska, Ewa & Czajkowski, Mikotaj, 2017. "Are preferences stated in web vs. personal interviews different? A comparison of willingness to pay results for a large multi-country study of the Baltic Sea eutrophication reduction," Annual Meeting, 2017, June 18-21, Montreal, Canada 258604, Canadian Agricultural Economics Society.
    20. Ispano, Alessandro & Schwardmann, Peter, 2017. "Cooperating over losses and competing over gains: A social dilemma experiment," Games and Economic Behavior, Elsevier, vol. 105(C), pages 329-348.
    21. Kerstin K Zander & Gillian B Ainsworth & Jürgen Meyerhoff & Stephen T Garnett, 2014. "Threatened Bird Valuation in Australia," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-9, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:teepxx:v:6:y:2017:i:1:p:17-35. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/teep20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.