IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v88y2018icp18-34.html
   My bibliography  Save this article

The link between response time and preference, variance and processing heterogeneity in stated choice experiments

Author

Listed:
  • Campbell, Danny
  • Mørkbak, Morten Raun
  • Olsen, Søren Bøye

Abstract

In this article we utilize the time respondents require to answer a self-administered online stated preference survey. While the effects of response time have been previously explored, this article proposes a different approach that explicitly recognizes the highly equivocal relationship between response time and respondents' choices. In particular, we attempt to disentangle preference, variance and processing heterogeneity and explore whether response time helps to explain these three types of heterogeneity. For this, we divide the data (ordered by response time) into approximately equal-sized subsets, and then derive different class membership probabilities for each subset. We estimate a large number of candidate models and subsequently conduct a frequentist-based model averaging approach using information criteria to derive weights of evidence for each model. Our findings show a clear link between response time and utility coefficients, error variance and processing strategies. Our results thus emphasize the importance of considering response time when modeling stated choice data.

Suggested Citation

  • Campbell, Danny & Mørkbak, Morten Raun & Olsen, Søren Bøye, 2018. "The link between response time and preference, variance and processing heterogeneity in stated choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 18-34.
  • Handle: RePEc:eee:jeeman:v:88:y:2018:i:c:p:18-34
    DOI: 10.1016/j.jeem.2017.10.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069617307349
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2017.10.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hess, Stephane & Train, Kenneth, 2017. "Correlation and scale in mixed logit models," Journal of choice modelling, Elsevier, vol. 23(C), pages 1-8.
    2. Frejinger, E. & Bierlaire, M. & Ben-Akiva, M., 2009. "Sampling of alternatives for route choice modeling," Transportation Research Part B: Methodological, Elsevier, vol. 43(10), pages 984-994, December.
    3. Leon-Gonzalez, Roberto & Scarpa, Riccardo, 2008. "Improving multi-site benefit functions via Bayesian model averaging: A new approach to benefit transfer," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 50-68, July.
    4. Jae Bong Chang & Jayson L. Lusk & F. Bailey Norwood, 2007. "How Closely Do Hypothetical Surveys and Laboratory Experiments Predict Field Behavior?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(2), pages 518-534.
    5. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, September.
    6. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    7. Mara Thiene & Riccardo Scarpa & Jordan Louviere, 2015. "Addressing Preference Heterogeneity, Multiple Scales and Attribute Attendance with a Correlated Finite Mixing Model of Tap Water Choice," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 637-656, November.
    8. Chih-Chien Yang & Chih-Chiang Yang, 2007. "Separating Latent Classes by Information Criteria," Journal of Classification, Springer;The Classification Society, vol. 24(2), pages 183-203, September.
    9. Balcombe, Kelvin & Chalak, Ali & Fraser, Iain, 2009. "Model selection for the mixed logit with Bayesian estimation," Journal of Environmental Economics and Management, Elsevier, vol. 57(2), pages 226-237, March.
    10. Riccardo Scarpa & Timothy J. Gilbride & Danny Campbell & David A. Hensher, 2009. "Modelling attribute non-attendance in choice experiments for rural landscape valuation," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(2), pages 151-174, June.
    11. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    12. Joseph Cook & Marc Jeuland & Brian Maskery & Dale Whittington, 2012. "Giving Stated Preference Respondents “Time to Think”: Results From Four Countries," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 473-496, April.
    13. Swait, Joffre, 2001. "Choice set generation within the generalized extreme value family of discrete choice models," Transportation Research Part B: Methodological, Elsevier, vol. 35(7), pages 643-666, August.
    14. Thiene, Mara & Swait, Joffre & Scarpa, Riccardo, 2017. "Choice set formation for outdoor destinations: The role of motivations and preference discrimination in site selection for the management of public expenditures on protected areas," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 152-173.
    15. Lindhjem, Henrik & Navrud, Ståle, 2011. "Are Internet surveys an alternative to face-to-face interviews in contingent valuation?," Ecological Economics, Elsevier, vol. 70(9), pages 1628-1637, July.
    16. Danny Campbell & David A. Hensher & Riccardo Scarpa, 2011. "Non-attendance to attributes in environmental choice analysis: a latent class specification," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 54(8), pages 1061-1076, December.
    17. John Rose & Iain Black, 2006. "Means matter, but variance matter too: Decomposing response latency influences on variance heterogeneity in stated preference experiments," Marketing Letters, Springer, vol. 17(4), pages 295-310, December.
    18. Stephane Hess & John Rose, 2012. "Can scale and coefficient heterogeneity be separated in random coefficients models?," Transportation, Springer, vol. 39(6), pages 1225-1239, November.
    19. Schwappach, David L.B. & Strasmann, Thomas J., 2006. ""Quick and dirty numbers"?: The reliability of a stated-preference technique for the measurement of preferences for resource allocation," Journal of Health Economics, Elsevier, vol. 25(3), pages 432-448, May.
    20. Börjesson, Maria & Fosgerau, Mogens, 2015. "Response time patterns in a stated choice experiment," Journal of choice modelling, Elsevier, vol. 14(C), pages 48-58.
    21. Danny Campbell & Morten Raun Mørkbak & Søren Bøye Olsen, 2017. "Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 17-35, January.
    22. Arvin B. Vista & Randall S. Rosenberger & Alan R. Collins, 2009. "If You Provide It, Will They Read It? Response Time Effects in a Choice Experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 57(3), pages 365-377, September.
    23. Arne Henningsen & Ott Toomet, 2011. "maxLik: A package for maximum likelihood estimation in R," Computational Statistics, Springer, vol. 26(3), pages 443-458, September.
    24. Danny Campbell & Seda Erdem, 2015. "Position Bias in Best-worst Scaling Surveys: A Case Study on Trust in Institutions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 97(2), pages 526-545.
    25. Hess, Stephane & Stathopoulos, Amanda, 2013. "Linking response quality to survey engagement: A combined random scale and latent variable approach," Journal of choice modelling, Elsevier, vol. 7(C), pages 1-12.
    26. Kaplan, Sigal & Shiftan, Yoram & Bekhor, Shlomo, 2012. "Development and estimation of a semi-compensatory model with a flexible error structure," Transportation Research Part B: Methodological, Elsevier, vol. 46(2), pages 291-304.
    27. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    28. Brown, Thomas C. & Kingsley, David & Peterson, George L. & Flores, Nicholas E. & Clarke, Andrea & Birjulin, Andrej, 2008. "Reliability of individual valuations of public and private goods: Choice consistency, response time, and preference refinement," Journal of Public Economics, Elsevier, vol. 92(7), pages 1595-1606, July.
    29. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    30. Swait, Joffre & Ben-Akiva, Moshe, 1987. "Incorporating random constraints in discrete models of choice set generation," Transportation Research Part B: Methodological, Elsevier, vol. 21(2), pages 91-102, April.
    31. Campbell, Danny & Hensher, David A. & Scarpa, Riccardo, 2014. "Bounding WTP distributions to reflect the ‘actual’ consideration set," Journal of choice modelling, Elsevier, vol. 11(C), pages 4-15.
    32. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Danny Campbell & Seda Erdem, 2019. "Including Opt-Out Options in Discrete Choice Experiments: Issues to Consider," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 12(1), pages 1-14, February.
    2. Imamura, Kohei & Takano, Kohei Takenaka & Kumagai, Naoki H. & Yoshida, Yumi & Yamano, Hiroya & Fujii, Masahiko & Nakashizuka, Tohru & Managi, Shunsuke, 2020. "Valuation of coral reefs in Japan: Willingness to pay for conservation and the effect of information," Ecosystem Services, Elsevier, vol. 46(C).
    3. Edenbrandt, Anna Kristina & Lagerkvist, Carl-Johan & Lüken, Malte & Orquin, Jacob L., 2022. "Seen but not considered? Awareness and consideration in choice analysis," Journal of choice modelling, Elsevier, vol. 45(C).
    4. D. Fang & R. M. Nayga & H. A. Snell & G. H. West & C. Bazzani, 2019. "Evaluating USA’s New Nutrition and Supplement Facts Label: Evidence from a Non-hypothetical Choice Experiment," Journal of Consumer Policy, Springer, vol. 42(4), pages 545-562, December.
    5. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    6. Erlend Dancke Sandorf, 2019. "Did You Miss Something? Inattentive Respondents in Discrete Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(4), pages 1197-1235, August.
    7. Börger, Tobias & Ngoc, Quach Thi Khanh & Kuhfuss, Laure & Hien, Tang Thi & Hanley, Nick & Campbell, Danny, 2021. "Preferences for coastal and marine conservation in Vietnam: Accounting for differences in individual choice set formation," Ecological Economics, Elsevier, vol. 180(C).
    8. Lagerkvist, C.J. & Edenbrandt, A.K. & Tibbelin, I. & Wahlstedt, Y., 2020. "Preferences for sustainable and responsible equity funds - A choice experiment with Swedish private investors," Journal of Behavioral and Experimental Finance, Elsevier, vol. 28(C).
    9. Thao Thai & Michiel Bliemer & Gang Chen & Jean Spinks & Sonja de New & Emily Lancsar, 2023. "Comparison of a full and partial choice set design in a labeled discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1284-1304, June.
    10. Fraser, Iain & Balcombe, Kelvin & Williams, Louis & McSorley, Eugene, 2021. "Preference stability in discrete choice experiments. Some evidence using eye-tracking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    11. Erdem, Seda, 2018. "Who do UK consumers trust for information about nanotechnology?," Food Policy, Elsevier, vol. 77(C), pages 133-142.
    12. Mokas, Ilias & Lizin, Sebastien & Brijs, Tom & Witters, Nele & Malina, Robert, 2021. "Can immersive virtual reality increase respondents’ certainty in discrete choice experiments? A comparison with traditional presentation formats," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    13. Lotito, Gianna & Migheli, Matteo & Ortona, Guido, 2019. "Some Experimental Evidence on Type Stability and Response Times," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201919, University of Turin.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Danny Campbell & Morten Raun Mørkbak & Søren Bøye Olsen, 2017. "Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 17-35, January.
    2. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    3. Sandorf, Erlend Dancke & Persson, Lars & Broberg, Thomas, 2020. "Using an integrated choice and latent variable model to understand the impact of “professional” respondents in a stated preference survey," Resource and Energy Economics, Elsevier, vol. 61(C).
    4. Tobias Börger & Joseph Cook, 2016. "Giving respondents “time to think” reduces response randomness in repeated discrete choice tasks," Discussion Papers in Environment and Development Economics 2016-13, University of St. Andrews, School of Geography and Sustainable Development.
    5. Logar, Ivana & Brouwer, Roy & Campbell, Danny, 2020. "Does attribute order influence attribute-information processing in discrete choice experiments?," Resource and Energy Economics, Elsevier, vol. 60(C).
    6. Kolstoe, Sonja & Naald, Brian Vander & Cohan, Alison, 2022. "A tale of two samples: Understanding WTP differences in the age of social media," Ecosystem Services, Elsevier, vol. 55(C).
    7. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    8. Erlend Dancke Sandorf & Danny Campbell, 2019. "Accommodating satisficing behaviour in stated choice experiments," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(1), pages 133-162.
    9. Chen, Xuqi & Shen, Meng & Gao, Zhifeng, 2017. "Impact of Intra-respondent Variations in Attribute Attendance on Consumer Preference in Food Choice," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258509, Agricultural and Applied Economics Association.
    10. Liebe, Ulf & Glenk, Klaus & Oehlmann, Malte & Meyerhoff, Jürgen, 2015. "Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?," Journal of choice modelling, Elsevier, vol. 14(C), pages 17-31.
    11. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    12. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    13. Kelvin Balcombe & Michail Bitzios & Iain Fraser & Janet Haddock-Fraser, 2014. "Using Attribute Importance Rankings Within Discrete Choice Experiments: An Application to Valuing Bread Attributes," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(2), pages 446-462, June.
    14. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    15. Edenbrandt, Anna Kristina & Lagerkvist, Carl-Johan & Lüken, Malte & Orquin, Jacob L., 2022. "Seen but not considered? Awareness and consideration in choice analysis," Journal of choice modelling, Elsevier, vol. 45(C).
    16. Sandorf, Erlend Dancke & Crastes dit Sourd, Romain & Mahieu, Pierre-Alexandre, 2018. "The effect of attribute-alternative matrix displays on preferences and processing strategies," Journal of choice modelling, Elsevier, vol. 29(C), pages 113-132.
    17. Lien Nguyen & Hanna Jokimäki & Ismo Linnosmaa & Eirini-Christina Saloniki & Laurie Batchelder & Juliette Malley & Hui Lu & Peter Burge & Birgit Trukeschitz & Julien Forder, 2022. "Valuing informal carers’ quality of life using best-worst scaling—Finnish preference weights for the Adult Social Care Outcomes Toolkit for carers (ASCOT-Carer)," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(3), pages 357-374, April.
    18. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    19. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    20. Schmid, Basil & Jokubauskaite, Simona & Aschauer, Florian & Peer, Stefanie & Hössinger, Reinhard & Gerike, Regine & Jara-Diaz, Sergio R. & Axhausen, Kay W., 2019. "A pooled RP/SP mode, route and destination choice model to investigate mode and user-type effects in the value of travel time savings," Transportation Research Part A: Policy and Practice, Elsevier, vol. 124(C), pages 262-294.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:88:y:2018:i:c:p:18-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.