IDEAS home Printed from https://ideas.repec.org/a/bla/canjag/v57y2009i3p365-377.html
   My bibliography  Save this article

If You Provide It, Will They Read It? Response Time Effects in a Choice Experiment

Author

Listed:
  • Arvin B. Vista
  • Randall S. Rosenberger
  • Alan R. Collins

Abstract

Substantial effort is expended in the design of surveys, including the amount and type of information they contain. However, we often do not know how involved respondents are in reading and processing the informational content of a survey and making choices, and whether different levels of involvement result in systematic differences in estimated models. To address this issue, we recorded response times for each respondent of an internet‐based choice experiment for stream restoration. Response times per survey section and for the entire survey were used as proxies for the amount of involvement in reading information provided or answering choice questions. Response times per survey section fell rapidly, possibly signaling learning, use of heuristics, or attempts to quickly dispel with the survey. Response times were found to be independent of demographics and attitudes. Log‐likelihood ratio tests failed to reject the null hypotheses of equal coefficients and scale parameters across response time‐partitioned data. However, there exists an association between response times and the increasing learning curve or difficult choice trade‐offs, suggesting a heuristic response. Additional research on response time effects and survey design is needed, especially with the rise in electronic surveying media. D'énormes efforts sont investis dans la conception de sondages, notamment pour déterminer la quantité et le type d'information présentée. Toutefois, nous ne savons pas combien de temps les répondants consacrent à la lecture et au traitement de cette information et au choix des réponses, ni si les divers degrés de participation entraînent ou non des différences systématiques dans les modèles estimés. Pour s'attaquer à cette question, nous avons chronométré les personnes qui ont répondu à un sondage en ligne sur la restauration des cours d'eau. Nous avons utilisé le temps de réponse pour chaque section et pour le sondage au complet comme mesure approximative de l'effort des participants pour lire l'information et répondre aux questions. Pour chaque section, le temps de réponse diminuait rapidement, soit en raison des connaissances heuristiques des répondants, soit en raison de leur désir d'effectuer le sondage le plus rapidement possible. Le temps de réponse s'est révélé indépendant des caractéristiques démographiques et des attitudes des répondants. Des tests du rapport de vraisemblance n'ont pas rejeté les hypothèses nulles de coefficients égaux et de paramètres d'échelle de l'ensemble des données cloisonnées. Toutefois, il existe un lien entre le temps de réponse et la courbe d'apprentissage croissante ou la difficulté des choix, ce qui laisse supposer une réponse heuristique. Il faudrait effectuer davantage de recherche sur les effets du temps consacré pour répondre à un sondage et pour le concevoir, en raison du nombre croissant de sondages en ligne.

Suggested Citation

  • Arvin B. Vista & Randall S. Rosenberger & Alan R. Collins, 2009. "If You Provide It, Will They Read It? Response Time Effects in a Choice Experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 57(3), pages 365-377, September.
  • Handle: RePEc:bla:canjag:v:57:y:2009:i:3:p:365-377
    DOI: 10.1111/j.1744-7976.2009.01156.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1744-7976.2009.01156.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1744-7976.2009.01156.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Trudy Cameron, 2005. "Updating Subjective Risks in the Presence of Conflicting Information: An Application to Climate Change," Journal of Risk and Uncertainty, Springer, vol. 30(1), pages 63-97, January.
    2. John C. Bergstrom & John R. Stoll & Alan Randall, 1990. "The Impact of Information on Environmental Commodity Valuation Decisions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(3), pages 614-621.
    3. Bateman, Ian J. & Day, Brett H. & Georgiou, Stavros & Lake, Iain, 2006. "The aggregation of environmental benefit values: Welfare measures, distance decay and total WTP," Ecological Economics, Elsevier, vol. 60(2), pages 450-460, December.
    4. Karl C. Samples & John A. Dixon & KMarcia M. Gowen, 1986. "Information Disclosure and Endangered Species Valuation," Land Economics, University of Wisconsin Press, vol. 62(3), pages 306-312.
    5. Kevin J. Boyle, 1989. "Commodity Specification and the Framing of Contingent-Valuation Questions," Land Economics, University of Wisconsin Press, vol. 65(1), pages 57-63.
    6. George L. Peterson & Thomas C. Brown, 1998. "Economic Valuation by the Method of Paired Comparison, with Emphasis on Evaluation of the Transitivity Axiom," Land Economics, University of Wisconsin Press, vol. 74(2), pages 240-261.
    7. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank C. & Silva, Carol L. & Weimer, David L., 2004. "Information and effort in contingent valuation surveys: application to global climate change using national internet samples," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 331-363, March.
    8. M. K. Haener & P. C. Boxall & W. L. Adamowicz, 2001. "Modeling Recreation Site Choice: Do Hypothetical Choices Reflect Actual Behavior?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 629-642.
    9. Ajzen, Icek & Brown, Thomas C. & Rosenthal, Lori H., 1996. "Information Bias in Contingent Valuation: Effects of Personal Relevance, Quality of Information, and Motivational Orientation," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 43-57, January.
    10. Ian J. Bateman & Richard T. Carson & Brett Day & Michael Hanemann & Nick Hanley & Tannis Hett & Michael Jones-Lee & Graham Loomes, 2002. "Economic Valuation with Stated Preference Techniques," Books, Edward Elgar Publishing, number 2639.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    2. Tanya O�Garra & Susanna Mourato, 2013. "An Experimental Investigation of the Impacts of Persuasion and Information Acquisition on Non-Use Values for Climate Change Adaptation," GRI Working Papers 125, Grantham Research Institute on Climate Change and the Environment.
    3. Welling, Malte & Sagebiel, Julian & Rommel, Jens, 2023. "Information processing in stated preference surveys," Journal of Environmental Economics and Management, Elsevier, vol. 119(C).
    4. Danny Campbell & Morten Raun Mørkbak & Søren Bøye Olsen, 2017. "Response time in online stated choice experiments: the non-triviality of identifying fast and slow respondents," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 17-35, January.
    5. Tobias Börger, 2016. "Are Fast Responses More Random? Testing the Effect of Response Time on Scale in an Online Choice Experiment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(2), pages 389-413, October.
    6. Ahtiainen, Heini & Tienhaara, Annika & Pouta, Eija & Czajkowski, Mikolaj, 2017. "Role of information in the valuation of unfamiliar goods – the case of genetic resources in agriculture," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 261423, European Association of Agricultural Economists.
    7. Li, Xiaoshu & Boyle, Kevin J. & Pullis, Genevieve, 2012. "Does On-site Experience Affect Responses to Stated Preference Questions?," 2012 Annual Meeting, August 12-14, 2012, Seattle, Washington 124991, Agricultural and Applied Economics Association.
    8. Chen, Xuqi & Shen, Meng & Gao, Zhifeng, 2017. "Impact of Intra-respondent Variations in Attribute Attendance on Consumer Preference in Food Choice," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258509, Agricultural and Applied Economics Association.
    9. Eija, Pouta & Annika, Tienhaara & Heini, Ahtiainen, 2014. "Citizens’ preferences for policies to conserve agricultural genetic resources," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 182679, European Association of Agricultural Economists.
    10. Campbell, Danny & Mørkbak, Morten Raun & Olsen, Søren Bøye, 2018. "The link between response time and preference, variance and processing heterogeneity in stated choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 88(C), pages 18-34.
    11. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clem Tisdell & Clevo Wilson, 2006. "Information, Wildlife Valuation, Conservation: Experiments And Policy," Contemporary Economic Policy, Western Economic Association International, vol. 24(1), pages 144-159, January.
    2. Robert W. Kling & Charles F. Revier & Karin Sable, 2004. "Estimating the Public Good Value of Preserving a Local Historic Landmark: The Role of Non-substitutability and Citizen Information," Urban Studies, Urban Studies Journal Limited, vol. 41(10), pages 2025-2041, September.
    3. Li, Xiaoshu & Boyle, Kevin J. & Pullis, Genevieve, 2012. "Does On-site Experience Affect Responses to Stated Preference Questions?," 2012 Annual Meeting, August 12-14, 2012, Seattle, Washington 124991, Agricultural and Applied Economics Association.
    4. Hassan Harajli & Ali Chalak, 2019. "Willingness to Pay for Energy Efficient Appliances: The Case of Lebanese Consumers," Sustainability, MDPI, vol. 11(20), pages 1-20, October.
    5. Li, Xiaoshu & Boyle, Kevin J. & Holmes, Thomas P. & LaRouche, Genevieve Pullis, 2014. "The effect of on-site forest experience on stated preferences for low-impact timber harvesting programs," Journal of Forest Economics, Elsevier, vol. 20(4), pages 348-362.
    6. Wang, Xi & Curtis, Kynda R. & Moeltner, Klaus, 2011. "Modeling the Impact of New Information on Consumer Preferences for Specialty Meat Products," 2011 Conference (55th), February 8-11, 2011, Melbourne, Australia 100540, Australian Agricultural and Resource Economics Society.
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. Alhassan, Mustapha & Gustafson, Christopher R. & Schoengold, Karina, 2017. "Effects of Information Framing on Smallholder Irrigation Farmers’ Willingness to Pay for Groundwater Protection: The Case of Vea Irrigation Scheme in Ghana," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258432, Agricultural and Applied Economics Association.
    9. Broberg, Thomas & Daniel, Aemiro Melkamu & Persson, Lars, 2021. "Household preferences for load restrictions: Is there an effect of pro-environmental framing?," Energy Economics, Elsevier, vol. 97(C).
    10. Katuwal, Hari & Venn, Tyron J. & Paveglio, Travis & Prato, Tony, 2015. "Effects of Information Framing and Information Seeking Behavior on Willingness-to-pay for a Wildfire Management Program," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205645, Agricultural and Applied Economics Association.
    11. Glenk, Klaus & Schaafsma, Marije & Moxey, Andrew & Martin-Ortega, Julia & Hanley, Nick, 2014. "A framework for valuing spatially targeted peatland restoration," Ecosystem Services, Elsevier, vol. 9(C), pages 20-33.
    12. Spash, Clive L., 2008. "The Contingent Valuation Method: Retrospect and Prospect," MPRA Paper 101234, University Library of Munich, Germany.
    13. Tisdell, Clement A. & Wilson, Clevo & Swarna Nantha, Hemanath, 2004. "Dynamic Processes in Contingent Valuation: A Case Study Involving the Mahogany Glider," Economics, Ecology and Environment Working Papers 51414, University of Queensland, School of Economics.
    14. Tisdell, Clem & Wilson, Clevo & Swarna Nantha, Hemanath, 2008. "Contingent valuation as a dynamic process," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(4), pages 1443-1458, August.
    15. Tanguay, Mark & Adamowicz, Wiktor L. & Boxall, Peter C., 1995. "An Economic Evaluation of Woodland Caribou Conservation Programs in Northwestern Saskatchewan," Project Report Series 24039, University of Alberta, Department of Resource Economics and Environmental Sociology.
    16. Tisdell, Clement A., 2003. "Influences of Knowledge of Wildlife Species on Patterns of Willingness to pay for their Conservation," Economics, Ecology and Environment Working Papers 48972, University of Queensland, School of Economics.
    17. Akcura, E., 2011. "Information Effects in Valuation of Electricity and Water Service Attributes Using Contingent Valuation," Cambridge Working Papers in Economics 1156, Faculty of Economics, University of Cambridge.
    18. Blomquist, Glenn C. & Whitehead, John C., 1998. "Resource quality information and validity of willingness to pay in contingent valuation," Resource and Energy Economics, Elsevier, vol. 20(2), pages 179-196, June.
    19. Welling, Malte & Sagebiel, Julian & Rommel, Jens, 2023. "Information processing in stated preference surveys," Journal of Environmental Economics and Management, Elsevier, vol. 119(C).
    20. Tisdell, Clement A. & Wilson, Clevo & Swarna Nantha, Hemanath, 2005. "Dynamic Processes in the Contingent Valuation of an Endangered Mammal Species," Economics, Ecology and Environment Working Papers 55064, University of Queensland, School of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:canjag:v:57:y:2009:i:3:p:365-377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/caefmea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.