IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v23y2008i3p351-371.html
   My bibliography  Save this article

Learning and fatigue during choice experiments: a comparison of online and mail survey modes

Author

Listed:
  • Scott J. Savage

    (Department of Economics, University of Colorado, Boulder, Colorado, USA)

  • Donald M. Waldman

Abstract

This study investigates the effect of survey mode on respondent learning and fatigue during repeated choice experiments. Stated preference data are obtained from an experiment concerning high-speed Internet service conducted on samples of mail respondents and online respondents. We identify and estimate aspects of the error components for different subsets of the choice questions, for both mail and online respondents. Results show mail respondents answer questions consistently throughout a series of choice experiments, but the quality of the online respondents' answers declines. Therefore, while the online survey provides lower survey administration costs and reduced time between implementation and data analysis, such benefits come at the cost of less precise responses. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Scott J. Savage & Donald M. Waldman, 2008. "Learning and fatigue during choice experiments: a comparison of online and mail survey modes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 351-371.
    • Handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:351-371
    DOI: 10.1002/jae.984
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.984
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2008-v23.3/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.984?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Philipson, Tomas, 2001. "Data Markets, Missing Data, and Incentive Pay," Econometrica, Econometric Society, vol. 69(4), pages 1099-1111, July.
    2. Waldman, Donald M., 1985. "Computation in duration models with heterogeneity," Journal of Econometrics, Elsevier, vol. 28(1), pages 127-134, April.
    3. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    4. Cameron, Trudy Ann & Poe, Gregory L. & Ethier, Robert G. & Schulze, William D., 2002. "Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 391-425, November.
    5. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, October.
    6. Hensher, David & Louviere, Jordan & Swait, Joffre, 1998. "Combining sources of preference data," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 197-221, November.
    7. Swait, Joffre & Adamowicz, Wiktor L., 1996. "The Effect of Choice Environment and Task Demands on Consumer Behavior: Discriminating Between Contribution and Confusion," Staff Paper Series 24091, University of Alberta, Department of Resource Economics and Environmental Sociology.
    8. Richard Carson & Robert Mitchell & Michael Hanemann & Raymond Kopp & Stanley Presser & Paul Ruud, 2003. "Contingent Valuation and Lost Passive Use: Damages from the Exxon Valdez Oil Spill," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 257-286, July.
    9. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank & Silva, Carol & Weimer, David L., 2003. "The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples," Political Analysis, Cambridge University Press, vol. 11(1), pages 1-22, January.
    10. Romeo, Charles & Sopher, Barry, 1999. "Learning and Decision Costs in One-Person Games," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 335-357, July-Aug..
    11. Philipson, Tomas & Malani, Anup, 1999. "Measurement errors: A principal investigator-agent approach," Journal of Econometrics, Elsevier, vol. 91(2), pages 273-298, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siikamaki, Juha & Layton, David F., 2006. "Discrete Choice Survey Experiments: A Comparison Using Flexible Models," RFF Working Paper Series dp-05-60, Resources for the Future.
    2. F Alpizar & F Carlsson & P Martinsson, 2003. "Using Choice Experiments for Non-Market Valuation," Economic Issues Journal Articles, Economic Issues, vol. 8(1), pages 83-110, March.
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Daniel McFadden, 2009. "The human side of mechanism design: a tribute to Leo Hurwicz and Jean-Jacque Laffont," Review of Economic Design, Springer;Society for Economic Design, vol. 13(1), pages 77-100, April.
    5. Siikamaki, Juha & Layton, David F., 2001. "Logit Models For Pooled Contingent Valuation And Contingent Rating And Ranking Data: Valuing Benefits From Forest Biodiversity Conservation," 2001 Annual meeting, August 5-8, Chicago, IL 20616, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    6. John C. Whitehead & Subhrendu K. Pattanayak & George L. Van Houtven & Brett R. Gelso, 2008. "Combining Revealed And Stated Preference Data To Estimate The Nonmarket Value Of Ecological Services: An Assessment Of The State Of The Science," Journal of Economic Surveys, Wiley Blackwell, vol. 22(5), pages 872-908, December.
    7. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    8. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    9. Murakami, Kayo & Ida, Takanori & Tanaka, Makoto & Friedman, Lee, 2015. "Consumers' willingness to pay for renewable and nuclear energy: A comparative analysis between the US and Japan," Energy Economics, Elsevier, vol. 50(C), pages 178-189.
    10. Rid, Wolfgang & Haider, Wolfgang & Ryffel, Andrea & Beardmore, Ben, 2018. "Visualisations in Choice Experiments: Comparing 3D Film-sequences and Still-images to Analyse Housing Development Alternatives," Ecological Economics, Elsevier, vol. 146(C), pages 203-217.
    11. Siikamaki, Juha & Layton, David F., 2007. "Discrete choice survey experiments: A comparison using flexible methods," Journal of Environmental Economics and Management, Elsevier, vol. 53(1), pages 122-139, January.
    12. María Vázquez Rodríguez & Carmelo León, 2004. "Altruism and the Economic Values of Environmental and Social Policies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 28(2), pages 233-249, June.
    13. Lin, Yi-Hsing & Hong, Chun-Fu & Lee, Chun-Hung & Chen, Chih-Cheng, 2020. "Integrating Aspects of Ecosystem Dimensions into Sorghum and Wheat Production Areas in Kinmen, Taiwan," Land Use Policy, Elsevier, vol. 99(C).
    14. Vincenzina Caputo & Jayson L Lusk & Rodolfo M Nayga, 2020. "Am I Getting a Good Deal? Reference‐DependentDecision Making When the Reference Price Is Uncertain," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(1), pages 132-153, January.
    15. V. Smith & Carol Mansfield & Laurel Clayton, 2009. "Valuing a homeland security policy: Countermeasures for the threats from shoulder mounted missiles," Journal of Risk and Uncertainty, Springer, vol. 38(3), pages 215-243, June.
    16. J. DeShazo & Trudy Cameron & Manrique Saenz, 2009. "The Effect of Consumers’ Real-World Choice Sets on Inferences from Stated Preference Surveys," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 319-343, March.
    17. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    18. Feld, Brian & Nagy, AbdelRahman & Osman, Adam, 2022. "What do jobseekers want? Comparing methods to estimate reservation wages and the value of job attributes," Journal of Development Economics, Elsevier, vol. 159(C).
    19. Tin Cheuk Leung, 2013. "What Is the True Loss Due to Piracy? Evidence from Microsoft Office in Hong Kong," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 1018-1029, July.
    20. Ortega, David L. & Wang, H. Holly & Wu, Laping & Hong, Soo Jeong, 2015. "Retail channel and consumer demand for food quality in China," China Economic Review, Elsevier, vol. 36(C), pages 359-366.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:351-371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.