IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v23y2008i3p351-371.html
   My bibliography  Save this article

Learning and fatigue during choice experiments: a comparison of online and mail survey modes

Author

Listed:
  • Scott J. Savage

    (Department of Economics, University of Colorado, Boulder, Colorado, USA)

  • Donald M. Waldman

Abstract

This study investigates the effect of survey mode on respondent learning and fatigue during repeated choice experiments. Stated preference data are obtained from an experiment concerning high-speed Internet service conducted on samples of mail respondents and online respondents. We identify and estimate aspects of the error components for different subsets of the choice questions, for both mail and online respondents. Results show mail respondents answer questions consistently throughout a series of choice experiments, but the quality of the online respondents' answers declines. Therefore, while the online survey provides lower survey administration costs and reduced time between implementation and data analysis, such benefits come at the cost of less precise responses. Copyright © 2008 John Wiley & Sons, Ltd.

Suggested Citation

  • Scott J. Savage & Donald M. Waldman, 2008. "Learning and fatigue during choice experiments: a comparison of online and mail survey modes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 351-371.
    • Handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:351-371
    DOI: 10.1002/jae.984
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.984
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2008-v23.3/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.984?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Romeo, Charles & Sopher, Barry, 1999. "Learning and Decision Costs in One-Person Games," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(4), pages 335-357, July-Aug..
    2. Philipson, Tomas & Malani, Anup, 1999. "Measurement errors: A principal investigator-agent approach," Journal of Econometrics, Elsevier, vol. 91(2), pages 273-298, August.
    3. Philipson, Tomas, 2001. "Data Markets, Missing Data, and Incentive Pay," Econometrica, Econometric Society, vol. 69(4), pages 1099-1111, July.
    4. Hensher, David & Louviere, Jordan & Swait, Joffre, 1998. "Combining sources of preference data," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 197-221, November.
    5. Waldman, Donald M., 1985. "Computation in duration models with heterogeneity," Journal of Econometrics, Elsevier, vol. 28(1), pages 127-134, April.
    6. Richard Carson & Robert Mitchell & Michael Hanemann & Raymond Kopp & Stanley Presser & Paul Ruud, 2003. "Contingent Valuation and Lost Passive Use: Damages from the Exxon Valdez Oil Spill," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 257-286, July.
    7. repec:cup:cbooks:9780521788304 is not listed on IDEAS
    8. Cameron, Trudy Ann & Poe, Gregory L. & Ethier, Robert G. & Schulze, William D., 2002. "Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 391-425, November.
    9. Berrens, Robert P. & Bohara, Alok K. & Jenkins-Smith, Hank & Silva, Carol & Weimer, David L., 2003. "The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples," Political Analysis, Cambridge University Press, vol. 11(1), pages 1-22, January.
    10. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    11. Swait, Joffre & Adamowicz, Wiktor L., 1996. "The Effect of Choice Environment and Task Demands on Consumer Behavior: Discriminating Between Contribution and Confusion," Staff Paper Series 24091, University of Alberta, Department of Resource Economics and Environmental Sociology.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. F Alpizar & F Carlsson & P Martinsson, 2003. "Using Choice Experiments for Non-Market Valuation," Economic Issues Journal Articles, Economic Issues, vol. 8(1), pages 83-110, March.
    2. Siikamaki, Juha & Layton, David F., 2001. "Logit Models For Pooled Contingent Valuation And Contingent Rating And Ranking Data: Valuing Benefits From Forest Biodiversity Conservation," 2001 Annual meeting, August 5-8, Chicago, IL 20616, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    3. Feld, Brian & Nagy, AbdelRahman & Osman, Adam, 2022. "What do jobseekers want? Comparing methods to estimate reservation wages and the value of job attributes," Journal of Development Economics, Elsevier, vol. 159(C).
    4. Siikamaki, Juha & Layton, David F., 2006. "Discrete Choice Survey Experiments: A Comparison Using Flexible Models," RFF Working Paper Series dp-05-60, Resources for the Future.
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Hui Li & Robert P. Berrens & Alok K. Bohara & Hank C. Jenkins-Smith & Carol L. Silva & David L. Weimer, 2005. "Exploring the Beta Model Using Proportional Budget Information in a Contingent Valuation Study," Economics Bulletin, AccessEcon, vol. 17(8), pages 1-9.
    7. Lothar Essig & Joachim K. Winter, 2009. "Item Non-Response to Financial Questions in Household Surveys: An Experimental Study of Interviewer and Mode Effects," Fiscal Studies, Institute for Fiscal Studies, vol. 30(Special I), pages 367-390, December.
    8. Daniel McFadden, 2009. "The human side of mechanism design: a tribute to Leo Hurwicz and Jean-Jacque Laffont," Review of Economic Design, Springer;Society for Economic Design, vol. 13(1), pages 77-100, April.
    9. de Koning, Koen & Filatova, Tatiana & Bin, Okmyung, 2017. "Bridging the Gap Between Revealed and Stated Preferences in Flood-prone Housing Markets," Ecological Economics, Elsevier, vol. 136(C), pages 1-13.
    10. Lindhjem, Henrik & Navrud, Ståle, 2011. "Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes," International Review of Environmental and Resource Economics, now publishers, vol. 5(4), pages 309-351, September.
    11. Denzil G. Fiebig & Michael P. Keane & Jordan Louviere & Nada Wasi, 2010. "The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity," Marketing Science, INFORMS, vol. 29(3), pages 393-421, 05-06.
    12. Michael P. Keane & Nada Wasi, 2013. "The Structure of Consumer Taste Heterogeneity in Revealed vs. Stated Preference Data," Economics Papers 2013-W10, Economics Group, Nuffield College, University of Oxford.
    13. Siikamaki, Juha & Layton, David F., 2007. "Discrete choice survey experiments: A comparison using flexible methods," Journal of Environmental Economics and Management, Elsevier, vol. 53(1), pages 122-139, January.
    14. John C. Whitehead & Andrew Ropicki & John Loomis & Sherry Larkin & Tim Haab & Sergio Alvarez, 2023. "Estimating the benefits to Florida households from avoiding another Gulf oil spill using the contingent valuation method: Internal validity tests with probability‐based and opt‐in samples," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(2), pages 705-720, June.
    15. Mikołaj Czajkowski & Nick Hanley & Jacob LaRiviere, 2016. "Controlling for the Effects of Information in a Public Goods Discrete Choice Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(3), pages 523-544, March.
    16. Kettlewell, Nathan & Walker, Matthew J. & Yoo, Hong Il, 2024. "Alternative Models of Preference Heterogeneity for Elicited Choice Probabilities," IZA Discussion Papers 16821, Institute of Labor Economics (IZA).
    17. Winter, Joachim, 0000. "Bracketing effects in categorized survey questions and the measurement of economic quantities," Sonderforschungsbereich 504 Publications 02-35, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    18. María Vázquez Rodríguez & Carmelo León, 2004. "Altruism and the Economic Values of Environmental and Social Policies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 28(2), pages 233-249, June.
    19. Eran Ben-Elia & Robert Ishaq & Yoram Shiftan, 2013. "“If only I had taken the other road...”: Regret, risk and reinforced learning in informed route-choice," Transportation, Springer, vol. 40(2), pages 269-293, February.
    20. Keane, Michael P. & Wasi, Nada, 2016. "How to model consumer heterogeneity? Lessons from three case studies on SP and RP data," Research in Economics, Elsevier, vol. 70(2), pages 197-231.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:23:y:2008:i:3:p:351-371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.