IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v114y2022ics0095069622000377.html
   My bibliography  Save this article

Using economic experiments to assess the validity of stated preference contingent behavior responses

Author

Listed:
  • Xie, Lusi
  • Adamowicz, Wiktor
  • Kecinski, Maik
  • Fooks, Jacob R.

Abstract

Contingent behavior (CB), a stated preference (SP) method, elicits individuals’ intentions about behavior in quantities or frequencies under hypothetical scenarios. CB has primarily been used to elicit preferences in recreation demand models or to assess market demand. Although CB shares the hypothetical nature of other SP methods, there has been limited assessment of CB validity and incentive compatibility. Focusing on hypothetical bias and framing effects, we design an incentive-compatible decision mechanism that examines the validity of CB in economic experiments. We find hypothetical bias associated with an overstatement of quantities in CB responses, but the overstatement does not appear to arise from strategic behavior. We also find that overstating quantities is not significantly affected by framing, but framing does affect the convergence of CB and revealed preference responses. These findings raise questions about the validity CB research and its demand revealing properties but provide some avenues to address these concerns.

Suggested Citation

  • Xie, Lusi & Adamowicz, Wiktor & Kecinski, Maik & Fooks, Jacob R., 2022. "Using economic experiments to assess the validity of stated preference contingent behavior responses," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
  • Handle: RePEc:eee:jeeman:v:114:y:2022:i:c:s0095069622000377
    DOI: 10.1016/j.jeem.2022.102659
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069622000377
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2022.102659?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    2. Heberlein, Thomas A. & Wilson, Matthew A. & Bishop, Richard C. & Schaeffer, Nora Cate, 2005. "Rethinking the scope test as a criterion for validity in contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 50(1), pages 1-22, July.
    3. Frank Lupi & Daniel J. Phaneuf & Roger H. von Haefen, 2020. "Best Practices for Implementing Recreation Demand Models," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 302-323.
    4. List, John A. & Price, Michael K., 2009. "The role of social connections in charitable fundraising: Evidence from a natural field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 160-169, February.
    5. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    6. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    7. Patrick Lloyd-Smith & Wiktor Adamowicz & Diane Dupont, 2019. "Incorporating Stated Consequentiality Questions in Stated Preference Research," Land Economics, University of Wisconsin Press, vol. 95(3), pages 293-306.
    8. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    9. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
    10. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    11. Christine Bertram & Heini Ahtiainen & Jürgen Meyerhoff & Kristine Pakalniete & Eija Pouta & Katrin Rehdanz, 2020. "Contingent Behavior and Asymmetric Preferences for Baltic Sea Coastal Recreation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(1), pages 49-78, January.
    12. Ou Yang & Peter Sivey & Andrea M. de Silva & Anthony Scott, 2020. "Parents' Demand for Sugar Sweetened Beverages for Their Pre‐School Children: Evidence from a Stated‐Preference Experiment," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(2), pages 480-504, March.
    13. Charness, Gary & Gneezy, Uri & Henderson, Austin, 2018. "Experimental methods: Measuring effort in economics experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 74-87.
    14. DongGyu Yi & Joseph A. Herriges, 2017. "Convergent Validity and the Time Consistency of Preferences: Evidence from the Iowa Lakes Recreation Demand Project," Land Economics, University of Wisconsin Press, vol. 93(2), pages 269-291.
    15. Richard T. Carson, 2012. "Contingent Valuation: A Practical Alternative When Prices Aren't Available," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 27-42, Fall.
    16. Mandy Ryan & Verity Watson, 2009. "Comparing welfare estimates from payment card contingent valuation and discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 18(4), pages 389-401, April.
    17. Christian A. Vossler & Ewa Zawojska, 2020. "Behavioral Drivers or Economic Incentives? Toward a Better Understanding of Elicitation Effects in Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 7(2), pages 279-303.
    18. Patrick Lloyd-Smith & Ewa Zawojska & Wiktor Adamowicz, 2020. "Moving beyond the Contingent Valuation versus Choice Experiment Debate: Presentation Effects in Stated Preference," Land Economics, University of Wisconsin Press, vol. 96(1), pages 1-24.
    19. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's "Dubious to Hopeless" Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    20. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Post-Print halshs-02076569, HAL.
    21. P. A. Kuperis & M. M. Veeman & W. L. Adamowicz, 1999. "Consumer's Responses to the Potential Use of Bovine Somatotrophin in Canadian Dairy Production," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 47(2), pages 151-163, July.
    22. Andreoni, James, 1990. "Impure Altruism and Donations to Public Goods: A Theory of Warm-Glow Giving?," Economic Journal, Royal Economic Society, vol. 100(401), pages 464-477, June.
    23. Jeffrey Englin & Trudy Cameron, 1996. "Augmenting travel cost models with contingent behavior data," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 7(2), pages 133-147, March.
    24. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    25. W. Douglass Shaw, 2002. "Testing the Validity of Contingent Behavior Trip Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 84(2), pages 401-414.
    26. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    27. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    28. Karen Blumenschein & Glenn C. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    29. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    30. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    31. Grebitus, Carola & Lusk, Jayson L. & Nayga, Rodolfo M., 2013. "Explaining differences in real and hypothetical experimental auctions and choice experiments with personality," Journal of Economic Psychology, Elsevier, vol. 36(C), pages 11-26.
    32. Kevin Atkinson & John C. Whitehead, 2015. "Predictive validity of stated preference data: evidence from mountain bike park visits before and after trail system expansion," Applied Economics Letters, Taylor & Francis Journals, vol. 22(9), pages 730-733, June.
    33. Yongsik Jeon & Joseph Herriges, 2010. "Convergent Validity of Contingent Behavior Responses in Models of Recreation Demand," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(2), pages 223-250, February.
    34. Marisa J. Mazzotta & James J. Opaluch, 1995. "Decision Making When Choices Are Complex: A Test of Heiner's Hypothesis," Land Economics, University of Wisconsin Press, vol. 71(4), pages 500-515.
    35. Maurice Doyon & Stéphane Bergeron, 2016. "Understanding Strategic Behavior and Its Contribution to Hypothetical Bias When Eliciting Values for a Private Good," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 653-666, December.
    36. Lloyd-Smith, Patrick & Adamowicz, Wiktor, 2018. "Can stated measures of willingness-to-accept be valid? Evidence from laboratory experiments," Journal of Environmental Economics and Management, Elsevier, vol. 91(C), pages 133-149.
    37. John Whitehead & Daniel Phaneuf & Christopher Dumas & Jim Herstine & Jeffery Hill & Bob Buerger, 2010. "Convergent Validity of Revealed and Stated Recreation Behavior with Quality Change: A Comparison of Multiple and Single Site Demands," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(1), pages 91-112, January.
    38. Patrick Lloyd-Smith & Joshua K. Abbott & Wiktor Adamowicz & Daniel Willard, 2019. "Decoupling the Value of Leisure Time from Labor Market Returns in Travel Cost Models," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 6(2), pages 215-242.
    39. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    40. Nobel, Anne & Lizin, Sebastien & Witters, Nele & Rineau, Francois & Malina, Robert, 2020. "The impact of wildfires on the recreational value of heathland: A discrete factor approach with adjustment for on-site sampling," Journal of Environmental Economics and Management, Elsevier, vol. 101(C).
    41. F. Bailey Norwood & Jayson L. Lusk, 2011. "Social Desirability Bias in Real, Hypothetical, and Inferred Valuation Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(2), pages 528-534.
    42. Irwin, Julie R, et al, 1998. "Payoff Dominance vs. Cognitive Transparency in Decision Making," Economic Inquiry, Western Economic Association International, vol. 36(2), pages 272-285, April.
    43. Daniel McFadden, 2017. "Stated preference methods and their applicability to environmental use and non-use valuations," Chapters, in: Daniel McFadden & Kenneth Train (ed.), Contingent Valuation of Environmental Goods, chapter 6, pages 153-187, Edward Elgar Publishing.
    44. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    45. Jayson Lusk & Leatta McLaughlin & Sara Jaeger, 2007. "Strategy and response to purchase intention questions," Marketing Letters, Springer, vol. 18(1), pages 31-44, June.
    46. Daniel W. Elfenbein & Ray Fisman & Brian Mcmanus, 2012. "Charity as a Substitute for Reputation: Evidence from an Online Marketplace," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(4), pages 1441-1468.
    47. Brown, Alexander L. & Healy, Paul J., 2018. "Separated decisions," European Economic Review, Elsevier, vol. 101(C), pages 20-34.
    48. Riccarda Moser & Roberta Raffaelli & Sandra Notaro, 2014. "Testing hypothetical bias with a real choice experiment using respondents' own money," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 41(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Richard C. Bishop & Kevin J. Boyle, 2021. "On Adding-Up as a Validity Criterion for Stated-Preference Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 80(3), pages 587-601, November.
    4. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's 'Dubious to Hopeless' Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    5. Félix Muñoz-García & Tongzhe Li, 2018. "Explaining Hypothetical Bias Variations Using Income Elasticity of Demand," Homo Oeconomicus: Journal of Behavioral and Institutional Economics, Springer, vol. 35(3), pages 207-224, September.
    6. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    7. Pengfei Liu & Xiaohui Tian, 2021. "Downward Hypothetical Bias in the Willingness to Accept Measure for Private Goods: Evidence from a Field Experiment," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(5), pages 1679-1699, October.
    8. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    9. Amoah, Anthony & Ferrini, Silvia & Schaafsma, Marije, 2019. "Electricity outages in Ghana: Are contingent valuation estimates valid?," Energy Policy, Elsevier, vol. 135(C).
    10. Christian A. Vossler & Stéphane Bergeron & Maurice Doyon & Daniel Rondeau, 2023. "Revisiting the Gap between the Willingness to Pay and Willingness to Accept for Public Goods," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 10(2), pages 413-445.
    11. Zawojska, Ewa & Gastineau, Pascal & Mahieu, Pierre-Alexandre & Cheze, Benoit & Paris, Anthony, 2021. "Measuring policy consequentiality perceptions in stated preference surveys," 2021 Annual Meeting, August 1-3, Austin, Texas 313977, Agricultural and Applied Economics Association.
    12. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    13. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    14. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    15. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson L. & Nayga, Rodolfo M. Jr., 2015. "Reference dependence, consequentiality and social desirability in value elicitation: A study of fair labor labeling," 143rd Joint EAAE/AAEA Seminar, March 25-27, 2015, Naples, Italy 202705, European Association of Agricultural Economists.
    16. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    17. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    18. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    19. Drichoutis, Andreas C. & Vassilopoulos, Achilleas & Lusk, Jayson & Nayga, Rodolfo M., 2015. "Fair farming: Preferences for fair labor certification using four elicitation methods," MPRA Paper 62546, University Library of Munich, Germany.
    20. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2016. "Putting Your Money Where Your Mouth Is," Monash Economics Working Papers 42-16, Monash University, Department of Economics.

    More about this item

    Keywords

    Contingent behavior; Stated preference; Validity; Incentive compatibility;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects
    • D4 - Microeconomics - - Market Structure, Pricing, and Design

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:114:y:2022:i:c:s0095069622000377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.