IDEAS home Printed from https://ideas.repec.org/a/bla/canjag/v68y2020i3p343-357.html
   My bibliography  Save this article

Testing hypothetical bias in a framed field experiment

Author

Listed:
  • Roy Brouwer
  • Solomon Tarfasa

Abstract

Hypothetical bias is tested based on inter‐ and intra‐respondent comparisons of choice behavior, applying a hypothetical and real choice experiment. The inter‐respondent comparison commonly applied in the environmental and agricultural economics literature consists of a control group of buyers who are asked to hypothetically choose between conventional and organic beans and an experimental group of buyers who are endowed to purchase the same beans using an identical experimental design. Hypothetical bias is tested by comparing inter‐ and intra‐respondents’ (i) hypothetical and real choices, (ii) preference parameters of the estimated choice models related to hypothetical and real choices, and (iii) hypothetical and real willingness to pay (WTP). Choices in the experimental group are highly consistent when switching from hypothetical to real choices for this study's homegrown goods. However, after being endowed, the price sensitivity of lower income households drops, suggesting a house money effect. WTP derived from actual purchases is higher than WTP based on hypothetical choices, indicating a negative hypothetical bias, but differences are only significant in the case of the inter‐respondent comparison. Actual prices paid by respondents in the field experiment appear to be considerably lower than the estimated WTP values and yield a mixed picture of hypothetical bias. Le biais hypothétique est testé sur la base de comparaisons inter et intra‐répondants du comportement de choix, en appliquant une expérience de choix hypothétique et réelle. La comparaison entre les répondants couramment appliquée dans la littérature en économie environnementale et agricole consiste en un groupe témoin d'acheteurs à qui l'on demande de choisir hypothétiquement entre les fèves conventionnelles et biologiques et un groupe expérimental d'acheteurs qui reçoivent une allocation pour acheter les mêmes haricots en utilisant un design expérimental identique. Le biais hypothétique est testé en comparant les choix inter et intra‐répondants (i) hypothétiques et réels, (ii) les paramètres de préférence des modèles de choix estimés liés aux choix hypothétiques et réels, et (iii) la volonté hypothétique et réelle de payer (CAP). Les choix du groupe expérimental sont très cohérents lors du passage de choix hypothétiques à des choix réels pour les produits locaux de cette étude. Cependant, après avoir reçu leur allocation, la sensibilité aux prix des ménages à faible revenu diminue, ce qui suggère un effet « argent maison ». Le CAP calculé à partir des achats réels est supérieur au CAP basé sur des choix hypothétiques, indiquant un biais hypothétique négatif, mais les différences ne sont significatives que dans le cas de la comparaison entre les inter‐répondants. Les prix réels payés par les répondants dans l'expérience de terrain semblent être considérablement inférieurs aux valeurs estimées du CAP et donnent une image mitigée de biais hypothétique.

Suggested Citation

  • Roy Brouwer & Solomon Tarfasa, 2020. "Testing hypothetical bias in a framed field experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 68(3), pages 343-357, September.
  • Handle: RePEc:bla:canjag:v:68:y:2020:i:3:p:343-357
    DOI: 10.1111/cjag.12224
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/cjag.12224
    Download Restriction: no

    File URL: https://libkey.io/10.1111/cjag.12224?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Krinsky, Itzhak & Robb, A Leslie, 1986. "On Approximating the Statistical Properties of Elasticities," The Review of Economics and Statistics, MIT Press, vol. 68(4), pages 715-719, November.
    2. Whittington, Dale, 1998. "Administering contingent valuation surveys in developing countries," World Development, Elsevier, vol. 26(1), pages 21-30, January.
    3. Stephen Hynes & Nick Hanley & Riccardo Scarpa, 2008. "Effects on Welfare Measures of Alternative Means of Accounting for Preference Heterogeneity in Recreational Demand Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(4), pages 1011-1027.
    4. Carlos E. Carpio & Olga Isengildina-Massa, 2009. "Consumer willingness to pay for locally grown products: the case of South Carolina," Agribusiness, John Wiley & Sons, Ltd., vol. 25(3), pages 412-426.
    5. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    6. Juan Cárdenas & Nicolas Roux & Christian Jaramillo & Luis Martinez, 2014. "Is it my money or not? An experiment on risk aversion and the house-money effect," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 47-60, March.
    7. Roy Brouwer & Ivana Logar & Oleg Sheremet, 2017. "Choice Consistency and Preference Stability in Test-Retests of Discrete Choice Experiment and Open-Ended Willingness to Pay Elicitation Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 729-751, November.
    8. Richard H. Thaler & Eric J. Johnson, 1990. "Gambling with the House Money and Trying to Break Even: The Effects of Prior Outcomes on Risky Choice," Management Science, INFORMS, vol. 36(6), pages 643-660, June.
    9. William Desvousges & Kristy Mathews & Kenneth Train, 2015. "An Adding-up Test on Contingent Valuations of River and Lake Quality," Land Economics, University of Wisconsin Press, vol. 91(3), pages 556-571.
    10. Simon Chege Kimenju & Hugo De Groote, 2008. "Consumer willingness to pay for genetically modified food in Kenya," Agricultural Economics, International Association of Agricultural Economists, vol. 38(1), pages 35-46, January.
    11. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    12. Roy Brouwer & Thijs Dekker & John Rolfe & Jill Windle, 2010. "Choice Certainty and Consistency in Repeated Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(1), pages 93-109, May.
    13. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    14. Brownstone, David & Small, Kenneth A., 2005. "Valuing time and reliability: assessing the evidence from road pricing demonstrations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(4), pages 279-293, May.
    15. James Murphy & Thomas Stevens & Lava Yadav, 2010. "A Comparison of Induced Value and Home-Grown Value Experiments to Test for Hypothetical Bias in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(1), pages 111-123, September.
    16. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    17. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    18. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    19. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    20. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, January.
    21. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    22. Matteo Mattmann & Ivana Logar & Roy Brouwer, 2019. "Choice certainty, consistency, and monotonicity in discrete choice experiments," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 8(2), pages 109-127, April.
    23. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    24. Yohei Mitani & Nicholas Flores, 2014. "Hypothetical Bias Reconsidered: Payment and Provision Uncertainties in a Threshold Provision Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 433-454, November.
    25. Scarpa Riccardo & Del Giudice Teresa, 2004. "Market Segmentation via Mixed Logit: Extra-Virgin Olive Oil in Urban Italy," Journal of Agricultural & Food Industrial Organization, De Gruyter, vol. 2(1), pages 1-20, August.
    26. Solomon Tarfasa & Roy Brouwer, 2013. "Estimation of the public benefits of urban water supply improvements in Ethiopia: a choice experiment," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1099-1108, March.
    27. Jay R. Corrigan & Matthew C. Rousu, 2006. "The Effect of Initial Endowments in Experimental Auctions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(2), pages 448-457.
    28. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    29. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    30. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    31. Vossler, Christian A. & Evans, Mary F., 2009. "Bridging the gap between the field and the lab: Environmental goods, policy maker input, and consequentiality," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 338-345, November.
    32. Hensher,David A. & Rose,John M. & Greene,William H., 2015. "Applied Choice Analysis," Cambridge Books, Cambridge University Press, number 9781107465923.
    33. McCluskey, Jill J. & Loureiro, Maria L., 2003. "Consumer Preferences And Willingness To Pay For Food Labeling: A Discussion Of Empirical Studies," Journal of Food Distribution Research, Food Distribution Research Society, vol. 34(3), pages 1-8, November.
    34. Harrison, Glenn W. & Rutström, E. Elisabet, 2008. "Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 81, pages 752-767, Elsevier.
    35. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    36. repec:ken:wpaper:0601 is not listed on IDEAS
    37. Riccarda Moser & Roberta Raffaelli & Sandra Notaro, 2014. "Testing hypothetical bias with a real choice experiment using respondents' own money," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 41(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    3. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    4. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    5. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    6. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    9. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    10. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    11. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    12. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    13. Svenningsen, Lea S. & Jacobsen, Jette Bredahl, 2018. "Testing the effect of changes in elicitation format, payment vehicle and bid range on the hypothetical bias for moral goods," Journal of choice modelling, Elsevier, vol. 29(C), pages 17-32.
    14. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    15. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    16. Krčál, Ondřej & Peer, Stefanie & Staněk, Rostislav & Karlínová, Bára, 2019. "Real consequences matter: Why hypothetical biases in the valuation of time persist even in controlled lab experiments," Economics of Transportation, Elsevier, vol. 20(C).
    17. Zhai, Qianqian & Kassas, Bachir & Zhao, Shuoli & Chen, Lijun & Chen, Chao, 2020. "Investigating Preference Inconsistencies in Incentive Structures that Account for House Money Effects," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304584, Agricultural and Applied Economics Association.
    18. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    19. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    20. Ladenburg, Jacob & Skotte, Maria, 2022. "Heterogeneity in willingness to pay for the location of offshore wind power development: An application of the willingness to pay space model," Energy, Elsevier, vol. 241(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:canjag:v:68:y:2020:i:3:p:343-357. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/caefmea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.