IDEAS home Printed from https://ideas.repec.org/a/wly/ajagec/v103y2021i1p142-161.html
   My bibliography  Save this article

On the Use of Virtual Reality in Mitigating Hypothetical Bias in Choice Experiments

Author

Listed:
  • Di Fang
  • Rodolfo M. Nayga
  • Grant H. West
  • Claudia Bazzani
  • Wei Yang
  • Benjamin C. Lok
  • Charles E. Levy
  • Heather A. Snell

Abstract

Choice experiments have been extensively used in many stated preference studies and disciplines. In order to give external validity to stated preferences, participants must behave the same in an experiment setting as they do in reality. The difference between a decision made in a real experiment and a hypothetical experiment is commonly attributed to “hypothetical bias.” In this paper, we investigate whether virtual reality can reduce hypothetical bias in choice experiments. We conducted a set of experiments using the Food and Drug Administration's new Nutrition Facts Label for yogurts. Participants were randomly assigned to non‐hypothetical and hypothetical experiments, which differed in terms of visual presentations of the product in question: text, picture, and a virtual grocery store. Given the absence of real markets for the new label at the time of the research, we approximate the real market with a binding choice in our non‐hypothetical experiments. Our results suggest that although the hypothetical bias with virtual reality is not statistically significantly different from those using text or picture, it is the smallest. Among participants who did not exhibit high simulator discomfort, results suggest that virtual reality can significantly reduce hypothetical bias in choice experiments.

Suggested Citation

  • Di Fang & Rodolfo M. Nayga & Grant H. West & Claudia Bazzani & Wei Yang & Benjamin C. Lok & Charles E. Levy & Heather A. Snell, 2021. "On the Use of Virtual Reality in Mitigating Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 142-161, January.
  • Handle: RePEc:wly:ajagec:v:103:y:2021:i:1:p:142-161
    DOI: 10.1111/ajae.12118
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/ajae.12118
    Download Restriction: no

    File URL: https://libkey.io/10.1111/ajae.12118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. D. Fang & R. M. Nayga & H. A. Snell & G. H. West & C. Bazzani, 2019. "Evaluating USA’s New Nutrition and Supplement Facts Label: Evidence from a Non-hypothetical Choice Experiment," Journal of Consumer Policy, Springer, vol. 42(4), pages 545-562, December.
    2. Matthews, Yvonne & Scarpa, Riccardo & Marsh, Dan, 2017. "Using virtual environments to improve the realism of choice experiments: A case study about coastal erosion management," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 193-208.
    3. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    4. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    5. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    6. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    7. Frode Alfnes & Chengyan Yue & Helen H. Jensen, 2010. "Cognitive dissonance as a means of reducing hypothetical bias," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 37(2), pages 147-163, June.
    8. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    9. Innocenti, Alessandro, 2017. "Virtual reality experiments in economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 71-77.
    10. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    11. Scarpa, Riccardo & Rose, John M., 2008. "Design efficiency for non-market valuation with choice modelling: how to measure it, what to report and why," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 52(3), pages 1-30.
    12. Brownstone, David & Small, Kenneth A., 2005. "Valuing time and reliability: assessing the evidence from road pricing demonstrations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(4), pages 279-293, May.
    13. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    14. Scott J. Savage & Donald M. Waldman, 2008. "Learning and fatigue during choice experiments: a comparison of online and mail survey modes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 351-371.
    15. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    16. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    17. Papoutsi, Georgia S. & Nayga, Rodolfo M. & Lazaridis, Panagiotis & Drichoutis, Andreas C., 2015. "Fat tax, subsidy or both? The role of information and children's pester power in food choice," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 196-208.
    18. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    19. Andreas C. Drichoutis & Panagiotis Lazaridis & Rodolfo M. Nayga, 2005. "Nutrition knowledge and consumer use of nutritional food labels," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 32(1), pages 93-118, March.
    20. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    21. Depositario, Dinah Pura T. & Nayga Jr., Rodolfo M. & Wu, Ximing & Laude, Tiffany P., 2009. "Should students be used as subjects in experimental auctions?," Economics Letters, Elsevier, vol. 102(2), pages 122-124, February.
    22. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    23. Denzil G. Fiebig & Michael P. Keane & Jordan Louviere & Nada Wasi, 2010. "The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity," Marketing Science, INFORMS, vol. 29(3), pages 393-421, 05-06.
    24. Bateman, Ian J. & Day, Brett H. & Jones, Andrew P. & Jude, Simon, 2009. "Reducing gain-loss asymmetry: A virtual reality choice experiment valuing land use change," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 106-118, July.
    25. Van Wezemael, Lynn & Caputo, Vincenzina & Nayga, Rodolfo M. & Chryssochoidis, George & Verbeke, Wim, 2014. "European consumer preferences for beef with nutrition and health claims: A multi-country investigation using discrete choice experiments," Food Policy, Elsevier, vol. 44(C), pages 167-176.
    26. Sarrias, Mauricio & Daziano, Ricardo, 2017. "Multinomial Logit Models with Continuous and Discrete Individual Heterogeneity in R: The gmnl Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 79(i02).
    27. Jayson L. Lusk & F. Bailey Norwood, 2009. "An Inferred Valuation Method," Land Economics, University of Wisconsin Press, vol. 85(3), pages 500-514.
    28. Pierre-Alexandre Mahieu & Pere Riera & Marek Giergiczny, 2012. "The influence of cheap talk on willingness-to-pay ranges: some empirical evidence from a contingent valuation study," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 55(6), pages 753-763, September.
    29. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    30. William D. Schulze & Ralph C. d'Arge & David S. Brookshire, 1981. "Valuing Environmental Commodities: Some Recent Experiments," Land Economics, University of Wisconsin Press, vol. 57(2), pages 151-172.
    31. Isacsson, Gunnar, 2007. "The trade off between time and money: Is there a difference between real and hypothetical choices?," Working Papers 2007:3, Swedish National Road & Transport Research Institute (VTI).
    32. Muhammad Bello & Awudu Abdulai, 2016. "Impact of Ex-Ante Hypothetical Bias Mitigation Methods on Attribute Non-Attendance in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(5), pages 1486-1506.
    33. Gregory Howard & Brian E. Roe & Erik C. Nisbet & Jay F. Martin, 2017. "Hypothetical Bias Mitigation Techniques in Choice Experiments: Do Cheap Talk and Honesty Priming Effects Fade with Repeated Choices?," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 543-573.
    34. F. Bailey Norwood & Jayson L. Lusk, 2011. "Social Desirability Bias in Real, Hypothetical, and Inferred Valuation Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(2), pages 528-534.
    35. Silva, Andres & Nayga, Rodolfo M., Jr. & Campbell, Benjamin L. & Park, John L., 2011. "Revisiting Cheap Talk with New Evidence from a Field Experiment," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 36(2), pages 1-12, August.
    36. Andreas C. Drichoutis & Achilleas Vassilopoulos & Jayson L. Lusk & Rodolfo M. NaygaJr., 2017. "Consumer preferences for fair labour certification," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 44(3), pages 455-474.
    37. William Greene & David Hensher, 2010. "Does scale heterogeneity across individuals matter? An empirical assessment of alternative logit models," Transportation, Springer, vol. 37(3), pages 413-428, May.
    38. Fiore, Stephen M. & Harrison, Glenn W. & Hughes, Charles E. & Rutstrm, E. Elisabet, 2009. "Virtual experiments and environmental policy," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 65-86, January.
    39. Balcombe, Kelvin & Chalak, Ali & Fraser, Iain, 2009. "Model selection for the mixed logit with Bayesian estimation," Journal of Environmental Economics and Management, Elsevier, vol. 57(2), pages 226-237, March.
    40. Tiziana de-Magistris & Azucena Gracia & Rodolfo M. Nayga, 2013. "On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(5), pages 1136-1154.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hanna Ihli & Ronja Seegers & Etti Winter & Brian Chiputwa & Anja Gassner, 2022. "Preferences for tree fruit market attributes among smallholder farmers in Eastern Rwanda," Agricultural Economics, International Association of Agricultural Economists, vol. 53(1), pages 5-21, January.
    2. Yuan, Rao & Asioli, Daniele & Jin, Shaosheng & Nayga, Rodolfo M., 2021. "Consumers’ Valuation for Cultured Chicken Meat: A Multi-city Choice Experiment in China," 2021 Annual Meeting, August 1-3, Austin, Texas 313957, Agricultural and Applied Economics Association.
    3. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    4. Daniele Asioli & Marija Banovic & Ada Maria Barone & Simona Grasso & Rodolfo M. Nayga, 2023. "European consumers' valuation for hybrid meat: Does information matter?," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(1), pages 44-62, March.
    5. Fabio Boncinelli & Andrea Dominici & Federico Bondioni & Enrico Marone, 2024. "Consumers bahavior towards the country of origin labeling policy: The case of the pasta market in Italy," Agribusiness, John Wiley & Sons, Ltd., vol. 40(1), pages 46-69, January.
    6. Kar Ho Lim & Wuyang Hu, 2023. "Contextual reference price in choice experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(4), pages 1288-1306, August.
    7. Schmiess, Jacob S. & Lusk, Jayson L., 2022. "Tradeoff between Animal Welfare and Environmental Impacts of Beef Production: An Analysis of Presentation Effects on Consumer Choice," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 47(2), May.
    8. Caputo, Vincenzina & Lusk, Jayson L., 2022. "The Basket-Based Choice Experiment: A Method for Food Demand Policy Analysis," Food Policy, Elsevier, vol. 109(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    3. D. Fang & R. M. Nayga & H. A. Snell & G. H. West & C. Bazzani, 2019. "Evaluating USA’s New Nutrition and Supplement Facts Label: Evidence from a Non-hypothetical Choice Experiment," Journal of Consumer Policy, Springer, vol. 42(4), pages 545-562, December.
    4. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    5. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    6. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    7. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    8. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    9. Wuepper, David & Clemm, Alexandra & Wree, Philipp, 2019. "The preference for sustainable coffee and a new approach for dealing with hypothetical bias," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 475-486.
    10. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    11. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    12. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    13. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    14. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    15. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    16. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    17. de-Magistris, Tiziana & Pascucci, Stefano, 2014. "The effect of the solemn oath script in hypothetical choice experiment survey: A pilot study," Economics Letters, Elsevier, vol. 123(2), pages 252-255.
    18. West, Grant H. & Snell, Heather & Kovacs, Kent & Nayga, Rodolfo M., 2020. "Estimation of the preferences for the intertemporal services from groundwater," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304220, Agricultural and Applied Economics Association.
    19. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    20. Kar Ho Lim & Wuyang Hu, 2023. "Contextual reference price in choice experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(4), pages 1288-1306, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:ajagec:v:103:y:2021:i:1:p:142-161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1467-8276 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.