IDEAS home Printed from https://ideas.repec.org/a/ags/aareaj/186962.html
   My bibliography  Save this article

Predicting versus testing: a conditional cross-forecasting accuracy measure for hypothetical bias

Author

Listed:
  • Volinskiy, Dmitriy
  • Adamowicz, Wiktor L.
  • Veeman, Michele

Abstract

A measure of hypothetical bias, or the divergence between stated and revealed preferences, based on conditional cross-forecasting accuracy is suggested, based on out-ofsample prediction accuracy when estimates from stated preference data are used in place of those from actual choices, and vice versa. We describe an application of this measure to assess hypothetical bias in the context of an inquiry into people’s willingness to pay to avoid canola oil produced from genetically modified plants. The analysis suggests the presence of groupwise hypothetical bias in these choice data.

Suggested Citation

  • Volinskiy, Dmitriy & Adamowicz, Wiktor L. & Veeman, Michele, 2011. "Predicting versus testing: a conditional cross-forecasting accuracy measure for hypothetical bias," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 55(3), pages 1-22, September.
    • Handle: RePEc:ags:aareaj:186962
    DOI: 10.22004/ag.econ.186962
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/186962/files/j.1467-8489.2011.00552.x.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.186962?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1997. "Evaluating the Validity of the Dichotomous Choice Question Format in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(2), pages 109-123, September.
    2. von Haefen, Roger H. & Phaneuf, Daniel J., 2008. "Identifying demand parameters in the presence of unobservables: A combined revealed and stated preference approach," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 19-32, July.
    3. Mariah D. Ehmke & Jayson L. Lusk & John A. List, 2008. "Is Hypothetical Bias a Universal Phenomenon? A Multinational Investigation," Land Economics, University of Wisconsin Press, vol. 84(3), pages 489-500.
    4. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    5. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    6. Cummings, Ronald G & Harrison, Glenn W & Rutstrom, E Elisabet, 1995. "Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible?," American Economic Review, American Economic Association, vol. 85(1), pages 260-266, March.
    7. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    8. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    9. Krinsky, Itzhak & Robb, A Leslie, 1991. "Three Methods for Calculating the Statistical Properties of Elasticities: A Comparison," Empirical Economics, Springer, vol. 16(2), pages 199-209.
    10. M. K. Haener & P. C. Boxall & W. L. Adamowicz, 2001. "Modeling Recreation Site Choice: Do Hypothetical Choices Reflect Actual Behavior?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 629-642.
    11. Charles Noussair & StÈphane Robin & Bernard Ruffieux, 2004. "Do Consumers Really Refuse To Buy Genetically Modified Food?," Economic Journal, Royal Economic Society, vol. 114(492), pages 102-120, January.
    12. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    13. Harrison, Glenn W. & Rutström, E. Elisabet, 2008. "Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 81, pages 752-767, Elsevier.
    14. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Craig D. Broadbent, 2014. "Evaluating mitigation and calibration techniques for hypothetical bias in choice experiments," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 57(12), pages 1831-1848, December.
    2. Craig D. Broadbent, 2012. "Hypothetical Bias, Consequentiality and Choice Experiments," Economics Bulletin, AccessEcon, vol. 32(3), pages 2490-2499.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    2. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    3. Kanya, Lucy & Sanghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: A systematic review and meta-analysis of the evidence," Social Science & Medicine, Elsevier, vol. 232(C), pages 238-261.
    4. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    5. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    6. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    7. Hofstetter, Reto & Miller, Klaus M. & Krohmer, Harley & Zhang, Z. John, 2021. "A de-biased direct question approach to measuring consumers' willingness to pay," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 70-84.
    8. Gubanova, Tatiana & Adamowicz, Wiktor L. & McMillan, Melville, 2009. "‘Pocket and Pot’: Hypothetical Bias in a No-Free-Riding Public Contribution Game," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49318, Agricultural and Applied Economics Association.
    9. Félix Muñoz-García & Tongzhe Li, 2018. "Explaining Hypothetical Bias Variations Using Income Elasticity of Demand," Homo Oeconomicus: Journal of Behavioral and Institutional Economics, Springer, vol. 35(3), pages 207-224, September.
    10. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    11. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    12. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    13. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    14. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    15. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    16. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    17. Frode Alfnes & Chengyan Yue & Helen H. Jensen, 2010. "Cognitive dissonance as a means of reducing hypothetical bias," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 37(2), pages 147-163, June.
    18. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 33(2), pages 1-11, October.
    19. Kees Vringer & Eline van der Heijden & Daan van Soest & Herman Vollebergh & Frank Dietz, 2017. "Sustainable Consumption Dilemmas," Sustainability, MDPI, vol. 9(6), pages 1-21, June.
    20. Jayson L. Lusk & Darren Hudson, 2004. "Willingness-to-Pay Estimates and Their Relevance to Agribusiness Decision Making," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 26(2), pages 152-169.

    More about this item

    Keywords

    Labor and Human Capital;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aareaj:186962. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaresea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.