IDEAS home Printed from https://ideas.repec.org/a/bla/ajarec/v55y2011i3p429-450.html
   My bibliography  Save this article

Predicting versus testing: a conditional cross‐forecasting accuracy measure for hypothetical bias

Author

Listed:
  • Dmitriy Volinskiy
  • Wiktor Adamowicz
  • Michele Veeman

Abstract

A measure of hypothetical bias, or the divergence between stated and revealed preferences, based on conditional cross-forecasting accuracy is suggested, based on out-ofsample prediction accuracy when estimates from stated preference data are used in place of those from actual choices, and vice versa. We describe an application of this measure to assess hypothetical bias in the context of an inquiry into people’s willingness to pay to avoid canola oil produced from genetically modified plants. The analysis suggests the presence of groupwise hypothetical bias in these choice data.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Dmitriy Volinskiy & Wiktor Adamowicz & Michele Veeman, 2011. "Predicting versus testing: a conditional cross‐forecasting accuracy measure for hypothetical bias," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 55(3), pages 429-450, July.
    • Handle: RePEc:bla:ajarec:v:55:y:2011:i:3:p:429-450
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. von Haefen, Roger H. & Phaneuf, Daniel J., 2008. "Identifying demand parameters in the presence of unobservables: A combined revealed and stated preference approach," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 19-32, July.
    2. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    3. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    4. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1997. "Evaluating the Validity of the Dichotomous Choice Question Format in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(2), pages 109-123, September.
    5. Cummings, Ronald G & Harrison, Glenn W & Rutstrom, E Elisabet, 1995. "Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible?," American Economic Review, American Economic Association, vol. 85(1), pages 260-266, March.
    6. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    7. M. K. Haener & P. C. Boxall & W. L. Adamowicz, 2001. "Modeling Recreation Site Choice: Do Hypothetical Choices Reflect Actual Behavior?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 629-642.
    8. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    9. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    10. Krinsky, Itzhak & Robb, A Leslie, 1991. "Three Methods for Calculating the Statistical Properties of Elasticities: A Comparison," Empirical Economics, Springer, vol. 16(2), pages 199-209.
    11. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    12. Mariah D. Ehmke & Jayson L. Lusk & John A. List, 2008. "Is Hypothetical Bias a Universal Phenomenon? A Multinational Investigation," Land Economics, University of Wisconsin Press, vol. 84(3), pages 489-500.
    13. Charles Noussair & StÈphane Robin & Bernard Ruffieux, 2004. "Do Consumers Really Refuse To Buy Genetically Modified Food?," Economic Journal, Royal Economic Society, vol. 114(492), pages 102-120, January.
    14. Harrison, Glenn W. & Rutström, E. Elisabet, 2008. "Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 81, pages 752-767, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Craig D. Broadbent, 2012. "Hypothetical Bias, Consequentiality and Choice Experiments," Economics Bulletin, AccessEcon, vol. 32(3), pages 2490-2499.
    2. Craig D. Broadbent, 2014. "Evaluating mitigation and calibration techniques for hypothetical bias in choice experiments," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 57(12), pages 1831-1848, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    2. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    3. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    4. Kanya, Lucy & Sanghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: A systematic review and meta-analysis of the evidence," Social Science & Medicine, Elsevier, vol. 232(C), pages 238-261.
    5. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    6. Hofstetter, Reto & Miller, Klaus M. & Krohmer, Harley & Zhang, Z. John, 2021. "A de-biased direct question approach to measuring consumers' willingness to pay," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 70-84.
    7. Gubanova, Tatiana & Adamowicz, Wiktor L. & McMillan, Melville, 2009. "‘Pocket and Pot’: Hypothetical Bias in a No-Free-Riding Public Contribution Game," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49318, Agricultural and Applied Economics Association.
    8. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    9. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    11. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    12. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    13. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    14. Félix Muñoz-García & Tongzhe Li, 2018. "Explaining Hypothetical Bias Variations Using Income Elasticity of Demand," Homo Oeconomicus: Journal of Behavioral and Institutional Economics, Springer, vol. 35(3), pages 207-224, September.
    15. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    16. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    17. Frode Alfnes & Chengyan Yue & Helen H. Jensen, 2010. "Cognitive dissonance as a means of reducing hypothetical bias," European Review of Agricultural Economics, Foundation for the European Review of Agricultural Economics, vol. 37(2), pages 147-163, June.
    18. Kees Vringer & Eline van der Heijden & Daan van Soest & Herman Vollebergh & Frank Dietz, 2017. "Sustainable Consumption Dilemmas," Sustainability, MDPI, vol. 9(6), pages 1-21, June.
    19. repec:ebl:ecbull:v:2:y:2007:i:1:p:1-9 is not listed on IDEAS
    20. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    21. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ajarec:v:55:y:2011:i:3:p:429-450. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/aaresea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.