IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v84y2012i1p201-215.html
   My bibliography  Save this article

Eliciting and estimating valid subjective probabilities: An experimental investigation of the exchangeability method

Author

Listed:
  • Cerroni, Simone
  • Notaro, Sandra
  • Shaw, W. Douglass

Abstract

Using a laboratory experiment, we investigate whether incentive compatibility affects subjective probabilities elicited via the exchangeability method (EM), an elicitation technique consisting of several chained questions. We hypothesize that subjects who are aware of the chaining strategically behave and provide invalid subjective probabilities, while subjects who are not aware of the chaining state their real beliefs and provide valid subjective probabilities. The validity of subjective probabilities is investigated using de Finetti's notion of coherence, under which probability estimates are valid if and only if they obey all axioms of probability theory.

Suggested Citation

  • Cerroni, Simone & Notaro, Sandra & Shaw, W. Douglass, 2012. "Eliciting and estimating valid subjective probabilities: An experimental investigation of the exchangeability method," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 201-215.
    • Handle: RePEc:eee:jeborg:v:84:y:2012:i:1:p:201-215
    DOI: 10.1016/j.jebo.2012.08.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268112001539
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jebo.2012.08.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:feb:framed:0074 is not listed on IDEAS
    2. Steffen Andersen & John Fountain & Glenn Harrison & E. Rutström, 2014. "Estimating subjective probabilities," Journal of Risk and Uncertainty, Springer, vol. 48(3), pages 207-229, June.
    3. Mohammed Abdellaoui & Aurelien Baillon & Laetitia Placido & Peter P. Wakker, 2011. "The Rich Domain of Uncertainty: Source Functions and Their Experimental Implementation," American Economic Review, American Economic Association, vol. 101(2), pages 695-723, April.
    4. Corso, Phaedra S & Hammitt, James K & Graham, John D, 2001. "Valuing Mortality-Risk Reduction: Using Visual Aids to Improve the Validity of Contingent Valuation," Journal of Risk and Uncertainty, Springer, vol. 23(2), pages 165-184, September.
    5. Peter Wakker & Daniel Deneffe, 1996. "Eliciting von Neumann-Morgenstern Utilities When Probabilities Are Distorted or Unknown," Management Science, INFORMS, vol. 42(8), pages 1131-1150, August.
    6. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    7. Buzby, Jean C. & Fox, John A. & Ready, Richard C. & Crutchfleld, Stephen R., 1998. "Measuring Consumer Benefits of Food Safety Risk Reductions," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 30(1), pages 69-82, July.
    8. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, March.
    9. Viscusi, W Kip, 1990. "Do Smokers Underestimate Risks?," Journal of Political Economy, University of Chicago Press, vol. 98(6), pages 1253-1269, December.
    10. Vossler, Christian A. & Evans, Mary F., 2009. "Bridging the gap between the field and the lab: Environmental goods, policy maker input, and consequentiality," Journal of Environmental Economics and Management, Elsevier, vol. 58(3), pages 338-345, November.
    11. Fiore, Stephen M. & Harrison, Glenn W. & Hughes, Charles E. & Rutstrm, E. Elisabet, 2009. "Virtual experiments and environmental policy," Journal of Environmental Economics and Management, Elsevier, vol. 57(1), pages 65-86, January.
    12. Carl S. Spetzler & Carl-Axel S. Staël Von Holstein, 1975. "Exceptional Paper--Probability Encoding in Decision Analysis," Management Science, INFORMS, vol. 22(3), pages 340-358, November.
    13. Kivi, Paul A. & Shogren, Jason F., 2010. "Second-Order Ambiguity in Very Low Probability Risks: Food Safety Valuation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 35(3), pages 1-14, December.
    14. Theo Offerman & Joep Sonnemans & Gijs Van De Kuilen & Peter P. Wakker, 2009. "A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes ," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1461-1489.
    15. Riddel, Mary C. & Shaw, W. Douglass, 2006. "A Theoretically-Consistent Empirical Non-Expected Utility Model of Ambiguity: Nuclear Waste Mortality Risk and Yucca Mountain," Pre-Prints 23964, Texas A&M University, Department of Agricultural Economics.
    16. Hammitt, James K & Graham, John D, 1999. "Willingness to Pay for Health Protection: Inadequate Sensitivity to Probability?," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 33-62, April.
    17. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    18. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    19. Aurélien Baillon, 2008. "Eliciting Subjective Probabilities Through Exchangeable Events: An Advantage and a Limitation," Decision Analysis, INFORMS, vol. 5(2), pages 76-87, June.
    20. W. Douglass Shaw & Paul M. Jakus & Mary Riddel, 2012. "Perceived Arsenic-Related Mortality Risks For Smokers And Non-Smokers," Contemporary Economic Policy, Western Economic Association International, vol. 30(3), pages 417-429, July.
    21. Chew Soo Hong & Jacob S. Sagi, 2006. "Event Exchangeability: Probabilistic Sophistication Without Continuity or Monotonicity," Econometrica, Econometric Society, vol. 74(3), pages 771-786, May.
    22. Jakus, Paul M. & Shaw, W. Douglass & Nguyen, To N. & Walker, Mark, 2009. "Risk Perceptions of Arsenic in Tap Water and Consumption of Bottled Water," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49221, Agricultural and Applied Economics Association.
    23. Michael Kilka & Martin Weber, 2001. "What Determines the Shape of the Probability Weighting Function Under Uncertainty?," Management Science, INFORMS, vol. 47(12), pages 1712-1726, December.
    24. Harrison, Glenn W., 1986. "An experimental test for risk aversion," Economics Letters, Elsevier, vol. 21(1), pages 7-11.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thierry Kalisa & Mary Riddel & W. Douglass Shaw, 2016. "Willingness to pay to avoid arsenic-related risks: a special regressor approach," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 5(2), pages 143-162, July.
    2. Chloe S McCallum & Simone Cerroni & Daniel Derbyshire & W George Hutchinson & Rodolfo M Nayga, 2022. "Consumers’ responses to food fraud risks: an economic experiment," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 942-969.
    3. Mohammed Abdellaoui & Han Bleichrodt & Cédric Gutierrez, 2023. "Unpacking Overconfident Behavior When Betting on Oneself," Post-Print hal-04383402, HAL.
    4. Cerroni, Simone & Notaro, Sandra & Raffaelli, Roberta & Shaw, Douglass W., 2013. "The incorporation of subjective risks into choice experiments to test scenario adjustment," 2013 Second Congress, June 6-7, 2013, Parma, Italy 149894, Italian Association of Agricultural and Applied Economics (AIEAA).
    5. Mei Cai & Wenfei Xiu & Guo Wei, 2021. "Expected loss utility for natural hazards and its application in pricing property insurance products," Environment Systems and Decisions, Springer, vol. 41(3), pages 377-391, September.
    6. Riccardo Scarpa & Claudia Bazzani & Diego Begalli & Roberta Capitello, 2021. "Resolvable and Near‐epistemic Uncertainty in Stated Preference for Olive Oil: An Empirical Exploration," Journal of Agricultural Economics, Wiley Blackwell, vol. 72(2), pages 335-369, June.
    7. Cerroni, Simone & Notaro, Sandra & Shaw, W. Douglass, 2013. "How many bad apples are in a bunch? An experimental investigation of perceived pesticide residue risks," Food Policy, Elsevier, vol. 41(C), pages 112-123.
    8. Simone Cerroni, 2020. "Eliciting farmers’ subjective probabilities, risk, and uncertainty preferences using contextualized field experiments," Agricultural Economics, International Association of Agricultural Economists, vol. 51(5), pages 707-724, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simone Cerroni & Sandra Notaro & W. Douglass Shaw, 2011. "Do Monetary Incentives and Chained Questions Affect the Validity of Risk Estimates Elicited via the Exchangeability Method? An Experimental Investigation," Department of Economics Working Papers 1110, Department of Economics, University of Trento, Italia.
    2. Cerroni, Simone & Shaw, W. Douglass, 2012. "Does climate change information affect stated risks of pine beetle impacts on forests? An application of the exchangeability method," Forest Policy and Economics, Elsevier, vol. 22(C), pages 72-84.
    3. Cerroni, Simone & Notaro, Sandra & Shaw, W. Douglass, 2013. "How many bad apples are in a bunch? An experimental investigation of perceived pesticide residue risks," Food Policy, Elsevier, vol. 41(C), pages 112-123.
    4. Cerroni, Simone & Notaro, Sandra & Shaw, W. Douglass, 2012. "The validity of risk estimates elicited via the Exchangeability Method: An experimental investigation of consumers’ perceived health risks," 2012 First Congress, June 4-5, 2012, Trento, Italy 124100, Italian Association of Agricultural and Applied Economics (AIEAA).
    5. Mohammed Abdellaoui & Han Bleichrodt & Cédric Gutierrez, 2023. "Unpacking Overconfident Behavior When Betting on Oneself," Post-Print hal-04383402, HAL.
    6. Simone Cerroni, 2020. "Eliciting farmers’ subjective probabilities, risk, and uncertainty preferences using contextualized field experiments," Agricultural Economics, International Association of Agricultural Economists, vol. 51(5), pages 707-724, September.
    7. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    8. Cerroni, Simone & Notaro, Sandra & Raffaelli, Roberta & Shaw, Douglass W., 2013. "The incorporation of subjective risks into choice experiments to test scenario adjustment," 2013 Second Congress, June 6-7, 2013, Parma, Italy 149894, Italian Association of Agricultural and Applied Economics (AIEAA).
    9. Gijs van de Kuilen & Peter P. Wakker, 2011. "The Midweight Method to Measure Attitudes Toward Risk and Ambiguity," Management Science, INFORMS, vol. 57(3), pages 582-598, March.
    10. Aurélien Baillon, 2008. "Eliciting Subjective Probabilities Through Exchangeable Events: An Advantage and a Limitation," Decision Analysis, INFORMS, vol. 5(2), pages 76-87, June.
    11. Mohammed Abdellaoui & Han Bleichrodt & Emmanuel Kemel & Olivier l’Haridon, 2021. "Measuring Beliefs Under Ambiguity," Operations Research, INFORMS, vol. 69(2), pages 599-612, March.
    12. Stephen G. Dimmock & Roy Kouwenberg & Peter P. Wakker, 2016. "Ambiguity Attitudes in a Large Representative Sample," Management Science, INFORMS, vol. 62(5), pages 1363-1380, May.
    13. Cathleen Johnson & Aurélien Baillon & Han Bleichrodt & Zhihua Li & Dennie Dolder & Peter P. Wakker, 2021. "Prince: An improved method for measuring incentivized preferences," Journal of Risk and Uncertainty, Springer, vol. 62(1), pages 1-28, February.
    14. Mohammed Abdellaoui & Aurelien Baillon & Laetitia Placido & Peter P. Wakker, 2011. "The Rich Domain of Uncertainty: Source Functions and Their Experimental Implementation," American Economic Review, American Economic Association, vol. 101(2), pages 695-723, April.
    15. Aurélien Baillon & Han Bleichrodt & Umut Keskin & Olivier L'Haridon & Author-Name: Chen Li, 2013. "Learning under ambiguity: An experiment using initial public offerings on a stock market," Economics Working Paper Archive (University of Rennes 1 & University of Caen) 201331, Center for Research in Economics and Management (CREM), University of Rennes 1, University of Caen and CNRS.
    16. Armantier, Olivier & Treich, Nicolas, 2013. "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging," European Economic Review, Elsevier, vol. 62(C), pages 17-40.
    17. Foster, Gigi & Frijters, Paul & Schaffner, Markus & Torgler, Benno, 2018. "Expectation formation in an evolving game of uncertainty: New experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 154(C), pages 379-405.
    18. Attema, Arthur E. & Brouwer, Werner B.F., 2012. "A test of independence of discounting from quality of life," Journal of Health Economics, Elsevier, vol. 31(1), pages 22-34.
    19. Tsang, Ming, 2020. "Estimating uncertainty aversion using the source method in stylized tasks with varying degrees of uncertainty," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    20. Epper, Thomas & Fehr-Duda, Helga, 2017. "A Tale of Two Tails: On the Coexistence of Overweighting and Underweighting of Rare Extreme Events," Economics Working Paper Series 1705, University of St. Gallen, School of Economics and Political Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:84:y:2012:i:1:p:201-215. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.