IDEAS home Printed from https://ideas.repec.org/p/apl/wpaper/25-11.html

A Meta-Analysis of SBC Contingent Valuation: Willingness to Pay Estimates, Determinants of Reliability and Replication of Split-Sample Hypothesis Tests

Author

Listed:
  • John C. Whitehead
  • Tim Haas
  • Lynne Lewis
  • Leslie Richardson
  • Pete Schuhmann

Abstract

The single binary choice (SBC) question format, commonly used in contingent valuation studies and modeled as a hypothetical referendum, is considered incentive compatible when paired with a coercive payment vehicle and a consequential survey. Despite its dominance in the field, the SBC format yields limited information, which can result in imprecise and unreliable estimates of willingness to pay (WTP). This chapter explores the limitations of SBC using a meta-analysis dataset originally compiled by Lewis, Richardson, and Whitehead (2024) for nonparametric WTP estimation. We extend their work by analyzing parametric WTP estimates and comparing them with nonparametric Turnbull and adjusted Kristršm estimates. Our results show that parametric WTP can differ significantly from the Turnbull nonparametric estimate, and that confidence intervals derived from parametric models are often wider than those from non-paramteric WTP estimates. In a meta-regression, we find that the inefficiency of SBC decreases with data quality. We illustrate the importance of these issues with a replication of directional split-sample tests from the meta-data. Compared to parametric WTP estimates, tests using Turnbull and adjusted Kristršm estimates are more likely to detect statistically significant differences in WTP, underscoring the importance of robustness tests with alternative WTP estimates. Key Words:

Suggested Citation

  • John C. Whitehead & Tim Haas & Lynne Lewis & Leslie Richardson & Pete Schuhmann, 2025. "A Meta-Analysis of SBC Contingent Valuation: Willingness to Pay Estimates, Determinants of Reliability and Replication of Split-Sample Hypothesis Tests," Working Papers 25-11, Department of Economics, Appalachian State University.
    • Handle: RePEc:apl:wpaper:25-11
    as

    Download full text from publisher

    File URL: http://econ.appstate.edu/RePEc/pdf/wp2511.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christopher Giguere & Chris Moore & John C. Whitehead, 2020. "Valuing Hemlock Woolly Adelgid Control in Public Forests: Scope Effects with Attribute Nonattendance," Land Economics, University of Wisconsin Press, vol. 96(1), pages 25-42.
    2. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    3. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    4. Czajkowski, Mikołaj & Zawojska, Ewa & Meade, Norman & da Motta, Ronaldo Seroa & Welsh, Mike & Ortiz, Ramon Arigoni, 2024. "On the inference about a willingness-to-pay distribution using contingent valuation data," Ecological Economics, Elsevier, vol. 222(C).
    5. Haab, Timothy C. & McConnell, Kenneth E., 1997. "Referendum Models and Negative Willingness to Pay: Alternative Solutions," Journal of Environmental Economics and Management, Elsevier, vol. 32(2), pages 251-270, February.
    6. W. Michael Hanemann, 1989. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Response Data: Reply," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(4), pages 1057-1061.
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. W. Michael Hanemann, 1984. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 66(3), pages 332-341.
    9. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    10. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    11. Arne Risa Hole, 2007. "A comparison of approaches to estimating confidence intervals for willingness to pay measures," Health Economics, John Wiley & Sons, Ltd., vol. 16(8), pages 827-840, August.
    12. Richard Carson & Robert Mitchell & Michael Hanemann & Raymond Kopp & Stanley Presser & Paul Ruud, 2003. "Contingent Valuation and Lost Passive Use: Damages from the Exxon Valdez Oil Spill," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 257-286, July.
    13. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    14. Park, Timothy A. & Loomis, John B., 1992. "Comparing Models For Contingent Valuation Surveys: Statistical Efficiency And The Precision Of Benefit Estimates," Northeastern Journal of Agricultural and Resource Economics, Northeastern Agricultural and Resource Economics Association, vol. 21(2), pages 1-7, October.
    15. Cho, Hyun-Chul & Abe, Shuzo, 2013. "Is two-tailed testing for directional research hypotheses tests legitimate?," Journal of Business Research, Elsevier, vol. 66(9), pages 1261-1266.
    16. Michael Hanemann & John Loomis & Barbara Kanninen, 1991. "Statistical Efficiency of Double-Bounded Dichotomous Choice Contingent Valuation," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 73(4), pages 1255-1263.
    17. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    18. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    19. Leslie Richardson & Lynne Lewis, 2022. "Getting to know you: individual animals, wildlife webcams, and willingness to pay for brown bear preservation," American Journal of Agricultural Economics, John Wiley & Sons, vol. 104(2), pages 673-692, March.
    20. John C. Whitehead, 2002. "Incentive Incompatibility and Starting-Point Bias in Iterative Valuation Questions," Land Economics, University of Wisconsin Press, vol. 78(2), pages 285-297.
    21. Aurelia Bengochea-Morancho & Ana Fuertes-Eugenio & Salvador Saz-Salazar, 2005. "A comparison of empirical models used to infer the willingness to pay in contingent valuation," Empirical Economics, Springer, vol. 30(1), pages 235-244, January.
    22. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Manuel Frondel & Stephan Sommer & Lukas Tomberg, 2021. "WTA-WTP Disparity: The Role of Perceived Realism of the Valuation Setting," Land Economics, University of Wisconsin Press, vol. 97(1), pages 196-206.
    3. Richard C. Bishop & Kevin J. Boyle, 2021. "On Adding-Up as a Validity Criterion for Stated-Preference Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 80(3), pages 587-601, November.
    4. Gordillo, Fernando & Elsasser, Peter & Günter, Sven, 2019. "Willingness to pay for forest conservation in Ecuador: Results from a nationwide contingent valuation survey in a combined “referendum” – “Consequential open-ended” design," Forest Policy and Economics, Elsevier, vol. 105(C), pages 28-39.
    5. José L Oviedo & Pablo Campos & Alejandro Caparrós, 2022. "Contingent valuation of landowner demand for forest amenities: application in Andalusia, Spain," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(3), pages 615-643.
    6. Czajkowski, Mikołaj & Zawojska, Ewa & Meade, Norman & da Motta, Ronaldo Seroa & Welsh, Mike & Ortiz, Ramon Arigoni, 2024. "On the inference about a willingness-to-pay distribution using contingent valuation data," Ecological Economics, Elsevier, vol. 222(C).
    7. Ghanem, Samar & Ferrini, Silvia & Di Maria, Corrado, 2023. "Air pollution and willingness to pay for health risk reductions in Egypt: A contingent valuation survey of Greater Cairo and Alexandria households," World Development, Elsevier, vol. 172(C).
    8. John C. Whitehead & Alicia Louis Cornicelli & Gregory Howard, 2024. "Total Economic Valuation of Great Lakes Recreational Fisheries: Attribute Non-attendance, Hypothetical Bias and Insensitivity to Scope," Working Papers 24-10, Department of Economics, Appalachian State University.
    9. Erik Brynjolfsson & Avinash Collis & Felix Eggers, 2019. "Using massive online choice experiments to measure changes in well-being," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(15), pages 7250-7255, April.
    10. Ndebele, Tom & Forgie, Vicky, 2017. "Estimating the economic benefits of a wetland restoration programme in New Zealand: A contingent valuation approach," Economic Analysis and Policy, Elsevier, vol. 55(C), pages 75-89.
    11. Andor, Mark A. & Lange, Andreas & Sommer, Stephan, 2022. "Fairness and the support of redistributive environmental policies," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    12. David Worden & Getu Hailu & Kate Jones & Yu Na Lee, 2022. "The effects of bundling on livestock producers' valuations of environmentally friendly traits available through genomic selection," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 70(4), pages 263-286, December.
    13. John C. Whitehead, "undated". "A Comment on “An Adding Up Test on Contingent Valuations of River and Lake Quality”," Working Papers 17-01_R, Department of Economics, Appalachian State University.
    14. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    15. Czajkowski, Mikołaj & Meade, Norman & Seroa da Motta, Ronaldo & Ortiz, Ramon Arigoni & Welsh, Mike & Blanc, Gleiciane Carvalho, 2023. "Estimating environmental and cultural/heritage damages of a tailings dam failure: The case of the Fundão dam in Brazil," Journal of Environmental Economics and Management, Elsevier, vol. 121(C).
    16. Pengfei Liu & Xiaohui Tian, 2021. "Downward Hypothetical Bias in the Willingness to Accept Measure for Private Goods: Evidence from a Field Experiment," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(5), pages 1679-1699, October.
    17. Alix-Garcia, Jennifer M. & Sims, Katharine R.E. & Phaneuf, Daniel J., 2019. "Using referenda to improve targeting and decrease costs of conditional cash transfers," Journal of Public Economics, Elsevier, vol. 176(C), pages 179-194.
    18. W. Michael Hanemann, 1994. "Valuing the Environment through Contingent Valuation," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 19-43, Fall.
    19. Michaël Schwarzinger & Fabrice Carrat & Stéphane Luchini, 2009. ""If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question". Evidence from a double-bounded dichotomous choice model with heterogeneous anchori," Post-Print inserm-00636179, HAL.
    20. Scarpa, Riccardo & Chilton, Susan M. & Hutchinson, W. George & Buongiorno, Joseph, 2000. "Valuing the recreational benefits from the creation of nature reserves in Irish forests," Ecological Economics, Elsevier, vol. 33(2), pages 237-250, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:apl:wpaper:25-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: O. Ashton Morgan (email available below). General contact details of provider: https://edirc.repec.org/data/deappus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.