IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v80y2021i3d10.1007_s10640-021-00599-1.html
   My bibliography  Save this article

On Adding-Up as a Validity Criterion for Stated-Preference Studies

Author

Listed:
  • Richard C. Bishop

    (University of Wisconsin-Madison)

  • Kevin J. Boyle

    (Virginia Tech)

Abstract

The adding-up test, which requires that the value of a bundle of goods or services be equal to the sum of the values of its component parts, has been proposed as a validity criterion for stated-preference studies. Though rooted in accepted theory, this proposal raises practical issues that need to be resolved before it is ready for implementation. It requires assumptions about preferences beyond those required for other validity tests such as the scope test. Surveys to implement adding up also increase respondent burden and may compromise consequentiality. These and other issues are reviewed and research strategies to address them are considered.

Suggested Citation

  • Richard C. Bishop & Kevin J. Boyle, 2021. "On Adding-Up as a Validity Criterion for Stated-Preference Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 80(3), pages 587-601, November.
    • Handle: RePEc:kap:enreec:v:80:y:2021:i:3:d:10.1007_s10640-021-00599-1
    DOI: 10.1007/s10640-021-00599-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10640-021-00599-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10640-021-00599-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. H. Spencer Banzhaf & V. Kerry Smith, 2007. "Meta-analysis in model implementation: choice sets and the valuation of air quality improvements," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(6), pages 1013-1031.
    2. Stephen C. Newbold & Patrick J. Walsh & D. Matthew Massey & Julie Hewitt, 2018. "Using structural restrictions to achieve theoretical consistency in benefit transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(3), pages 529-553, March.
    3. von Haefen, Roger H. & Phaneuf, Daniel J., 2008. "Identifying demand parameters in the presence of unobservables: A combined revealed and stated preference approach," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 19-32, July.
    4. Joel Corona & Todd Doley & Charles Griffiths & Matthew Massey & Chris Moore & Stephen Muela & Brenda Rashleigh & William Wheeler & Stephen D. Whitlock & Julie Hewitt, 2020. "An Integrated Assessment Model for Valuing Water Quality Changes in the United States," Land Economics, University of Wisconsin Press, vol. 96(4), pages 478-492.
    5. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    6. Haupt, Harry & Oberhofer, Walter, 2006. "Generalized adding-up in systems of regression equations," Economics Letters, Elsevier, vol. 92(2), pages 263-269, August.
    7. Heberlein, Thomas A. & Wilson, Matthew A. & Bishop, Richard C. & Schaeffer, Nora Cate, 2005. "Rethinking the scope test as a criterion for validity in contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 50(1), pages 1-22, July.
    8. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    9. B. Ravikumar & Surajit Ray & N. Eugene Savin, 2000. "Robust Wald Tests in SUR Systems with Adding-up Restrictions," Econometrica, Econometric Society, vol. 68(3), pages 715-720, May.
    10. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    11. Karen M. Stilley & J. Jeffrey Inman & Kirk L. Wakefield, 2010. "Planning to Make Unplanned Purchases? The Role of In-Store Slack in Budget Deviation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 264-278, August.
    12. Jeremy Clark, 2002. "House Money Effects in Public Good Experiments," Experimental Economics, Springer;Economic Science Association, vol. 5(3), pages 223-231, December.
    13. William Desvousges & Kristy Mathews & Kenneth Train, 2015. "An Adding-up Test on Contingent Valuations of River and Lake Quality," Land Economics, University of Wisconsin Press, vol. 91(3), pages 556-571.
    14. Heather Klemick & Charles Griffiths & Dennis Guignet & Patrick Walsh, 2018. "Improving Water Quality in an Iconic Estuary: An Internal Meta-analysis of Property Value Impacts Around the Chesapeake Bay," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(2), pages 265-292, February.
    15. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's "Dubious to Hopeless" Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    16. Smith, Richard D., 2005. "Sensitivity to scale in contingent valuation: the importance of the budget constraint," Journal of Health Economics, Elsevier, vol. 24(3), pages 515-529, May.
    17. Kuminoff, Nicolai V. & Zhang, Congwen & Rudi, Jeta, 2010. "Are Travelers Willing to Pay a Premium to Stay at a “Green” Hotel? Evidence from an Internal Meta-Analysis of Hedonic Price Premia," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 39(3), pages 1-17, October.
    18. Diamond, Peter, 1996. "Testing the Internal Consistency of Contingent Valuation Surveys," Journal of Environmental Economics and Management, Elsevier, vol. 30(3), pages 337-347, May.
    19. Chapman, David J. & Bishop, Richard C. & Hanemann, W. Michael & Kanninen, Barbara J. & Krosnick, Jon A. & Morey, Edward R. & Tourangeau, Roger, 2016. "On the adequacy of scope test results: Comments on Desvousges, Mathews, and Train," Ecological Economics, Elsevier, vol. 130(C), pages 356-360.
    20. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    21. John C. Whitehead & Subhrendu K. Pattanayak & George L. Van Houtven & Brett R. Gelso, 2008. "Combining Revealed And Stated Preference Data To Estimate The Nonmarket Value Of Ecological Services: An Assessment Of The State Of The Science," Journal of Economic Surveys, Wiley Blackwell, vol. 22(5), pages 872-908, December.
    22. Richard T. Carson & Theodore Groves & John A. List, 2014. "Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 1(1), pages 171-207.
    23. Bishop, Richard C., 2018. "Warm Glow, Good Feelings, and Contingent Valuation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 43(3), September.
    24. Whitehead, John C., 2016. "Plausible responsiveness to scope in contingent valuation," Ecological Economics, Elsevier, vol. 128(C), pages 17-22.
    25. Borghi, Josephine & Shrestha, Daya L. & Shrestha, Deepa & Jan, Stephen, 2007. "Using focus groups to develop contingent valuation scenarios--A case study of women's groups in rural Nepal," Social Science & Medicine, Elsevier, vol. 64(3), pages 531-542, February.
    26. Schulze, William D. & McClelland, Gary H. & Lazo, Jeffrey K. & Rowe, Robert D., 1998. "Embedding and calibration in measuring non-use values," Resource and Energy Economics, Elsevier, vol. 20(2), pages 163-178, June.
    27. Boxall, Peter C. & Englin, Jeffrey & Adamowicz, Wiktor L., 2003. "Valuing aboriginal artifacts: a combined revealed-stated preference approach," Journal of Environmental Economics and Management, Elsevier, vol. 45(2), pages 213-230, March.
    28. Desvousges, William & Mathews, Kristy & Train, Kenneth, 2012. "Adequate responsiveness to scope in contingent valuation," Ecological Economics, Elsevier, vol. 84(C), pages 121-128.
    29. Carlson, Jay P. & Weathers, Danny, 2008. "Examining differences in consumer reactions to partitioned prices with a variable number of price components," Journal of Business Research, Elsevier, vol. 61(7), pages 724-731, July.
    30. Epley, Nicholas & Gneezy, Ayelet, 2007. "The framing of financial windfalls and implications for public policy," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(1), pages 36-47, February.
    31. Andreoni, James, 1989. "Giving with Impure Altruism: Applications to Charity and Ricardian Equivalence," Journal of Political Economy, University of Chicago Press, vol. 97(6), pages 1447-1458, December.
    32. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    33. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    34. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    35. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    36. Kuminoff, Nicolai V. & Zhang, Congwen & Rudi, Jeta, 2010. "Are Travelers Willing to Pay a Premium to Stay at a “Green†Hotel? Evidence from an Internal Meta-Analysis of Hedonic Price Premia," Agricultural and Resource Economics Review, Cambridge University Press, vol. 39(3), pages 468-484, October.
    37. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    38. Kaplowitz, Michael D. & Hoehn, John P., 2001. "Do focus groups and individual interviews reveal the same information for natural resource valuation?," Ecological Economics, Elsevier, vol. 36(2), pages 237-247, February.
    39. Jerry Hausman, 2012. "Contingent Valuation: From Dubious to Hopeless," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 43-56, Fall.
    40. Levan Elbakidze & Rodolfo M. Nayga, 2018. "The Adding-Up Test in an Incentivized Value Elicitation Mechanism: The Role of the Income Effect," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 71(3), pages 625-644, November.
    41. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    42. Franziska Völckner & Alexander Rühle & Martin Spann, 2012. "To divide or not to divide? The impact of partitioned pricing on the informational and sacrifice effects of price," Marketing Letters, Springer, vol. 23(3), pages 719-730, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Bishop, Richard C., 2018. "Warm Glow, Good Feelings, and Contingent Valuation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 43(3), September.
    3. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    4. Erik Brynjolfsson & Avinash Collis & Felix Eggers, 2019. "Using massive online choice experiments to measure changes in well-being," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(15), pages 7250-7255, April.
    5. Ghanem, Samar & Ferrini, Silvia & Di Maria, Corrado, 2023. "Air pollution and willingness to pay for health risk reductions in Egypt: A contingent valuation survey of Greater Cairo and Alexandria households," World Development, Elsevier, vol. 172(C).
    6. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    7. Xie, Lusi & Adamowicz, Wiktor & Kecinski, Maik & Fooks, Jacob R., 2022. "Using economic experiments to assess the validity of stated preference contingent behavior responses," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    8. John C. Whitehead, 2024. "They doth protest too much, methinks: Reply to “Reply to Whitehead”," Working Papers 24-04, Department of Economics, Appalachian State University.
    9. Ana Faria Lopes & Gorm Kipperberg, 2020. "Diagnosing Insensitivity to Scope in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 77(1), pages 191-216, September.
    10. Whitehead, John C., 2016. "Plausible responsiveness to scope in contingent valuation," Ecological Economics, Elsevier, vol. 128(C), pages 17-22.
    11. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    12. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
    13. Anders Dugstad & Kristine Grimsrud & Gorm Kipperberg & Henrik Lindhjem & Ståle Navrud, 2020. "Scope elasticity and economic significance in discrete choice experiments," Discussion Papers 942, Statistics Norway, Research Department.
    14. Baker, Rick & Ruting, Brad, 2014. "Environmental Policy Analysis: A Guide to Non‑Market Valuation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165810, Australian Agricultural and Resource Economics Society.
    15. Christian A. Vossler & Stéphane Bergeron & Maurice Doyon & Daniel Rondeau, 2023. "Revisiting the Gap between the Willingness to Pay and Willingness to Accept for Public Goods," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 10(2), pages 413-445.
    16. Lopez-Becerra, E.I. & Alcon, F., 2021. "Social desirability bias in the environmental economic valuation: An inferred valuation approach," Ecological Economics, Elsevier, vol. 184(C).
    17. Alaya Spencer‐Cotton & Marit E. Kragt & Michael Burton, 2018. "Spatial and Scope Effects: Valuations of Coastal Management Practices," Journal of Agricultural Economics, Wiley Blackwell, vol. 69(3), pages 833-851, September.
    18. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's "Dubious to Hopeless" Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    19. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2014. "Putting One's Money Where One's Mouth is: Increasing Saliency in the Field," Monash Economics Working Papers 43-14, Monash University, Department of Economics.
    20. Felix Schläpfer, 2021. "Inadequate Standards in the Valuation of Public Goods and Ecosystem Services: Why Economists, Environmental Scientists and Policymakers Should Care," Sustainability, MDPI, vol. 13(1), pages 1-10, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:80:y:2021:i:3:d:10.1007_s10640-021-00599-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.