IDEAS home Printed from https://ideas.repec.org/p/een/eenhrr/1095.html
   My bibliography  Save this paper

Testing for value stability with a meta-analysis of choice experiments: River health in Australia

Author

Listed:
  • John Rolfe

    (Faculty of Business and Informatics at Central Queensland University)

  • Roy Brouwer

    (VU University in The Netherlands.)

Abstract

While meta-analysis is typically used to identify value estimates for benefit transfer, applications also provide insights into the potential influence of design, study and methodological factors on results of non-market valuation experiments. In this paper, a metaanalysis of sixteen separate choice modelling studies in Australia with 130 individual value estimates relating to river health are reported. The studies involved different measures and scales of river health, so consistency was generated by transforming implicit prices from each study into a common standard of WTP per kilometer of river in good health. Tobit models have been used to identify the relationships between the dependent variable (WTP/km) and a number of variables. The results demonstrate that values are sensitive to marginal effects, with lower WTP/km for larger catchments, and higher WTP/km when river health is in decline. Values are also lower when river health has been defined by a subset of benefit types, such as recreation uses, vegetation health, fish health or bird populations. While there is evidence that the framing of the choice sets and descriptions of attributes have systematic impacts on values, there is very little evidence that choice dimensions, collection methods, sample sizes, response rates, statistical methods or publication status have influenced value estimates. Tests of apparent author effects show that these become insignificant when other explanatory variables are included in the models.

Suggested Citation

  • John Rolfe & Roy Brouwer, 2011. "Testing for value stability with a meta-analysis of choice experiments: River health in Australia," Environmental Economics Research Hub Research Reports 1095, Environmental Economics Research Hub, Crawford School of Public Policy, The Australian National University.
    • Handle: RePEc:een:eenhrr:1095
    as

    Download full text from publisher

    File URL: https://crawford.anu.edu.au/research_units/eerh/pdf/EERH_RR95.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Hensher, 2006. "Revealing Differences in Willingness to Pay due to the Dimensionality of Stated Choice Designs: An Initial Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 7-44, May.
    2. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    3. Luke Brander & Raymond Florax & Jan Vermaat, 2006. "The Empirics of Wetland Valuation: A Comprehensive Summary and a Meta-Analysis of the Literature," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 33(2), pages 223-250, February.
    4. Swait, Joffre & Adamowicz, Wiktor & Bueren, Martin van, 2004. "Choice and temporal welfare impacts: incorporating history into discrete choice models," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 94-116, January.
    5. Marit E Kragt & Jeff Bennett, 2009. "Using Choice Experiments to value River and Estuary Health in Tasmania with Individual Preference Heterogeneity," Environmental Economics Research Hub Research Reports 0916, Environmental Economics Research Hub, Crawford School of Public Policy, The Australian National University, revised Sep 2009.
    6. Ian J. Bateman & Andrew P. Jones, 2003. "Contrasting Conventional with Multi-Level Modeling Approaches to Meta-Analysis: Expectation Consistency in U.K. Woodland Recreation Values," Land Economics, University of Wisconsin Press, vol. 79(2), pages 235-258.
    7. Rosenberger, Randall S. & Stanley, Tom D., 2006. "Measurement, generalization, and publication: Sources of error in benefit transfers and their management," Ecological Economics, Elsevier, vol. 60(2), pages 372-378, December.
    8. Robert J. Johnston & Randall S. Rosenberger, 2010. "Methods, Trends And Controversies In Contemporary Benefit Transfer," Journal of Economic Surveys, Wiley Blackwell, vol. 24(3), pages 479-510, July.
    9. Kragt, Marit Ellen & Bennett, Jeffrey W., 2010. "The Impacts of Attribute Level Framing and Changing Cost Levels on Choice Experiments Value Estimates," 2010 Conference (54th), February 10-12, 2010, Adelaide, Australia 59091, Australian Agricultural and Resource Economics Society.
    10. Mark Morrison & Jeff Bennett & Russell Blamey & Jordan Louviere, 2002. "Choice Modeling and Tests of Benefit Transfer," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 84(1), pages 161-170.
    11. John Rolfe & Jeff Bennett (ed.), 2006. "Choice Modelling and the Transfer of Environmental Values," Books, Edward Elgar Publishing, number 3336.
    12. Bennett, Jeffrey W. & Dumsday, Robert G. & Gillespie, Robert, 2008. "Analysing options for the Red Gum Forests along the Murray River," 2008 Conference (52nd), February 5-8, 2008, Canberra, Australia 6029, Australian Agricultural and Resource Economics Society.
    13. Kragt, Marit Ellen & Bennett, Jeffrey W. & Lloyd, Chris & Dumsday, Robert G., 2007. "Comparing choice models of river health improvement for the Goulburn River," 2007 Conference (51st), February 13-16, 2007, Queenstown, New Zealand 10359, Australian Agricultural and Resource Economics Society.
    14. Robert J. Johnston & Elena Y. Besedin & Richard Iovanna & Christopher J. Miller & Ryan F. Wardwell & Matthew H. Ranson, 2005. "Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta‐Analysis," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 53(2‐3), pages 221-248, June.
    15. V. Smith & Subhrendu Pattanayak, 2002. "Is Meta-Analysis a Noah's Ark for Non-Market Valuation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 22(1), pages 271-296, June.
    16. Roy Brouwer & Thijs Dekker & John Rolfe & Jill Windle, 2010. "Choice Certainty and Consistency in Repeated Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(1), pages 93-109, May.
    17. Mark Morrison & Jeff Bennett, 2004. "Valuing New South Wales rivers for use in benefit transfer," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(4), pages 591-611, December.
    18. Taylor, Cameron L. & Adamowicz, Wiktor L. & Luckert, Martin K., 2003. "Preferences over the timing of forest resource use," Journal of Forest Economics, Elsevier, vol. 9(3), pages 223-240.
    19. Rolfe, John & Bennett, Jeff, 2009. "The impact of offering two versus three alternatives in choice modelling experiments," Ecological Economics, Elsevier, vol. 68(4), pages 1140-1148, February.
    20. van Bueren, Martin & Bennett, Jeffrey W., 2004. "Towards the development of a transferable set of value estimates for environmental attributes," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(1), pages 1-32.
    21. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    22. Mazur, Kasia & Bennett, Jeffrey W., 2009. "Location differences in communities’ preferences for environmental improvements in selected NSW catchments: A Choice Modelling approach," 2009 Conference (53rd), February 11-13, 2009, Cairns, Australia 47946, Australian Agricultural and Resource Economics Society.
    23. Woodward, Richard T. & Wui, Yong-Suhk, 2001. "The economic value of wetland services: a meta-analysis," Ecological Economics, Elsevier, vol. 37(2), pages 257-270, May.
    24. Brouwer, Roy, 2000. "Environmental value transfer: state of the art and future prospects," Ecological Economics, Elsevier, vol. 32(1), pages 137-152, January.
    25. Van Houtven, George & Powers, John & Pattanayak, Subhrendu K., 2007. "Valuing water quality improvements in the United States using meta-analysis: Is the glass half-full or half-empty for national policy analysis?," Resource and Energy Economics, Elsevier, vol. 29(3), pages 206-228, September.
    26. Kim, Soo-Il & Haab, Timothy C., 2009. "Temporal insensitivity of willingness to pay and implied discount rates," Resource and Energy Economics, Elsevier, vol. 31(2), pages 89-102, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Baker, Rick & Ruting, Brad, 2014. "Environmental Policy Analysis: A Guide to Non‑Market Valuation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165810, Australian Agricultural and Resource Economics Society.
    2. Rolfe, John & Windle, Jill & Bennett, Jeffrey W. & Mazur, Kasia, 2013. "Calibration of values in benefit transfer to account for variations in geographic scale and scope: Comparing two choice modelling experiments," 2013 Conference (57th), February 5-8, 2013, Sydney, Australia 152176, Australian Agricultural and Resource Economics Society.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    2. Hjerpe, Evan & Hussain, Anwar & Phillips, Spencer, 2015. "Valuing type and scope of ecosystem conservation: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 21(1), pages 32-50.
    3. Robert J. Johnston & Kevin J. Boyle & Maria L. Loureiro & Ståle Navrud & John Rolfe, 2021. "Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 79(3), pages 575-624, July.
    4. Lindhjem, Henrik & Navrud, Ståle, 2008. "How reliable are meta-analyses for international benefit transfers?," Ecological Economics, Elsevier, vol. 66(2-3), pages 425-435, June.
    5. Richardson, Leslie & Loomis, John & Kroeger, Timm & Casey, Frank, 2015. "The role of benefit transfer in ecosystem service valuation," Ecological Economics, Elsevier, vol. 115(C), pages 51-58.
    6. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2017. "Threshold Effects in Meta-Analyses With Application to Benefit Transfer for Coral Reef Valuation," Ecological Economics, Elsevier, vol. 133(C), pages 74-85.
    7. Kukielka, Jessica B. & Johnston, Robert J. & Duke, Joshua M., 2008. "Systematic Variation in Willingness to Pay for Agricultural Land Preservation and Implications for Benefit Transfer: A Meta-Analysis," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6121, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    8. Kevin Boyle & Christopher Parmeter & Brent Boehlert & Robert Paterson, 2013. "Due Diligence in Meta-analyses to Support Benefit Transfers," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 55(3), pages 357-386, July.
    9. Roy Brouwer, 2009. "Multi-Attribute Choice Modeling of Australia’s Rivers and Wetlands: A Meta-Analysis of Ten Years of Research," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2009-05, CSIRO Sustainable Ecosystems.
    10. de Groot, Rudolf & Brander, Luke & van der Ploeg, Sander & Costanza, Robert & Bernard, Florence & Braat, Leon & Christie, Mike & Crossman, Neville & Ghermandi, Andrea & Hein, Lars & Hussain, Salman & , 2012. "Global estimates of the value of ecosystems and their services in monetary units," Ecosystem Services, Elsevier, vol. 1(1), pages 50-61.
    11. Windle, Jill & Rolfe, John, 2013. "The limitations of applying benefit transfer to assess the value of ecosystem services in a “generic” peri-urban, coastal town in Australia," 2013 Conference (57th), February 5-8, 2013, Sydney, Australia 152183, Australian Agricultural and Resource Economics Society.
    12. Chaikumbung, Mayula & Doucouliagos, Hristos & Scarborough, Helen, 2016. "The economic value of wetlands in developing countries: A meta-regression analysis," Ecological Economics, Elsevier, vol. 124(C), pages 164-174.
    13. Shuang Liu & David I Stern, 2008. "A Meta-Analysis of Contingent Valuation Studies in Coastal and Near-Shore Marine Ecosystems," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-15, CSIRO Sustainable Ecosystems.
    14. Fitzpatrick, Luke & Parmeter, Christopher F. & Agar, Juan, 2019. "Approaches for visualizing uncertainty in benefit transfer from metaregression," Ecological Economics, Elsevier, vol. 164(C), pages 1-1.
    15. Tuan, Tran Hu & Lindhjem, Henrik, 2008. "Meta-analysis of nature conservation values in Asia & Oceania: Data heterogeneity and benefit transfer issues," MPRA Paper 11470, University Library of Munich, Germany.
    16. Ahtiainen, Heini & Vanhatalo, Jarno, 2012. "The value of reducing eutrophication in European marine areas — A Bayesian meta-analysis," Ecological Economics, Elsevier, vol. 83(C), pages 1-10.
    17. Reynaud, Arnaud & Lanzanova, Denis, 2017. "A Global Meta-Analysis of the Value of Ecosystem Services Provided by Lakes," Ecological Economics, Elsevier, vol. 137(C), pages 184-194.
    18. Newbold, Stephen C. & Johnston, Robert J., 2020. "Valuing non-market valuation studies using meta-analysis: A demonstration using estimates of willingness-to-pay for water quality improvements," Journal of Environmental Economics and Management, Elsevier, vol. 104(C).
    19. Baker, Rick & Ruting, Brad, 2014. "Environmental Policy Analysis: A Guide to Non‑Market Valuation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165810, Australian Agricultural and Resource Economics Society.
    20. Fan, Yubing & Wang, Chenggang & Nan, Zhibiao, 2018. "Determining water use efficiency of wheat and cotton: A meta-regression analysis," Agricultural Water Management, Elsevier, vol. 199(C), pages 48-60.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:een:eenhrr:1095. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CAP Web Team (email available below). General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.