An Analysis Of Statistical Errors In Contingent Valuation Surveys
Environmental economists using contingent valuation (CV) surveys are often interested in estimating the population willingness to pay (WTP) for some intervention from a sample of individuals randomly drawn from some population of interest. These surveys collect information on bids or WTP amounts and various demographic and socioeconomic characteristics about the respondents that is used to estimate descriptive statistics (such as mean or median WTP) or regression equations (such as bid or WTP functions). Statistical errors can occur when either the framework from which the sample was drawn is ignored or when the sampled elements are used to incorrectly infer relationships for a target. These errors will often cause biased WTP estimates, although the magnitude and direction of the bias are often difficult to identify. In this paper, standard methods for testing and addressing these potential sources of error are presented and alternative, and often less restrictive, methods are presented and applied to a contingent valuation study of environmentally friendly changes in the Glen Canyon Dam's operations (Welsh, et al, 1995). Great strides have been made to reduce the potential biases in CV surveys. For the better part of the last 20 years, research in environmental economics has focused on reducing potential sources of biases such as embedding, information and scope effects. But research on who and what the respondents and nonrespondents represent has often taken a back seat and in practice is either assumed away or simply overlooked (e.g., nonrespondents are assumed to either (i) behave like respondents or (ii) behave in a particular way). Two types of statistical errors associated with this final stage include sampling error and response error (a combination of nonresponse and selection errors). Sampling errors can arise when the sample drawn does not directly reflect the population of interest, most commonly occurring when incorrect sampling and survey methods are used, most notably ignoring sample weights when complex samples are drawn. Sample weights effectively represent the number of individuals in the population that each sampled individual represents. Moreover, sample weights can be used to test for non-ignorable sampling designs that might cause selection errors and can be used to protect against model misspecification. The role of sample weights in the statistical analysis of survey data, however, is subject to considerable debate among theoretical statisticians despite its widespread use by applied statisticians. Response errors occur when sampled elements are used to infer relationships for a population where the sampled elements do not represent the target population. Regardless of the sampling structure, systematic differences between respondents and nonrespondents will usually invalidate population inferences based solely on survey data from respondents. Research in marketing and psychology has determined that nonrespondents will often differ from respondents on demographic characteristics, socioeconomic status, and attitudes and beliefs, especially those related to the survey in question. Additionally, selection error occurs as a result of respondents (and nonrespondents) censoring their bids. Selection errors are likely to occur for two reasons: (i) removing "protest" and other missing bids as if they were outliers, and (ii) nonrespondents censoring themselves. To adjust for these problems, most statistical approaches are forced to assume some sort of model relating the likelihood of response to willingness to pay. After applying the alternative methods to the data from the Glen Canyon Dam Study, this paper will show that the results from these methods differ enough to indicate that whether or not an intervention is deemed worthwhile could depend on the error correction method used. Since the more advanced and less restrictive methods generally provide more accurate results, environmental economists should be well versed in these methods or work closely with survey statisticians to obtain the most accurate estimates of population WTP.
|Date of creation:||2001|
|Contact details of provider:|| Postal: 555 East Wells Street, Suite 1100, Milwaukee, Wisconsin 53202|
Phone: (414) 918-3190
Fax: (414) 276-3349
Web page: http://www.aaea.org
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Heckman, James, 2013.
"Sample selection bias as a specification error,"
Publishing House "SINERGIA PRESS", vol. 31(3), pages 129-137.
- Mark L. Messonnier & John C. Bergstrom & Christopher M. Cornwell & R. Jeff Teasley & H. Ken Cordell, 2000. "Survey Response-Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(2), pages 438-450.
- Magee, L. & Robb, A. L. & Burbidge, J. B., 1998. "On the use of sampling weights when estimating regression models with survey data," Journal of Econometrics, Elsevier, vol. 84(2), pages 251-271, June.
- Horowitz, Joel L. & Manski, Charles F., 1998.
"Censoring of outcomes and regressors due to survey nonresponse: Identification and estimation using weights and imputations,"
Journal of Econometrics,
Elsevier, vol. 84(1), pages 37-58, May.
- Joel L. Horowitz & Charles F. Manski, 1996. "Censoring of Outcomes and Regressors Due To Survey Nonresponse: Identification and Estimation Using Weights and Imputations," Econometrics 9602007, EconWPA, revised 06 Mar 1996.
- Horowitz, J.L. & Manski, C.F., 1995. "Censoring of Outcomes and Regressors Due to Survey Nonresponse: Identification and Estimation Using Weights and Imputations," Working papers 9525, Wisconsin Madison - Social Systems.
- Horowitz, J.L. & Manski, C.F., 1995. "Censoring of Outcomes and Regressors Due to Survey Nonresponse: Identification and estimation Using Weights and Imputations," Working Papers 95-12, University of Iowa, Department of Economics.
- A. Meltzer & Peter Ordeshook & Thomas Romer, 1983. "Introduction," Public Choice, Springer, vol. 41(1), pages 1-5, January.
- Puhani, Patrick A, 2000. " The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
- A. P. Thirlwall, 1983. "Introduction," Journal of Post Keynesian Economics, M.E. Sharpe, Inc., vol. 5(3), pages 341-344, April.
- Steven F. Edwards & Glen D. Anderson, 1987. "Overlooked Biases in Contingent Valuation Surveys: Some Considerations," Land Economics, University of Wisconsin Press, vol. 63(2), pages 168-178.
- Göran Bostedt & Mattias Boman, 1996. "Nonresponse in Contingent Valuation-reducing uncertainty in value inference," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 8(1), pages 119-124, July.
When requesting a correction, please mention this item's handle: RePEc:ags:aaea01:20462. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (AgEcon Search)
If references are entirely missing, you can add them using this form.