IDEAS home Printed from https://ideas.repec.org/p/ags/aaea16/235465.html
   My bibliography  Save this paper

Systematic Non-Response in Stated Preference Choice Experiments: Implications for the Valuation of Climate Risk Reductions

Author

Listed:
  • Abdulrahman, Abdulallah S
  • Johnston, Robert J

Abstract

Discrete choice experiments (DCEs) addressing adaptation to climate-related risks may be subject to response biases associated with variations in risk exposure across sampled populations. Systematic adjustments for such biases are hindered by the absence of rigorous, standardized selection-correction models for multinomial DCEs, together with a lack of information on non-respondents. This paper illustrates a systematic approach to accommodate risk-related non-response bias in DCEs, where variations in risk exposure may be linked to observable landscape characteristics. The approach adapts reduced form response-propensity models to correct for survey non-response, capitalizing on the fact that indicators of risk exposure may be linked to the geocoded locations of respondents and non-respondents. An application to coastal flood adaptation in Connecticut, USA illustrates implications for welfare estimation. Results demonstrate that the proposed approach can reveal otherwise invisible, systematic effects of survey response patterns on estimated WTP.

Suggested Citation

  • Abdulrahman, Abdulallah S & Johnston, Robert J, 2016. "Systematic Non-Response in Stated Preference Choice Experiments: Implications for the Valuation of Climate Risk Reductions," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235465, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea16:235465
    DOI: 10.22004/ag.econ.235465
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/235465/files/NON_RESPONSE%20BIAS.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.235465?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. King, Gary & Roberts, Margaret E., 2015. "How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It," Political Analysis, Cambridge University Press, vol. 23(2), pages 159-179, April.
    2. Johnston, Robert J. & Weaver, Thomas F. & Smith, Lynn A. & Swallow, Stephen K., 1995. "Contingent Valuation Focus Groups: Insights from Ethnographic Interview Techniques," Agricultural and Resource Economics Review, Cambridge University Press, vol. 24(1), pages 56-69, April.
    3. Denzil G. Fiebig & Michael P. Keane & Jordan Louviere & Nada Wasi, 2010. "The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity," Marketing Science, INFORMS, vol. 29(3), pages 393-421, 05-06.
    4. Weihua Guan, 2003. "From the help desk: Bootstrapped standard errors," Stata Journal, StataCorp LP, vol. 3(1), pages 71-80, March.
    5. Cameron, Trudy Ann & DeShazo, J.R., 2013. "Demand for health risk reductions," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 87-109.
    6. Bateman, Ian J. & Day, Brett H. & Georgiou, Stavros & Lake, Iain, 2006. "The aggregation of environmental benefit values: Welfare measures, distance decay and total WTP," Ecological Economics, Elsevier, vol. 60(2), pages 450-460, December.
    7. Nancy E. Bockstael & Ivar E. Strand, Jr. & Kenneth E. McConnell & Firuzeh Arsanjani, 1990. "Sample Selection Bias in the Estimation of Recreation Demand Functions: An Application to Sportfishing," Land Economics, University of Wisconsin Press, vol. 66(1), pages 40-49.
    8. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, September.
    9. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    10. John B. Loomis, 1987. "Expanding Contingent Value Sample Estimates to Aggregate Benefit Estimates: Current Practices and Proposed Solutions," Land Economics, University of Wisconsin Press, vol. 63(4), pages 396-402.
    11. W. Michael Hanemann, 1984. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 66(3), pages 332-341.
    12. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    13. Arne Risa Hole, 2007. "A comparison of approaches to estimating confidence intervals for willingness to pay measures," Health Economics, John Wiley & Sons, Ltd., vol. 16(8), pages 827-840, August.
    14. Søren Olsen, 2009. "Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 44(4), pages 591-610, December.
    15. Trudy Ann Cameron & W. Douglas Shaw & Shannon R. Ragland & Sally Keefe & John M. (Mac) Callaway, 1996. "Using Distance and Zip Code Census Information For Nonresponse Correction In the Analysis of Mail Survey Data," UCLA Economics Working Papers 751, UCLA Department of Economics.
    16. Cameron, Trudy Ann & Shaw, W. Douglass & Ragland, Shannon E. & Callaway, J. Mac & Keefe, Sally, 1996. "Using Actual And Contingent Behavior Data With Differing Levels Of Time Aggregation To Model Recreation Demand," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 21(1), pages 1-20, July.
    17. Andrew Daly & Stephane Hess & Kenneth Train, 2012. "Assuring finite moments for willingness to pay in random coefficient models," Transportation, Springer, vol. 39(1), pages 19-31, January.
    18. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    19. Robert Johnston & Mahesh Ramachandran, 2014. "Modeling Spatial Patchiness and Hot Spots in Stated Preference Willingness to Pay," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 363-387, November.
    20. Steven F. Edwards & Glen D. Anderson, 1987. "Overlooked Biases in Contingent Valuation Surveys: Some Considerations," Land Economics, University of Wisconsin Press, vol. 63(2), pages 168-178.
    21. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    22. Anders Skrondal & Sophia Rabe‐Hesketh, 2009. "Prediction in multilevel generalized linear models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 659-687, June.
    23. Danny Campbell & Riccardo Scarpa & W. Hutchinson, 2008. "Assessing the spatial dependence of welfare estimates obtained from discrete choice experiments," Letters in Spatial and Resource Sciences, Springer, vol. 1(2), pages 117-126, December.
    24. Robert J. Johnston & Joshua M. Duke, 2007. "Willingness to Pay for Agricultural Land Preservation and Policy Process Attributes: Does the Method Matter?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(4), pages 1098-1115.
    25. Davidson, Russell & MacKinnon, James G, 1999. "Bootstrap Testing in Nonlinear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 487-508, May.
    26. Whitehead, John C. & Groothuis, Peter A. & Blomquist, Glenn C., 1993. "Testing for non-response and sample selection bias in contingent valuation : Analysis of a combination phone/mail survey," Economics Letters, Elsevier, vol. 41(2), pages 215-220.
    27. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    28. Johnston, Robert J. & Swallow, Stephen K. & Weaver, Thomas F., 1999. "Estimating Willingness to Pay and Resource Tradeoffs with Different Payment Mechanisms: An Evaluation of a Funding Guarantee for Watershed Management," Journal of Environmental Economics and Management, Elsevier, vol. 38(1), pages 97-120, July.
    29. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    30. Robert J. Johnston & Eric T. Schultz & Kathleen Segerson & Elena Y. Besedin & Mahesh Ramachandran, 2012. "Enhancing the Content Validity of Stated Preference Valuation: The Structure and Function of Ecological Indicators," Land Economics, University of Wisconsin Press, vol. 88(1), pages 102-120.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Holland, Benedict M. & Johnston, Robert J., 2017. "Optimized quantity-within-distance models of spatial welfare heterogeneity," Journal of Environmental Economics and Management, Elsevier, vol. 85(C), pages 110-129.
    3. Robert Johnston & Mahesh Ramachandran, 2014. "Modeling Spatial Patchiness and Hot Spots in Stated Preference Willingness to Pay," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 363-387, November.
    4. Makriyannis, Christos & Johnston, Robert, 2016. "Welfare Analysis for Climate Risk Reductions: Are Current Treatments of Outcome Uncertainty Sufficient?," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235532, Agricultural and Applied Economics Association.
    5. Holland, Benedict M. & Johnston, Robert J., 2014. "Spatially-Referenced Choice Experiments: Tests of Individualized Geocoding in Stated Preference Questionnaires," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170191, Agricultural and Applied Economics Association.
    6. Holland, Benedict M. & Johnston, Robert J., 2015. "Capturing More Relevant Measures of Spatial Heterogeneity in Stated Preference Willingness to Pay: Using an Iterative Grid Search Algorithm to Quantify Proximate Environmental Impacts," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205450, Agricultural and Applied Economics Association.
    7. Christos Makriyannis & Robert J. Johnston & Ewa Zawojska, 2022. "Do numerical probabilities promote informed stated preference responses under inherent uncertainty? Insight from a coastal adaptation choice experiment," Working Papers 2022-05, Faculty of Economic Sciences, University of Warsaw.
    8. Sandorf, Erlend Dancke & Aanesen, Margrethe & Navrud, Ståle, 2016. "Valuing unfamiliar and complex environmental goods: A comparison of valuation workshops and internet panel surveys with videos," Ecological Economics, Elsevier, vol. 129(C), pages 50-61.
    9. Johnston, Robert J. & Ramachandran, Mahesh & Schultz, Eric T. & Segerson, Kathleen & Besedin, Elena Y., 2011. "Characterizing Spatial Pattern in Ecosystem Service Values when Distance Decay Doesn’t Apply: Choice Experiments and Local Indicators of Spatial Association," 2011 Annual Meeting, July 24-26, 2011, Pittsburgh, Pennsylvania 103374, Agricultural and Applied Economics Association.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    11. Bakhtiari, Fatemeh & Jacobsen, Jette Bredahl & Thorsen, Bo Jellesmark & Lundhede, Thomas Hedemark & Strange, Niels & Boman, Mattias, 2018. "Disentangling Distance and Country Effects on the Value of Conservation across National Borders," Ecological Economics, Elsevier, vol. 147(C), pages 11-20.
    12. Mikołaj Czajkowski & Anna Bartczak & Marek Giergiczny & Stale Navrud & Tomasz Żylicz, 2013. "Providing Preference-Based Support for Forest Ecosystem Service Management in Poland," Working Papers 2013-05, Faculty of Economic Sciences, University of Warsaw.
    13. Tomas Badura & Silvia Ferrini & Michael Burton & Amy Binner & Ian J. Bateman, 2020. "Using Individualised Choice Maps to Capture the Spatial Dimensions of Value Within Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 75(2), pages 297-322, February.
    14. Scheufele, Gabriela & Bennett, Jeffrey W., 2010. "Ordering effects and strategic response in discrete choice experiments," Research Reports 107743, Australian National University, Environmental Economics Research Hub.
    15. Czajkowski, Mikołaj & Bartczak, Anna & Giergiczny, Marek & Navrud, Stale & Żylicz, Tomasz, 2014. "Providing preference-based support for forest ecosystem service management," Forest Policy and Economics, Elsevier, vol. 39(C), pages 1-12.
    16. Johnston, Robert J. & Schultz, Eric T. & Segerson, Kathleen & Besedin, Elena Y. & Ramachandran, Mahesh, 2013. "Stated Preferences for Intermediate versus Final Ecosystem Services: Disentangling Willingness to Pay for Omitted Outcomes," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 42(1), pages 1-21, April.
    17. Ndebele, Tom & Johnston, Robert J. & Newburn, David, 2020. "Transaction Costs and Household Adoption of Stormwater Best Management Practices," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304338, Agricultural and Applied Economics Association.
    18. Abildtrup, Jens & Garcia, Serge & Olsen, Søren Bøye & Stenger, Anne, 2013. "Spatial preference heterogeneity in forest recreation," Ecological Economics, Elsevier, vol. 92(C), pages 67-77.
    19. Tyllianakis, Emmanouil & Martin-Ortega, Julia & Ziv, Guy & Chapman, Pippa J. & Holden, Joseph & Cardwell, Michael & Fyfe, Duncan, 2023. "A window into land managers’ preferences for new forms of agri-environmental schemes: Evidence from a post-Brexit analysis," Land Use Policy, Elsevier, vol. 129(C).
    20. Dorner, Zach & Brent, Daniel A. & Leroux, Anke, 2016. "Eliciting Risk Preferences for Intrinsic Attributes," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236644, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    Environmental Economics and Policy;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea16:235465. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.