IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v29y2020i2p234-242.html
   My bibliography  Save this article

Survey modes comparison in contingent valuation: Internet panels and mail surveys

Author

Listed:
  • Mandy Ryan
  • Emmanouil Mentzakis
  • Catriona Matheson
  • Christine Bond

Abstract

Stated preferences methods are extensively applied in health economics to elicit preferences. Although mailed surveys were commonly used to collect data, internet panel (IP) surveys are being increasingly used. This raises questions about the validity of responses and estimated willingness‐to‐pay (WTP) values generated from IP surveys. We conduct the first study in health to compare a contingent valuation IP survey with a mailed survey using the electoral roll. Our IP has a higher response rate and lower item missing response rate. The difference is reduced but remains when restricting comparisons with valid WTPs. Sample characteristics differ, with significant differences between modes for gender, age, income, and attitudes and knowledge. Although difference in WTP values exist, with the IP resulting in higher values, we find limited evidence that such differences are statistically significant. The mail survey has lower initial cost per response; however, once restricting samples to valid WTP responses with nonmissing respondent information, the cost per response across modes is similar. Our results, suggesting that IPs generate valid and cost‐effective values, are encouraging as researchers move increasingly to IPs to collect preference data.

Suggested Citation

  • Mandy Ryan & Emmanouil Mentzakis & Catriona Matheson & Christine Bond, 2020. "Survey modes comparison in contingent valuation: Internet panels and mail surveys," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 234-242, February.
  • Handle: RePEc:wly:hlthec:v:29:y:2020:i:2:p:234-242
    DOI: 10.1002/hec.3983
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.3983
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.3983?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Donna Rowen & John Brazier & Anju Keetharuth & Aki Tsuchiya & Clara Mukuria, 2016. "Comparison of Modes of Administration and Alternative Formats for Eliciting Societal Preferences for Burden of Illness," Applied Health Economics and Health Policy, Springer, vol. 14(1), pages 89-104, February.
    2. Verity Watson & Terry Porteous & Tim Bolt & Mandy Ryan, 2019. "Mode and Frame Matter: Assessing the Impact of Survey Mode and Sample Frame in Choice Experiments," Medical Decision Making, , vol. 39(7), pages 827-841, October.
    3. Ryan, Mandy & San Miguel, Fernando, 2000. "Testing for consistency in willingness to pay experiments," Journal of Economic Psychology, Elsevier, vol. 21(3), pages 305-317, June.
    4. Anirban Basu & Willard G. Manning & John Mullahy, 2004. "Comparing alternative models: log vs Cox proportional hazard?," Health Economics, John Wiley & Sons, Ltd., vol. 13(8), pages 749-765, August.
    5. James Hammitt & Ying Zhou, 2006. "The Economic Value of Air-Pollution-Related Health Risks in China: A Contingent Valuation Study," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 33(3), pages 399-423, March.
    6. Duan, Naihua, et al, 1983. "A Comparison of Alternative Models for the Demand for Medical Care," Journal of Business & Economic Statistics, American Statistical Association, vol. 1(2), pages 115-126, April.
    7. Yu, Xiaohua & Abler, David, 2010. "Incorporating zero and missing responses into CVM with open-ended bidding: willingness to pay for blue skies in Beijing," Environment and Development Economics, Cambridge University Press, vol. 15(5), pages 535-556, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blackman, Allen & Qin, Ping & Yang, Jun, 2020. "How costly are driving restrictions? Contingent valuation evidence from Beijing," Journal of Environmental Economics and Management, Elsevier, vol. 104(C).
    2. Law, Michael R. & Grépin, Karen A., 2010. "Is newer always better? Re-evaluating the benefits of newer pharmaceuticals," Journal of Health Economics, Elsevier, vol. 29(5), pages 743-750, September.
    3. John Mullahy, 2015. "In Memoriam: Willard G. Manning, 1946‐2014," Health Economics, John Wiley & Sons, Ltd., vol. 24(3), pages 253-257, March.
    4. Manos Matsaganis & Theodore Mitrakos & Panos Tsakloglou, 2008. "Modelling Household Expenditure on Health Care in Greece," Working Papers 68, Bank of Greece.
    5. Jones, A. & Lomas, J. & Rice, N., 2014. "Going Beyond the Mean in Healthcare Cost Regressions: a Comparison of Methods for Estimating the Full Conditional Distribution," Health, Econometrics and Data Group (HEDG) Working Papers 14/26, HEDG, c/o Department of Economics, University of York.
    6. Andrew M. Jones & James Lomas & Peter T. Moore & Nigel Rice, 2016. "A quasi-Monte-Carlo comparison of parametric and semiparametric regression methods for heavy-tailed and non-normal data: an application to healthcare costs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(4), pages 951-974, October.
    7. Borislava Mihaylova & Andrew Briggs & Anthony O'Hagan & Simon G. Thompson, 2011. "Review of statistical methods for analysing healthcare resources and costs," Health Economics, John Wiley & Sons, Ltd., vol. 20(8), pages 897-916, August.
    8. Manos Matsaganis & Theodore Mitrakos & Panos Tsakloglou, 2009. "Modelling health expenditure at the household level in Greece," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 10(3), pages 329-336, July.
    9. Andrew M. Jones & James Lomas & Nigel Rice, 2015. "Healthcare Cost Regressions: Going Beyond the Mean to Estimate the Full Distribution," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1192-1212, September.
    10. Yang Lu, 2019. "Flexible (panel) regression models for bivariate count–continuous data with an insurance application," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1503-1521, October.
    11. Ed Westerhout & Kees Folmer, 2007. "Co-payment systems in health care; between moral hazard and risk reduction," CPB Discussion Paper 78.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    12. Silva João M. C. Santos & Tenreyro Silvana & Windmeijer Frank, 2015. "Testing Competing Models for Non-negative Data with Many Zeros," Journal of Econometric Methods, De Gruyter, vol. 4(1), pages 1-18, January.
    13. Noémi Kreif & Richard Grieve & M. Zia Sadique, 2013. "Statistical Methods For Cost‐Effectiveness Analyses That Use Observational Data: A Critical Appraisal Tool And Review Of Current Practice," Health Economics, John Wiley & Sons, Ltd., vol. 22(4), pages 486-500, April.
    14. Tugba Akkaya Hocagil & Richard J. Cook & Sandra W. Jacobson & Joseph L. Jacobson & Louise M. Ryan, 2021. "Propensity score analysis for a semi‐continuous exposure variable: a study of gestational alcohol exposure and childhood cognition," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(4), pages 1390-1413, October.
    15. Ni, Xinwen, 2019. "Voting for Health Insurance Policy: the U.S. versus Europe," IRTG 1792 Discussion Papers 2019-012, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    16. Ziebarth, N. R. & Schmitt, M. & Karlsson, M., 2013. "The short-term population health effects of weather and pollution: implications of climate change," Health, Econometrics and Data Group (HEDG) Working Papers 13/34, HEDG, c/o Department of Economics, University of York.
    17. Buntin, Melinda Beeuwkes & Zaslavsky, Alan M., 2004. "Too much ado about two-part models and transformation?: Comparing methods of modeling Medicare expenditures," Journal of Health Economics, Elsevier, vol. 23(3), pages 525-542, May.
    18. Sumei Chen & Ling‐Yun He, 2019. "Taxation and the Environment–Health–Poverty Trap: A Policy Experiment Perspective," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 27(1), pages 72-92, January.
    19. Sandeep Rath & Kumar Rajaram, 2022. "Staff Planning for Hospitals with Implicit Cost Estimation and Stochastic Optimization," Production and Operations Management, Production and Operations Management Society, vol. 31(3), pages 1271-1289, March.
    20. Joseph F. Levy & Marjorie A. Rosenberg, 2019. "A Latent Class Approach to Modeling Trajectories of Health Care Cost in Pediatric Cystic Fibrosis," Medical Decision Making, , vol. 39(5), pages 593-604, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:29:y:2020:i:2:p:234-242. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.