IDEAS home Printed from https://ideas.repec.org/a/kap/mktlet/v16y2005i3p183-196.html
   My bibliography  Save this article

Statistical Analysis of Choice Experiments and Surveys

Author

Listed:
  • Daniel McFadden
  • Albert Bemmaor
  • Francis Caro
  • Jeff Dominitz
  • Byung-Hill Jun
  • Arthur Lewbel
  • Rosa Matzkin
  • Francesca Molinari
  • Norbert Schwarz
  • Robert Willis
  • Joachim Winter

Abstract

Measures of households' past behavior, their expectations with respect to future events and contingencies, and their intentions with respect to future behavior are frequently collected using household surveys. These questions are conceptually difficult. Answering them requires elaborate cognitive and social processes, and often respondents report only their “best” guesses and/or estimates, using more or less sophisticated heuristics. A large body of literature in psychology and survey research shows that as a result, responses to such questions may be severely biased. In this paper, (1) we describe some of the problems that are typically encountered, (2) provide some empirical illustrations of these biases, and (3) develop a framework for conceptualizing survey response behavior and for integrating structural models of response behavior into the statistical analysis of the underlying economic behavior. Copyright Springer Science + Business Media, Inc. 2005

Suggested Citation

  • Daniel McFadden & Albert Bemmaor & Francis Caro & Jeff Dominitz & Byung-Hill Jun & Arthur Lewbel & Rosa Matzkin & Francesca Molinari & Norbert Schwarz & Robert Willis & Joachim Winter, 2005. "Statistical Analysis of Choice Experiments and Surveys," Marketing Letters, Springer, vol. 16(3), pages 183-196, December.
    • Handle: RePEc:kap:mktlet:v:16:y:2005:i:3:p:183-196
    DOI: 10.1007/s11002-005-5884-2
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11002-005-5884-2
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11002-005-5884-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Li Gan & Michael D. Hurd & Daniel L. McFadden, 2005. "Individual Subjective Survival Curves," NBER Chapters, in: Analyses in the Economics of Aging, pages 377-412, National Bureau of Economic Research, Inc.
    2. Crossley, Thomas F. & Kennedy, Steven, 2002. "The reliability of self-assessed health status," Journal of Health Economics, Elsevier, vol. 21(4), pages 643-658, July.
    3. Manski, Charles F, 1999. "Analysis of Choice Expectations in Incomplete Scenarios," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 49-66, December.
    4. V. Kerry Smith & Donald H. Taylor & Frank A. Sloan, 2001. "Longevity Expectations and Death: Can People Predict Their Own Demise?," American Economic Review, American Economic Association, vol. 91(4), pages 1126-1134, September.
    5. Winter, Joachim, 0000. "Bracketing effects in categorized survey questions and the measurement of economic quantities," Sonderforschungsbereich 504 Publications 02-35, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    6. Granbois, Donald H & Summers, John O, 1975. "Primary and Secondary Validity of Consumer Purchase Probabilities," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 1(4), pages 31-38, March.
    7. J. Dominitz & C. F. Manski, "undated". "Using expectations data to study subjective income expectations," Institute for Research on Poverty Discussion Papers 1050-94, University of Wisconsin Institute for Research on Poverty.
    8. James Banks & Arie Kapteyn & James P. Smith & Arthur Van Soest, 2004. "International Comparisons of Work Disability," Working Papers WR-155, RAND Corporation.
    9. Poterba, James M & Summers, Lawrence H, 1986. "Reporting Errors and Labor Market Dynamics," Econometrica, Econometric Society, vol. 54(6), pages 1319-1338, November.
    10. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    11. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    12. Ben-Akiva, Moshe & McFadden, Daniel & Train, Kenneth & Börsch-Supan, Axel, 2002. "Hybrid Choice Models: Progress and Challenges," Sonderforschungsbereich 504 Publications 02-29, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    13. Michael D. Hurd & Kathleen McGarry, 2002. "The Predictive Validity of Subjective Probabilities of Survival," Economic Journal, Royal Economic Society, vol. 112(482), pages 966-985, October.
    14. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    15. Kathleen McGarry, 2004. "Health and Retirement: Do Changes in Health Affect Retirement Expectations?," Journal of Human Resources, University of Wisconsin Press, vol. 39(3).
    16. Jeff Dominitz & Charles F. Manski, 2004. "How Should We Measure Consumer Confidence?," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 51-66, Spring.
    17. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    18. Schwarz, Norbert, 2003. "Self-Reports in Consumer Research: The Challenge of Comparing Cohorts and Cultures," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 29(4), pages 588-594, March.
    19. Banks, James & Kapteyn, Arie & Smith, James P. & van Soest, Arthur, 2004. "International Comparisons of Work Disability," IZA Discussion Papers 1118, Institute for the Study of Labor (IZA).
    20. William J. Infosino, 1986. "Forecasting New Product Sales from Likelihood of Purchase Ratings," Marketing Science, INFORMS, vol. 5(4), pages 372-384.
    21. Bruce Buchanan & Donald G. Morrison, 1987. "Note—Sampling Properties of Rate Questions with Implications for Survey Research," Marketing Science, INFORMS, vol. 6(3), pages 286-298.
    22. Peter Adams & Michael D. Hurd & Daniel L. McFadden & Angela Merrill & Tiago Ribeiro, 2004. "Healthy, Wealthy, and Wise? Tests for Direct Causal Paths between Health and Socioeconomic Status," NBER Chapters, in: Perspectives on the Economics of Aging, pages 415-526, National Bureau of Economic Research, Inc.
    23. Michael D. Hurd & Kathleen McGarry, 1995. "Evaluation of the Subjective Probabilities of Survival in the Health and Retirement Study," Journal of Human Resources, University of Wisconsin Press, vol. 30, pages 268-292.
    24. Michael D. Hurd & Daniel McFadden & Harish Chand & Li Gan & Angela Menill & Michael Roberts, 1998. "Consumption and Savings Balances of the Elderly: Experimental Evidence on Survey Response Bias," NBER Chapters, in: Frontiers in the Economics of Aging, pages 353-392, National Bureau of Economic Research, Inc.
    25. Klein, Roger & Sherman, Robert, 1997. "Estimating new product demand from biased survey data," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 53-76.
    26. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    27. Manohar U. Kalwani & Alvin J. Silk, 1982. "On the Reliability and Predictive Validity of Purchase Intention Measures," Marketing Science, INFORMS, vol. 1(3), pages 243-286.
    28. Harris, Katherine M. & Keane, Michael P., 1998. "A model of health plan choice:: Inferring preferences and perceptions from a combination of revealed preference and attitudinal data," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 131-157, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huynh, Kim P. & Jung, Juergen, 2015. "Subjective health expectations," Journal of Policy Modeling, Elsevier, vol. 37(4), pages 693-711.
    2. Beni­tez-Silva, Hugo & Ni, Huan, 2008. "Health status and health dynamics in an empirical model of expected longevity," Journal of Health Economics, Elsevier, vol. 27(3), pages 564-584, May.
    3. Joan Costa-Font & Cristina Vilaplana-Prieto, 2022. "Biased survival expectations and behaviours: Does domain specific information matter?," Journal of Risk and Uncertainty, Springer, vol. 65(3), pages 285-317, December.
    4. Adeline Delavande, 2008. "Measuring revisions to subjective expectations," Journal of Risk and Uncertainty, Springer, vol. 36(1), pages 43-82, February.
    5. Martin Salm, 2010. "Subjective mortality expectations and consumption and saving behaviours among the elderly," Canadian Journal of Economics, Canadian Economics Association, vol. 43(3), pages 1040-1057, August.
    6. A. Ludwig & A. Zimper, 2013. "A parsimonious model of subjective life expectancy," Theory and Decision, Springer, vol. 75(4), pages 519-541, October.
    7. Sanna Nivakoski, 2020. "Wealth and the effect of subjective survival probability," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(2), pages 633-670, April.
    8. Nils Grevenbrock & Max Groneck & Alexander Ludwig & Alexander Zimper, 2021. "Cognition, Optimism, And The Formation Of Age‐Dependent Survival Beliefs," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(2), pages 887-918, May.
    9. Todd Elder, 2013. "The Predictive Validity of Subjective Mortality Expectations: Evidence From the Health and Retirement Study," Demography, Springer;Population Association of America (PAA), vol. 50(2), pages 569-589, April.
    10. Adeline Delavande & Susann Rohwedder, 2008. "Eliciting Subjective Expectations in Internet Surveys," Working Papers 589, RAND Corporation.
    11. Adeline Delavande & Susann Rohwedder, 2008. "Differential Mortality in Europe and the U.S. Estimates Based on Subjective Probabilities of Survival," Working Papers 613, RAND Corporation.
    12. Ahmed Khwaja & Frank Sloan & Sukyung Chung, 2007. "The relationship between individual expectations and behaviors: Mortality expectations and smoking decisions," Journal of Risk and Uncertainty, Springer, vol. 35(2), pages 179-201, October.
    13. Adeline Delavande & Susann Rohwedder, 2011. "Differential Survival in Europe and the United States: Estimates Based on Subjective Probabilities of Survival," Demography, Springer;Population Association of America (PAA), vol. 48(4), pages 1377-1400, November.
    14. L. Bissonnette & J. de Bresser, 2018. "Eliciting Subjective Survival Curves: Lessons from Partial Identification," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(3), pages 505-515, July.
    15. Anikó Bíró, 2013. "Subjective mortality hazard shocks and the adjustment of consumption expenditures," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(4), pages 1379-1408, October.
    16. Wu, Shang & Stevens, Ralph & Thorp, Susan, 2015. "Cohort and target age effects on subjective survival probabilities: Implications for models of the retirement phase," Journal of Economic Dynamics and Control, Elsevier, vol. 55(C), pages 39-56.
    17. Silvia Balia, 2007. "Reporting expected longevity and smoking: evidence from the SHARE," Health, Econometrics and Data Group (HEDG) Working Papers 07/10, HEDG, c/o Department of Economics, University of York.
    18. Bruno Arpino & Pierluigi Conzo & Francesco Salustri, 2022. "I am a survivor, keep on surviving: early-life exposure to conflict and subjective survival probabilities in adult life," Journal of Population Economics, Springer;European Society for Population Economics, vol. 35(2), pages 471-517, April.
    19. Julien Hugonnier & Florian Pelgrin & Pascal St‐Amour, 2020. "Closing down the shop: Optimal health and wealth dynamics near the end of life," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 138-153, February.
    20. de Bresser, Jochem, 2016. "Test-Retest Reliability of Subjective Survival Expectations," Other publications TiSEM dfd6074d-31ae-4ecb-be25-6, Tilburg University, School of Economics and Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:mktlet:v:16:y:2005:i:3:p:183-196. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.