IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v109y2018icp70-89.html
   My bibliography  Save this article

Pooling stated and revealed preference data in the presence of RP endogeneity

Author

Listed:
  • Helveston, John Paul
  • Feit, Elea McDonnell
  • Michalek, Jeremy J.

Abstract

Pooled discrete choice models combine revealed preference (RP) data and stated preference (SP) data to exploit advantages of each. SP data is often treated with suspicion because consumers may respond differently in a hypothetical survey context than they do in the marketplace. However, models built on RP data can suffer from endogeneity bias when attributes that drive consumer choices are unobserved by the modeler and correlated with observed variables. Using a synthetic data experiment, we test the performance of pooled RP–SP models in recovering the preference parameters that generated the market data under conditions that choice modelers are likely to face, including (1) when there is potential for endogeneity problems in the RP data, such as omitted variable bias, and (2) when consumer willingness to pay for attributes may differ from the survey context to the market context. We identify situations where pooling RP and SP data does and does not mitigate each data source’s respective weaknesses. We also show that the likelihood ratio test, which has been widely used to determine whether pooling is statistically justifiable, (1) can fail to identify the case where SP context preference differences and RP endogeneity bias shift the parameter estimates of both models in the same direction and magnitude and (2) is unreliable when the product attributes are fixed within a small number of choice sets, which is typical of automotive RP data. Our findings offer new insights into when pooling data sources may or may not be advisable for accurately estimating market preference parameters, including consideration of the conditions and context under which the data were generated as well as the relative balance of information between data sources.

Suggested Citation

  • Helveston, John Paul & Feit, Elea McDonnell & Michalek, Jeremy J., 2018. "Pooling stated and revealed preference data in the presence of RP endogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 109(C), pages 70-89.
  • Handle: RePEc:eee:transb:v:109:y:2018:i:c:p:70-89
    DOI: 10.1016/j.trb.2018.01.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261516304647
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2018.01.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. von Haefen, Roger H. & Phaneuf, Daniel J., 2008. "Identifying demand parameters in the presence of unobservables: A combined revealed and stated preference approach," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 19-32, July.
    2. Haaf, C. Grace & Morrow, W. Ross & Azevedo, Inês M.L. & Feit, Elea McDonnell & Michalek, Jeremy J., 2016. "Forecasting light-duty vehicle demand using alternative-specific constants for endogeneity correction versus calibration," Transportation Research Part B: Methodological, Elsevier, vol. 84(C), pages 182-210.
    3. Adamowicz, Wiktor & Swait, Joffre & Boxall, Peter & Louviere, Jordan & Williams, Michael, 1997. "Perceptions versus Objective Measures of Environmental Quality in Combined Revealed and Stated Preference Models of Environmental Valuation," Journal of Environmental Economics and Management, Elsevier, vol. 32(1), pages 65-84, January.
    4. Brownstone, David & Train, Kenneth, 1998. "Forecasting new product penetration with flexible substitution patterns," Journal of Econometrics, Elsevier, vol. 89(1-2), pages 109-129, November.
    5. Ju-Chin Huang & Timothy C. Haab & John C. Whitehead, "undated". "Willingness to Pay for Quality Improvements: Can Revealed and Stated Preferences Data be Combined?," Working Papers 9704, East Carolina University, Department of Economics.
    6. Brownstone, David & Small, Kenneth A., 2005. "Valuing time and reliability: assessing the evidence from road pricing demonstrations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(4), pages 279-293, May.
    7. William Greene, 2004. "The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 98-119, June.
    8. Min Ding & Rajdeep Grewal & John Liechty, 2005. "Incentive-aligned conjoint analysis," Framed Field Experiments 00139, The Field Experiments Website.
    9. Axsen, Jonn & Mountain, Dean C. & Jaccard, Mark, 2009. "Combining stated and revealed choice research to simulate the neighbor effect: The case of hybrid-electric vehicles," Institute of Transportation Studies, Working Paper Series qt02n9j6cv, Institute of Transportation Studies, UC Davis.
    10. Garrett Sonnier & Andrew Ainslie & Thomas Otter, 2007. "Heterogeneity distributions of willingness-to-pay in choice models," Quantitative Marketing and Economics (QME), Springer, vol. 5(3), pages 313-331, September.
    11. Brownstone, David & Bunch, David S. & Train, Kenneth, 2000. "Joint mixed logit models of stated and revealed preferences for alternative-fuel vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 34(5), pages 315-338, June.
    12. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    13. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    14. Adamowicz W. & Louviere J. & Williams M., 1994. "Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities," Journal of Environmental Economics and Management, Elsevier, vol. 26(3), pages 271-292, May.
    15. Axsen, Jonn & Mountain, Dean C. & Jaccard, Mark, 2009. "Combining stated and revealed choice research to simulate the neighbor effect: The case of hybrid-electric vehicles," Resource and Energy Economics, Elsevier, vol. 31(3), pages 221-238, August.
    16. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, January.
    17. Birol, Ekin & Kontoleon, Andreas & Smale, Melinda, 2006. "Combining revealed and stated preference methods to assess the private value of agrobiodiversity in Hungarian home gardens:," EPTD discussion papers 156, International Food Policy Research Institute (IFPRI).
    18. Peter E. Rossi, 2014. "Invited Paper —Even the Rich Can Make Themselves Poor: A Critical Examination of IV Methods in Marketing Applications," Marketing Science, INFORMS, vol. 33(5), pages 655-672, September.
    19. Bhat, Chandra R. & Castelar, Saul, 2002. "A unified mixed logit framework for modeling revealed and stated preferences: formulation and application to congestion pricing analysis in the San Francisco Bay area," Transportation Research Part B: Methodological, Elsevier, vol. 36(7), pages 593-616, August.
    20. Joffre Swait & Rick L. Andrews, 2003. "Enriching Scanner Panel Models with Choice Experiments," Marketing Science, INFORMS, vol. 22(4), pages 442-460, September.
    21. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    22. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    23. J. Miguel Villas-Boas & Russell S. Winer, 1999. "Endogeneity in Brand Choice Models," Management Science, INFORMS, vol. 45(10), pages 1324-1338, October.
    24. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    25. Guevara, C. Angelo, 2015. "Critical assessment of five methods to correct for endogeneity in discrete-choice models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 82(C), pages 240-254.
    26. Tami L. Mark & Joffre Swait, 2004. "Using stated preference and revealed preference modeling to evaluate prescribing decisions," Health Economics, John Wiley & Sons, Ltd., vol. 13(6), pages 563-573, June.
    27. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    28. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    29. Eleanor McDonnell Feit & Mark A. Beltramo & Fred M. Feinberg, 2010. "Reality Check: Combining Choice Experiments with Market Data to Estimate the Importance of Product Attributes," Management Science, INFORMS, vol. 56(5), pages 785-800, May.
    30. Huang, Ju-Chin & Haab, Timothy C. & Whitehead, John C., 1997. "Willingness to Pay for Quality Improvements: Should Revealed and Stated Preference Data Be Combined?," Journal of Environmental Economics and Management, Elsevier, vol. 34(3), pages 240-255, November.
    31. John Loomis, 2011. "What'S To Know About Hypothetical Bias In Stated Preference Valuation Studies?," Journal of Economic Surveys, Wiley Blackwell, vol. 25(2), pages 363-370, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Sheldon, Tamara L. & Dua, Rubal, 2020. "Effectiveness of China's plug-in electric vehicle subsidy," Energy Economics, Elsevier, vol. 88(C).
    4. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Gao, Dong Li & Xie, Wei & Ming Lee, Eric Wai, 2022. "Individual-level exit choice behaviour under uncertain risk," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 604(C).
    6. Shenhao Wang & Qingyi Wang & Jinhua Zhao, 2019. "Multitask Learning Deep Neural Networks to Combine Revealed and Stated Preference Data," Papers 1901.00227, arXiv.org, revised Aug 2019.
    7. Chen, Dongxu & Peng, Sufan & Lian, Feng & Yang, Zhongzhen, 2023. "Optimization of a Japan-Europe multimodal transportation corridor," Transportation Research Part A: Policy and Practice, Elsevier, vol. 175(C).
    8. Diana Romero‐Espinosa & Mauricio Sarrias & Ricardo Daziano, 2021. "Are preferences for city attributes heterogeneous? An assessment using a discrete choice experiment," Papers in Regional Science, Wiley Blackwell, vol. 100(1), pages 251-272, February.
    9. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    10. Wang, Shenhao & Wang, Qingyi & Zhao, Jinhua, 2020. "Multitask learning deep neural networks to combine revealed and stated preference data," Journal of choice modelling, Elsevier, vol. 37(C).
    11. Sisi Que & Yu Huang & Kwame Awuah-Offei & Liang Wang & Songlin Liu, 2023. "Discrete Choice Experiment Consideration: A Framework for Mining Community Consultation with Case Studies," Sustainability, MDPI, vol. 15(17), pages 1-17, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    3. Helveston, John Paul & Liu, Yimin & Feit, Elea McDonnell & Fuchs, Erica & Klampfl, Erica & Michalek, Jeremy J., 2015. "Will subsidies drive electric vehicle adoption? Measuring consumer preferences in the U.S. and China," Transportation Research Part A: Policy and Practice, Elsevier, vol. 73(C), pages 96-112.
    4. John C. Whitehead & Subhrendu K. Pattanayak & George L. Van Houtven & Brett R. Gelso, 2008. "Combining Revealed And Stated Preference Data To Estimate The Nonmarket Value Of Ecological Services: An Assessment Of The State Of The Science," Journal of Economic Surveys, Wiley Blackwell, vol. 22(5), pages 872-908, December.
    5. Martin Achtnicht, 2012. "German car buyers’ willingness to pay to reduce CO 2 emissions," Climatic Change, Springer, vol. 113(3), pages 679-697, August.
    6. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    7. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    8. Hocheol Jeon & Joseph A. Herriges, 2017. "Combining Revealed Preference Data with Stated Preference Data: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(4), pages 1053-1086, December.
    9. John C. Whitehead & Daniel K. Lew, 2020. "Estimating recreation benefits through joint estimation of revealed and stated preference discrete choice data," Empirical Economics, Springer, vol. 58(4), pages 2009-2029, April.
    10. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    11. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    12. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    13. Siikamaki, Juha & Layton, David F., 2006. "Discrete Choice Survey Experiments: A Comparison Using Flexible Models," RFF Working Paper Series dp-05-60, Resources for the Future.
    14. Araña, Jorge E. & León, Carmelo J., 2013. "Dynamic hypothetical bias in discrete choice experiments: Evidence from measuring the impact of corporate social responsibility on consumers demand," Ecological Economics, Elsevier, vol. 87(C), pages 53-61.
    15. Siikamaki, Juha & Layton, David F., 2007. "Discrete choice survey experiments: A comparison using flexible methods," Journal of Environmental Economics and Management, Elsevier, vol. 53(1), pages 122-139, January.
    16. Tanaka, Makoto & Ida, Takanori & Murakami, Kayo & Friedman, Lee, 2014. "Consumers’ willingness to pay for alternative fuel vehicles: A comparative discrete choice analysis between the US and Japan," Transportation Research Part A: Policy and Practice, Elsevier, vol. 70(C), pages 194-209.
    17. Takanori Ida & Kayo Murakami & Makoto Tanaka, 2012. "Keys to Smart Home Diffusion: A Stated Preference Analysis of Smart Meters, Photovoltaic Generation, and Electric/Hybrid Vehicles," Discussion papers e-11-011, Graduate School of Economics Project Center, Kyoto University.
    18. Coote, Leonard V. & Swait, Joffre & Adamowicz, Wiktor, 2021. "Separating generalizable from source-specific preference heterogeneity in the fusion of revealed and stated preferences," Journal of choice modelling, Elsevier, vol. 40(C).
    19. Hackbarth, André & Madlener, Reinhard, 2016. "Willingness-to-pay for alternative fuel vehicle characteristics: A stated choice study for Germany," Transportation Research Part A: Policy and Practice, Elsevier, vol. 85(C), pages 89-111.
    20. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:109:y:2018:i:c:p:70-89. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.