IDEAS home Printed from https://ideas.repec.org/a/eee/transa/v130y2019icp134-157.html
   My bibliography  Save this article

Laboratory experimentation and simulation of discrete direction choices: Investigating hypothetical bias, decision-rule effect and external validity based on aggregate prediction measures

Author

Listed:
  • Haghani, Milad
  • Sarvi, Majid

Abstract

Laboratory experiments have recently become popular methods for understanding decision-making behaviour of humans in evacuations. When designed for individual-level data extraction, these experiments can be analysed by econometric models. These models can subsequently be implemented as part of broader computational tools that simulate evacuation processes. In taking this approach, a modeller will face several major questions at both experiment design and estimation/implementation phases: (I) Can the behaviour be instead inferred, with adequate accuracy, from stated choice surveys (i.e. hypothetical bias)? (II) Given that these laboratory experiments are performed in specific geometric layouts, are their modelling outcomes transferable to geometric layouts other than that of their origin (i.e. external validity)? (III) At the modelling phase, how critical is to determine whether to set the decision rule as random regret minimisation as opposed to random utility maximisation (i.e. decision rule)? This study investigates how each of these three problems impact on prediction outcomes when these models are employed to simulate an evacuation system.

Suggested Citation

  • Haghani, Milad & Sarvi, Majid, 2019. "Laboratory experimentation and simulation of discrete direction choices: Investigating hypothetical bias, decision-rule effect and external validity based on aggregate prediction measures," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 134-157.
  • Handle: RePEc:eee:transa:v:130:y:2019:i:c:p:134-157
    DOI: 10.1016/j.tra.2019.09.040
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0965856418304762
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.tra.2019.09.040?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Milad Haghani & Majid Sarvi & Zahra Shahhoseini & Maik Boltes, 2016. "How Simple Hypothetical-Choice Experiments Can Be Utilized to Learn Humans’ Navigational Escape Decisions in Emergencies," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-24, November.
    2. Caspar Chorus, 2011. "Random Regret Minimization: An Overview of Model Properties and Empirical Evidence," Transport Reviews, Taylor & Francis Journals, vol. 32(1), pages 75-92, July.
    3. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    4. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    5. Omar Al-Ubaydli & John A. List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control than Laboratory Experiments? A Simple Model," NBER Working Papers 20877, National Bureau of Economic Research, Inc.
    6. Lovreglio, Ruggiero & Fonzone, Achille & dell’Olio, Luigi, 2016. "A mixed logit model for predicting exit choice during building evacuations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 92(C), pages 59-75.
    7. Chen, Liang & Tang, Tie-Qiao & Huang, Hai-Jun & Song, Ziqi, 2018. "Elementary students’ evacuation route choice in a classroom: A questionnaire-based method," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 492(C), pages 1066-1074.
    8. Mara Thiene & Marco Boeri & Caspar Chorus, 2012. "Random Regret Minimization: Exploration of a New Choice Model for Environmental and Resource Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(3), pages 413-429, March.
    9. Brownstone, David & Small, Kenneth A., 2005. "Valuing time and reliability: assessing the evidence from road pricing demonstrations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(4), pages 279-293, May.
    10. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    11. Özdemir, Semra & Johnson, F. Reed & Hauber, A. Brett, 2009. "Hypothetical bias, cheap talk, and stated willingness to pay for health care," Journal of Health Economics, Elsevier, vol. 28(4), pages 894-901, July.
    12. Lovreglio, Ruggiero & Spearpoint, Michael & Girault, Mathilde, 2019. "The impact of sampling methods on evacuation model convergence and egress time," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 24-34.
    13. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    14. van Cranenburgh, Sander & Prato, Carlo G., 2016. "On the robustness of random regret minimization modelling outcomes towards omitted attributes," Journal of choice modelling, Elsevier, vol. 18(C), pages 51-70.
    15. Caspar G. Chorus, 2012. "Random Regret-based Discrete Choice Modeling," SpringerBriefs in Business, Springer, edition 127, number 978-3-642-29151-7, October.
    16. Chorus, Caspar G. & Arentze, Theo A. & Timmermans, Harry J.P., 2008. "A Random Regret-Minimization model of travel choice," Transportation Research Part B: Methodological, Elsevier, vol. 42(1), pages 1-18, January.
    17. Haghani, Milad & Sarvi, Majid, 2017. "Social dynamics in emergency evacuations: Disentangling crowd’s attraction and repulsion effects," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 475(C), pages 24-34.
    18. Caspar G. Chorus, 2012. "Applicability of Random Regret Minimization-Models, and Their Strong and Weak Points," SpringerBriefs in Business, in: Random Regret-based Discrete Choice Modeling, edition 127, chapter 0, pages 35-41, Springer.
    19. Pursals, Salvador Casadesús & Garzón, Federico Garriga, 2009. "Optimal building evacuation time considering evacuation routes," European Journal of Operational Research, Elsevier, vol. 192(2), pages 692-699, January.
    20. Ning Ding & Hui Zhang & Tao Chen, 2017. "Simulation-based optimization of emergency evacuation strategy in ultra-high-rise buildings," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 89(3), pages 1167-1184, December.
    21. Hess, Stephane & Stathopoulos, Amanda, 2013. "A mixed random utility — Random regret model linking the choice of decision rule to latent character traits," Journal of choice modelling, Elsevier, vol. 9(C), pages 27-38.
    22. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    23. Angelino C. G. Viceisza, 2016. "Creating A Lab In The Field: Economics Experiments For Policymaking," Journal of Economic Surveys, Wiley Blackwell, vol. 30(5), pages 835-854, December.
    24. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    25. Harri Ehtamo & Simo Heliövaara & Timo Korhonen & Simo Hostikka, 2010. "Game Theoretic Best-Response Dynamics For Evacuees' Exit Selection," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 13(01), pages 113-134.
    26. Johansson-Stenman Olof & Svedsäter Henrik, 2008. "Measuring Hypothetical Bias in Choice Experiments: The Importance of Cognitive Consistency," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-10, September.
    27. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    28. Nikolai W F Bode & Stefan Holl & Wolfgang Mehner & Armin Seyfried, 2015. "Disentangling the Impact of Social Groups on Response Times and Movement Dynamics in Evacuations," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    29. Chorus, Caspar G. & Annema, Jan Anne & Mouter, Niek & van Wee, Bert, 2011. "Modeling politicians' preferences for road pricing policies: A regret-based and utilitarian perspective," Transport Policy, Elsevier, vol. 18(6), pages 856-861, November.
    30. Emily Lancsar & Joffre Swait, 2014. "Reconceptualising the External Validity of Discrete Choice Experiments," PharmacoEconomics, Springer, vol. 32(10), pages 951-965, October.
    31. Haghani, Milad & Sarvi, Majid, 2018. "Crowd behaviour and motion: Empirical methods," Transportation Research Part B: Methodological, Elsevier, vol. 107(C), pages 253-294.
    32. von Krüchten, Cornelia & Schadschneider, Andreas, 2017. "Empirical study on social groups in pedestrian evacuation dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 475(C), pages 129-141.
    33. Moser, Riccarda & Raffaelli, Roberta, 2014. "Does attribute cut-off elicitation affect choice consistency? Contrasting hypothetical and real-money choice experiments," Journal of choice modelling, Elsevier, vol. 11(C), pages 16-29.
    34. van Cranenburgh, Sander & Chorus, Caspar G., 2018. "Does the decision rule matter for large-scale transport models?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 114(PB), pages 338-353.
    35. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    36. Bosworth Ryan & Taylor Laura O., 2012. "Hypothetical Bias in Choice Experiments: Is Cheap Talk Effective at Eliminating Bias on the Intensive and Extensive Margins of Choice?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-28, December.
    37. Chorus, Caspar & van Cranenburgh, Sander & Dekker, Thijs, 2014. "Random regret minimization for consumer choice modeling: Assessment of empirical evidence," Journal of Business Research, Elsevier, vol. 67(11), pages 2428-2436.
    38. Johansson-Stenman, Olof & Svedsäter, Henrik, 2012. "Self-image and valuation of moral goods: Stated versus actual willingness to pay," Journal of Economic Behavior & Organization, Elsevier, vol. 84(3), pages 879-891.
    39. Dekker, Thijs, 2014. "Indifference based value of time measures for Random Regret Minimisation models," Journal of choice modelling, Elsevier, vol. 12(C), pages 10-20.
    40. van Cranenburgh, Sander & Guevara, Cristian Angelo & Chorus, Caspar G., 2015. "New insights on random regret minimization models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 74(C), pages 91-109.
    41. Haghani, Milad & Sarvi, Majid, 2017. "Stated and revealed exit choices of pedestrian crowd evacuees," Transportation Research Part B: Methodological, Elsevier, vol. 95(C), pages 238-259.
    42. Haghani, Milad & Sarvi, Majid & Shahhoseini, Zahra, 2015. "Accommodating taste heterogeneity and desired substitution pattern in exit choices of pedestrian crowd evacuees using a mixed nested logit model," Journal of choice modelling, Elsevier, vol. 16(C), pages 58-68.
    43. Gregory Howard & Brian E. Roe & Erik C. Nisbet & Jay F. Martin, 2017. "Hypothetical Bias Mitigation Techniques in Choice Experiments: Do Cheap Talk and Honesty Priming Effects Fade with Repeated Choices?," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 543-573.
    44. Fang, Zhiming & Song, Weiguo & Zhang, Jun & Wu, Hao, 2010. "Experiment and modeling of exit-selecting behaviors during a building evacuation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(4), pages 815-824.
    45. Lovreglio, Ruggiero & Ronchi, Enrico & Borri, Dino, 2014. "The validation of evacuation simulation models through the analysis of behavioural uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 166-174.
    46. Omar Al-Ubaydli & John A. List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control Than Laboratory Experiments?," American Economic Review, American Economic Association, vol. 105(5), pages 462-466, May.
    47. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    48. Omar Al-Ubaydli & John List, 2015. "Control in Experiments: A Simple Model," Artefactual Field Experiments 00397, The Field Experiments Website.
    49. Delcea, Camelia & Cotfas, Liviu-Adrian, 2019. "Increasing awareness in classroom evacuation situations using agent-based modeling," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 1400-1418.
    50. Matthew Quaife & Fern Terris-Prestholt & Gian Luca Di Tanna & Peter Vickerman, 2018. "How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(8), pages 1053-1066, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Smeele, Nicholas V.R. & Chorus, Caspar G. & Schermer, Maartje H.N. & de Bekker-Grob, Esther W., 2023. "Towards machine learning for moral choice analysis in health economics: A literature review and research agenda," Social Science & Medicine, Elsevier, vol. 326(C).
    4. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    5. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    6. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    4. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    5. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    6. Haghani, Milad & Sarvi, Majid, 2018. "Crowd behaviour and motion: Empirical methods," Transportation Research Part B: Methodological, Elsevier, vol. 107(C), pages 253-294.
    7. van Cranenburgh, Sander & Guevara, Cristian Angelo & Chorus, Caspar G., 2015. "New insights on random regret minimization models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 74(C), pages 91-109.
    8. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    9. van Cranenburgh, Sander & Prato, Carlo G., 2016. "On the robustness of random regret minimization modelling outcomes towards omitted attributes," Journal of choice modelling, Elsevier, vol. 18(C), pages 51-70.
    10. Haghani, Milad, 2021. "The knowledge domain of crowd dynamics: Anatomy of the field, pioneering studies, temporal trends, influential entities and outside-domain impact," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 580(C).
    11. Matthew Quaife & Fern Terris-Prestholt & Gian Luca Di Tanna & Peter Vickerman, 2018. "How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(8), pages 1053-1066, November.
    12. Shahhoseini, Zahra & Sarvi, Majid, 2019. "Pedestrian crowd flows in shared spaces: Investigating the impact of geometry based on micro and macro scale measures," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 57-87.
    13. Krčál, Ondřej & Peer, Stefanie & Staněk, Rostislav & Karlínová, Bára, 2019. "Real consequences matter: Why hypothetical biases in the valuation of time persist even in controlled lab experiments," Economics of Transportation, Elsevier, vol. 20(C).
    14. Milad Haghani & Majid Sarvi & Zahra Shahhoseini & Maik Boltes, 2016. "How Simple Hypothetical-Choice Experiments Can Be Utilized to Learn Humans’ Navigational Escape Decisions in Emergencies," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-24, November.
    15. Geržinič, Nejc & van Cranenburgh, Sander & Cats, Oded & Lancsar, Emily & Chorus, Caspar, 2021. "Estimating decision rule differences between ‘best’ and ‘worst’ choices in a sequential best worst discrete choice experiment," Journal of choice modelling, Elsevier, vol. 41(C).
    16. Hancock, Thomas O. & Hess, Stephane & Choudhury, Charisma F., 2018. "Decision field theory: Improvements to current methodology and comparisons with standard choice modelling techniques," Transportation Research Part B: Methodological, Elsevier, vol. 107(C), pages 18-40.
    17. Chorus, Caspar & van Cranenburgh, Sander & Dekker, Thijs, 2014. "Random regret minimization for consumer choice modeling: Assessment of empirical evidence," Journal of Business Research, Elsevier, vol. 67(11), pages 2428-2436.
    18. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    19. Boeri, Marco & Longo, Alberto, 2017. "The importance of regret minimization in the choice for renewable energy programmes: Evidence from a discrete choice experiment," Energy Economics, Elsevier, vol. 63(C), pages 253-260.
    20. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transa:v:130:y:2019:i:c:p:134-157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/547/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.