Advanced Search
MyIDEAS: Login to save this article or follow this journal

Experimental design influences on stated choice outputs: An empirical study in air travel choice

Contents:

Author Info

  • Bliemer, Michiel C.J.
  • Rose, John M.
Registered author(s):

    Abstract

    Discrete choice experiments are conducted in the transport field to obtain data for investigating travel behaviour and derived measures such as the value of travel time savings. The multinomial logit (MNL) and other more advanced discrete choice models (e.g., the mixed MNL model) have often been estimated on data from stated choice experiments and applied for planning and policy purposes. Determining efficient underlying experimental designs for these studies has become an increasingly important stream of research, in which the objective is to generate stated choice tasks that maximize the collected information, yielding more reliable parameter estimates. These theoretical advances have not been rigorously tested in practice, such that claims on whether the theoretical efficiency gains translate into practice cannot be made. Using an extensive empirical study of air travel choice behaviour, this paper presents for the first time results of different stated choice experimental design approaches, in which respective estimation results are compared. We show that D-efficient designs keep their promise in lowering standard errors in estimating, thereby requiring smaller sample sizes, ceteris paribus, compared to a more traditional orthogonal design. The parameter estimates found using an orthogonal design or an efficient design turn out to be statistically different in several cases, mainly attributed to more or less dominant alternatives existing in the orthogonal design. Furthermore, we found that small designs with a limited number of choice tasks performs just as good (or even better) than a large design. Finally, we show that theoretically predicted sample sizes using the so-called S-estimates provide a good lower bound. This paper will enable practitioners in better understanding the potential benefits of efficient designs, and enables policy makers to make decisions based on more reliable parameter estimates.

    Download Info

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
    File URL: http://www.sciencedirect.com/science/article/B6VG7-5178VK1-2/2/d12992183f844854e0a3797b2ba9bede
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

    Bibliographic Info

    Article provided by Elsevier in its journal Transportation Research Part A: Policy and Practice.

    Volume (Year): 45 (2011)
    Issue (Month): 1 (January)
    Pages: 63-79

    as in new window
    Handle: RePEc:eee:transa:v:45:y:2011:i:1:p:63-79

    Contact details of provider:
    Web page: http://www.elsevier.com/wps/find/journaldescription.cws_home/547/description#description

    Order Information:
    Postal: http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
    Web: https://shop.elsevier.com/order?id=547&ref=547_01_ooc_1&version=01

    Related research

    Keywords: Experimental design Stated choice Air travel Orthogonal design D-efficient design Sample size;

    References

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
    as in new window
    1. Darren Scott & Kay Axhausen, 2006. "Household Mobility Tool Ownership: Modeling Interactions between Cars and Season Tickets," Transportation, Springer, vol. 33(4), pages 311-328, 07.
    2. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387, April.
    3. Bhat, Chandra R. & Sardesai, Rupali, 2006. "The impact of stop-making and travel time reliability on commute mode choice," Transportation Research Part B: Methodological, Elsevier, vol. 40(9), pages 709-730, November.
    4. Cantillo, Víctor & Ortúzar, Juan de Dios, 2005. "A semi-compensatory discrete choice model with explicit attribute thresholds of perception," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 641-657, August.
    5. John M. Rose & Riccardo Scarpa, 2007. "Designs Efficiency for Non-market Valuation with Choice Modelling: How to Measure It, What to Report and Why," Working Papers in Economics 07/21, University of Waikato, Department of Economics.
    6. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    7. Guy D. Garrod & Riccardo Scarpa & Kenneth G. Willis, 2002. "Estimating the Benefits of Traffic Calming on Through Routes: A Choice Experiment Approach," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 36(2), pages 211-231, May.
    8. Yin-yen Tseng & Erik Verhoef, 2007. "Value of Time by Time of Day: A Stated-Preference Study," Tinbergen Institute Discussion Papers 07-061/3, Tinbergen Institute, revised 08 Nov 2007.
    9. Saleh, Wafaa & Farrell, Séona, 2005. "Implications of congestion charging for departure time choice: Work and non-work schedule flexibility," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(7-9), pages 773-791.
    10. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, University of Chicago Press, vol. 35(2), pages 360-375, 03.
    11. Hensher, David A. & Rose, John M. & Ortúzar, Juan de Dios & Rizzi, Luis I., 2009. "Estimating the willingness to pay and value of risk reduction for car occupants in the road environment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 43(7), pages 692-707, August.
    12. Espino, Raquel & de Dios Ortúzar, Juan & Román, Concepción, 2007. "Understanding suburban travel demand: Flexible modelling with revealed and stated choice data," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(10), pages 899-912, December.
    13. Kjartan Sælensminde, 2001. "Inconsistent choices in Stated Choice data;Use of the logit scaling approach to handle resulting variance increases," Transportation, Springer, vol. 28(3), pages 269-296, August.
    14. Tilahun, Nebiyou Y. & Levinson, David M. & Krizek, Kevin J., 2007. "Trails, lanes, or traffic: Valuing bicycle facilities with an adaptive stated preference survey," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(4), pages 287-301, May.
    15. Fosgerau, Mogens, 2007. "Using nonparametrics to specify a model to measure the value of travel time," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(9), pages 842-856, November.
    16. Becky Loo & S. Wong & Timothy Hau, 2006. "Introducing alternative fuel vehicles in Hong Kong: views from the public light bus industry," Transportation, Springer, vol. 33(6), pages 605-619, November.
    17. Rouwendal, Jan & de Blaeij, Arianne & Rietveld, Piet & Verhoef, Erik, 2010. "The information content of a stated choice experiment: A new method and its application to the value of a statistical life," Transportation Research Part B: Methodological, Elsevier, vol. 44(1), pages 136-151, January.
    18. Luis I. Rizzi & Juan de Dios Ort�zar, 2006. "Road Safety Valuation under a Stated Choice Framework," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 40(1), pages 69-94, January.
    19. Leitham, Scott & McQuaid, Ronald W. & D. Nelson, John, 2000. "The influence of transport on industrial location choice: a stated preference experiment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 34(7), pages 515-535, September.
    20. Cherchi, Elisabetta & Ortúzar, Juan de Dios, 2006. "On fitting mode specific constants in the presence of new options in RP/SP models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(1), pages 1-18, January.
    21. Hess, Stephane & Daly, Andrew & Rohr, Charlene & Hyman, Geoff, 2007. "On the development of time period and mode choice models for use in large scale modelling forecasting systems," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(9), pages 802-826, November.
    22. Fowkes, Tony, 2007. "The design and interpretation of freight stated preference experiments seeking to elicit behavioural valuations of journey attributes," Transportation Research Part B: Methodological, Elsevier, vol. 41(9), pages 966-980, November.
    23. Lee, Jongsu & Cho, Youngsang, 2009. "Demand forecasting of diesel passenger car considering consumer preference and government regulation in South Korea," Transportation Research Part A: Policy and Practice, Elsevier, vol. 43(4), pages 420-429, May.
    24. David A. Hensher & John M. Rose & Ian Black, 2008. "Interactive Agency Choice in Automobile Purchase Decisions: The Role of Negotiation in Determining Equilibrium Choice Outcomes," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 42(2), pages 269-296, May.
    25. Ipek Sener & Naveen Eluru & Chandra Bhat, 2009. "An analysis of bicycle route choice preferences in Texas, US," Transportation, Springer, vol. 36(5), pages 511-539, September.
    26. Anderson, Christopher M. & Das, Chhandita & Tyrrell, Timothy J., 2006. "Parking preferences among tourists in Newport, Rhode Island," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(4), pages 334-353, May.
    27. David A. Hensher, 2008. "Joint Estimation of Process and Outcome in Choice Experiments and Implications for Willingness to Pay," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 42(2), pages 297-322, May.
    28. Rose, John M. & Bliemer, Michiel C.J. & Hensher, David A. & Collins, Andrew T., 2008. "Designing efficient stated choice experiments in the presence of reference alternatives," Transportation Research Part B: Methodological, Elsevier, vol. 42(4), pages 395-406, May.
    29. Jovicic, Goran & Hansen, Christian Overgaard, 2003. "A passenger travel demand model for Copenhagen," Transportation Research Part A: Policy and Practice, Elsevier, vol. 37(4), pages 333-349, May.
    30. Hensher, David A., 2006. "Towards a practical method to establish comparable values of travel time savings from stated choice experiments with differing design dimensions," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(10), pages 829-840, December.
    31. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    32. Hensher, David A., 2008. "Influence of vehicle occupancy on the valuation of car driver's travel time savings: Identifying important behavioural segments," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(1), pages 67-76, January.
    33. Hensher, David A. & Greene, William H., 2002. "Specification and estimation of the nested logit model: alternative normalisations," Transportation Research Part B: Methodological, Elsevier, vol. 36(1), pages 1-17, January.
    34. Bastin, Fabian & Cirillo, Cinzia & Toint, Philippe L., 2006. "Application of an adaptive Monte Carlo algorithm to mixed logit estimation," Transportation Research Part B: Methodological, Elsevier, vol. 40(7), pages 577-593, August.
    35. Bliemer, Michiel C.J. & Rose, John M. & Hensher, David A., 2009. "Efficient stated choice experiments for estimating nested logit models," Transportation Research Part B: Methodological, Elsevier, vol. 43(1), pages 19-35, January.
    36. Brownston, David & Bunch, David S. & Train, Kenneth, 1999. "Joint mixed logit models of stated and revealed preferences for alternative-fuel vehicles," University of California Transportation Center, Working Papers qt7rf7s3nx, University of California Transportation Center.
    37. Baojin Wang & David Hensher & Tu Ton, 2002. "Safety in the road environment: a driver behavioural response perspective," Transportation, Springer, vol. 29(3), pages 253-270, August.
    38. Train, Kenneth & Wilson, Wesley W., 2008. "Estimation on stated-preference experiments constructed from revealed-preference choices," Transportation Research Part B: Methodological, Elsevier, vol. 42(3), pages 191-203, March.
    39. Ann Brewer & David Hensher, 2000. "Distributed work and travel behaviour: The dynamics of interactive agency choices between employers and employees," Transportation, Springer, vol. 27(1), pages 117-148, February.
    40. Ortúzar, Juan de Dios & Iacobelli, Andrés & Valeze, Claudio, 2000. "Estimating demand for a cycle-way network," Transportation Research Part A: Policy and Practice, Elsevier, vol. 34(5), pages 353-373, June.
    41. Puckett, Sean M. & Hensher, David A., 2009. "Revealing the extent of process heterogeneity in choice analysis: An empirical assessment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 43(2), pages 117-126, February.
    42. David A. Hensher & Paola Prioni, 2002. "A Service Quality Index for Area-wide Contract Performance Assessment," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 36(1), pages 93-113, January.
    43. Hollander, Yaron, 2006. "Direct versus indirect models for the effects of unreliability," Transportation Research Part A: Policy and Practice, Elsevier, vol. 40(9), pages 699-711, November.
    44. Cantillo, Víctor & Heydecker, Benjamin & de Dios Ortúzar, Juan, 2006. "A discrete choice model incorporating thresholds for perception in attribute values," Transportation Research Part B: Methodological, Elsevier, vol. 40(9), pages 807-825, November.
    45. David Hensher, 2001. "The valuation of commuter travel time savings for car drivers: evaluating alternative model specifications," Transportation, Springer, vol. 28(2), pages 101-118, May.
    46. Hensher, David A. & Rose, John M., 2007. "Development of commuter and non-commuter mode choice models for the assessment of new public transport infrastructure projects: A case study," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(5), pages 428-443, June.
    47. Kevin Washbrook & Wolfgang Haider & Mark Jaccard, 2006. "Estimating commuter mode choice: A discrete choice analysis of the impact of road pricing and parking charges," Transportation, Springer, vol. 33(6), pages 621-639, November.
    48. David A. Hensher, 2004. "Identifying the Influence of Stated Choice Design Dimensionality on Willingness to Pay for Travel Time Savings," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 38(3), pages 425-446, September.
    49. Bhat, Chandra R. & Castelar, Saul, 2002. "A unified mixed logit framework for modeling revealed and stated preferences: formulation and application to congestion pricing analysis in the San Francisco Bay area," Transportation Research Part B: Methodological, Elsevier, vol. 36(7), pages 593-616, August.
    50. Sean Puckett & David Hensher & John Rose & Andrew Collins, 2007. "Design and development of a stated choice experiment for interdependent agents: accounting for interactions between buyers and sellers of urban freight services," Transportation, Springer, vol. 34(4), pages 429-451, July.
    51. Greene, William H. & Hensher, David A. & Rose, John, 2006. "Accounting for heterogeneity in the variance of unobserved effects in mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 40(1), pages 75-92, January.
    52. Raquel Espino & Concepción Román & Juan Ortúzar, 2006. "Analysing Demand for Suburban Trips: A Mixed RP/SP Model with Latent Variables and Interaction Effects," Transportation, Springer, vol. 33(3), pages 241-261, 05.
    53. Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
    54. J. Hunt & J. Abraham, 2007. "Influences on bicycle use," Transportation, Springer, vol. 34(4), pages 453-470, July.
    55. Greene, William H. & Hensher, David A., 2003. "A latent class model for discrete choice analysis: contrasts with mixed logit," Transportation Research Part B: Methodological, Elsevier, vol. 37(8), pages 681-698, September.
    56. Ferrini, Silvia & Scarpa, Riccardo, 2007. "Designs with a priori information for nonmarket valuation with choice experiments: A Monte Carlo study," Journal of Environmental Economics and Management, Elsevier, vol. 53(3), pages 342-363, May.
    57. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    58. Wang, Donggen & Borgers, Aloys & Oppewal, Harmen & Timmermans, Harry, 2000. "A stated choice approach to developing multi-faceted models of activity behavior," Transportation Research Part A: Policy and Practice, Elsevier, vol. 34(8), pages 625-643, November.
    59. Zhang, Junyi & Timmermans, Harry & Borgers, Aloys & Wang, Donggen, 2004. "Modeling traveler choice behavior using the concepts of relative utility and relative interest," Transportation Research Part B: Methodological, Elsevier, vol. 38(3), pages 215-234, March.
    60. Rosalie Viney & Elizabeth Savage & Jordan Louviere, 2005. "Empirical investigation of experimental design properties of discrete choice experiments in health care," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 349-362.
    61. M. Beuthe & Ch. Bouffioux, 2008. "Analysing Qualitative Attributes of Freight Transport from Stated Orders of Preference Experiment," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 42(1), pages 105-128, January.
    62. Teichert, Thorsten & Shehu, Edlira & von Wartburg, Iwan, 2008. "Customer segmentation revisited: The case of the airline industry," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(1), pages 227-242, January.
    63. de Palma, André & Picard, Nathalie, 2005. "Route choice decision under travel time uncertainty," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(4), pages 295-324, May.
    64. Simon McDonnell & Susana Ferriera & Frank Convery, 2009. "Bus Priority Provision and Willingness to Pay Differentials Resulting from Modal Choice and Residential Location: Evidence from a Stated Choice Survey," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 43(2), pages 213-235, May.
    65. Hensher, David A. & King, Jenny, 2001. "Parking demand and responsiveness to supply, pricing and location in the Sydney central business district," Transportation Research Part A: Policy and Practice, Elsevier, vol. 35(3), pages 177-196, March.
    66. Ahern, Aoife A. & Tapley, Nigel, 2008. "The use of stated preference techniques to model modal choices on interurban trips in Ireland," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(1), pages 15-27, January.
    67. Hess, Stephane & Rose, John M., 2009. "Allowing for intra-respondent variations in coefficients estimated on repeated choice data," Transportation Research Part B: Methodological, Elsevier, vol. 43(6), pages 708-719, July.
    68. Hensher, David A. & Puckett, Sean M. & Rose, John M., 2007. "Agency decision making in freight distribution chains: Establishing a parsimonious empirical framework from alternative behavioural structures," Transportation Research Part B: Methodological, Elsevier, vol. 41(9), pages 924-949, November.
    69. David A. Hensher, 2001. "Measurement of the Valuation of Travel Time Savings," Journal of Transport Economics and Policy, London School of Economics and University of Bath, vol. 35(1), pages 71-98, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as in new window

    Cited by:
    1. Basu, Debasis & Hunt, John Douglas, 2012. "Valuing of attributes influencing the attractiveness of suburban train service in Mumbai city: A stated preference approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(9), pages 1465-1476.
    2. Nikhil Sikka & Paul Hanley, 2013. "What do commuters think travel time reliability is worth? Calculating economic value of reducing the frequency and extent of unexpected delays," Transportation, Springer, vol. 40(5), pages 903-919, September.
    3. George R. Parsons & Michael K. Hidrue & Willett Kempton & Meryl P. Gardner, 2011. "Can Vehicle-to-Grid Revenue Help Electric Vehicles on the Market?," Working Papers 11-21, University of Delaware, Department of Economics.
    4. John Rose & David Hensher, 2014. "Demand for taxi services: new elasticity evidence," Transportation, Springer, vol. 41(4), pages 717-743, July.
    5. Collins, Andrew T. & Rose, John M. & Hensher, David A., 2013. "Specification issues in a generalised random parameters attribute nonattendance model," Transportation Research Part B: Methodological, Elsevier, vol. 56(C), pages 234-253.
    6. Parsons, George R. & Hidrue, Michael K. & Kempton, Willett & Gardner, Meryl P., 2014. "Willingness to pay for vehicle-to-grid (V2G) electric vehicles and their contract terms," Energy Economics, Elsevier, vol. 42(C), pages 313-324.
    7. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    8. Greiner, Romy, 2014. "Willingness of north Australian pastoralists and graziers to participate in contractual biodiversity conservation," 2014 Conference (58th), February 4-7, 2014, Port Maquarie, Australia 165839, Australian Agricultural and Resource Economics Society.
    9. Greiner, Romy & Bliemer, Michiel & Ballweg, Julie, 2014. "Design considerations of a choice experiment to estimate likely participation by north Australian pastoralists in contractual biodiversity conservation," Journal of choice modelling, Elsevier, vol. 10(C), pages 34-45.
    10. Julia Blasch & Mehdi Farsi, 2012. "Retail demand for voluntary carbon offsets - A choice experiment among Swiss consumers," IED Working paper 12-18, IED Institute for Environmental Decisions, ETH Zurich.
    11. Greiner, Romy & Ballweg, Julie, 2013. "Estimating the supply of on-farm biodiversity conservation services by north Australian pastoralists: design of a choice experiment," 2013 Conference (57th), February 5-8, 2013, Sydney, Australia 152153, Australian Agricultural and Resource Economics Society.

    Lists

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    Statistics

    Access and download statistics

    Corrections

    When requesting a correction, please mention this item's handle: RePEc:eee:transa:v:45:y:2011:i:1:p:63-79. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.