IDEAS home Printed from https://ideas.repec.org/a/kap/transp/v40y2013i5p1021-1041.html
   My bibliography  Save this article

Sample size requirements for stated choice experiments

Author

Listed:
  • John Rose
  • Michiel Bliemer

Abstract

Stated choice (SC) experiments represent the dominant data paradigm in the study of behavioral responses of individuals, households as well as other organizations, yet in the past little has been known about the sample size requirements for models estimated from such data. Traditional orthogonal designs and existing sampling theories does not adequately address the issue and hence researchers have had to resort to simple rules of thumb or ignore the issue and collect samples of arbitrary size, hoping that the sample is sufficiently large enough to produce reliable parameter estimates, or are forced to make assumptions about the data that are unlikely to hold in practice. In this paper, we demonstrate how a recently proposed sample size computation can be used to generate so-called S-efficient designs using prior parameter values to estimate panel mixed multinomial logit models. Sample size requirements for such designs in SC studies are investigated. In a numerical case study is shown that a D-efficient and even more an S-efficient design require a (much) smaller sample size than a random orthogonal design in order to estimate all parameters at the level of statistical significance. Furthermore, it is shown that wide level range has a significant positive influence on the efficiency of the design and therefore on the reliability of the parameter estimates. Copyright Springer Science+Business Media New York 2013

Suggested Citation

  • John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
  • Handle: RePEc:kap:transp:v:40:y:2013:i:5:p:1021-1041
    DOI: 10.1007/s11116-013-9451-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11116-013-9451-z
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11116-013-9451-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David A. Hensher & Paola Prioni, 2002. "A Service Quality Index for Area-wide Contract Performance Assessment," Journal of Transport Economics and Policy, University of Bath, vol. 36(1), pages 93-113, January.
    2. McFadden, Daniel L., 1984. "Econometric analysis of qualitative response models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 24, pages 1395-1457, Elsevier.
    3. Bliemer, Michiel C.J. & Rose, John M. & Hensher, David A., 2009. "Efficient stated choice experiments for estimating nested logit models," Transportation Research Part B: Methodological, Elsevier, vol. 43(1), pages 19-35, January.
    4. Jie Yu & Peter Goos & Martina Vandebroek, 2009. "Efficient Conjoint Choice Designs in the Presence of Respondent Heterogeneity," Marketing Science, INFORMS, vol. 28(1), pages 122-135, 01-02.
    5. Guy D. Garrod & Riccardo Scarpa & Kenneth G. Willis, 2002. "Estimating the Benefits of Traffic Calming on Through Routes: A Choice Experiment Approach," Journal of Transport Economics and Policy, University of Bath, vol. 36(2), pages 211-231, May.
    6. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    7. Rose, John M. & Bliemer, Michiel C.J. & Hensher, David A. & Collins, Andrew T., 2008. "Designing efficient stated choice experiments in the presence of reference alternatives," Transportation Research Part B: Methodological, Elsevier, vol. 42(4), pages 395-406, May.
    8. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    9. Zsolt Sándor & Michel Wedel, 2002. "Profile Construction in Experimental Choice Designs for Mixed Logit Models," Marketing Science, INFORMS, vol. 21(4), pages 455-475, February.
    10. Kessels, Roselinde & Jones, Bradley & Goos, Peter & Vandebroek, Martina, 2009. "An Efficient Algorithm for Constructing Bayesian Optimal Choice Designs," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(2), pages 279-291.
    11. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    12. Fredrik Carlsson & Peter Martinsson, 2003. "Design techniques for stated preference methods in health economics," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 281-294, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. van Cranenburgh, Sander & Rose, John M. & Chorus, Caspar G., 2018. "On the robustness of efficient experimental designs towards the underlying decision rule," Transportation Research Part A: Policy and Practice, Elsevier, vol. 109(C), pages 50-64.
    2. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    3. Palhazi Cuervo, Daniel & Kessels, Roselinde & Goos, Peter & Sörensen, Kenneth, 2016. "An integrated algorithm for the optimal design of stated choice experiments with partial profiles," Transportation Research Part B: Methodological, Elsevier, vol. 93(PA), pages 648-669.
    4. Sanko, Nobuhiro & Yamamoto, Toshiyuki, 2013. "Estimation efficiency of RP/SP models considering SP design and error structures," Journal of choice modelling, Elsevier, vol. 6(C), pages 60-73.
    5. Yu, Jie & Goos, Peter & Vandebroek, Martina, 2010. "Comparing different sampling schemes for approximating the integrals involved in the efficient design of stated choice experiments," Transportation Research Part B: Methodological, Elsevier, vol. 44(10), pages 1268-1289, December.
    6. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    7. John M. Rose & Michiel C.J. Bliemer, 2014. "Stated choice experimental design theory: the who, the what and the why," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 7, pages 152-177, Edward Elgar Publishing.
    8. Bliemer, Michiel C.J. & Rose, John M. & Hensher, David A., 2009. "Efficient stated choice experiments for estimating nested logit models," Transportation Research Part B: Methodological, Elsevier, vol. 43(1), pages 19-35, January.
    9. Kerr, Geoffrey N. & Sharp, Basil M.H., 2010. "Choice experiment adaptive design benefits: a case study," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 54(4), pages 1-14.
    10. Frischknecht, Bart D. & Eckert, Christine & Geweke, John & Louviere, Jordan J., 2014. "A simple method for estimating preference parameters for individuals," International Journal of Research in Marketing, Elsevier, vol. 31(1), pages 35-48.
    11. Kessels, Roselinde, 2016. "Homogeneous versus heterogeneous designs for stated choice experiments: Ain't homogeneous designs all bad?," Journal of choice modelling, Elsevier, vol. 21(C), pages 2-9.
    12. Joan L. Walker & Yanqiao Wang & Mikkel Thorhauge & Moshe Ben-Akiva, 2018. "D-efficient or deficient? A robustness analysis of stated choice experimental designs," Theory and Decision, Springer, vol. 84(2), pages 215-238, March.
    13. Danaf, Mazen & Atasoy, Bilge & de Azevedo, Carlos Lima & Ding-Mastera, Jing & Abou-Zeid, Maya & Cox, Nathaniel & Zhao, Fang & Ben-Akiva, Moshe, 2019. "Context-aware stated preferences with smartphone-based travel surveys," Journal of choice modelling, Elsevier, vol. 31(C), pages 35-50.
    14. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    15. Andreas Falke & Harald Hruschka, 2017. "A Monte Carlo study of design-generating algorithms for the latent class mixed logit model," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 39(4), pages 1035-1053, October.
    16. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    17. Nedka Dechkova Nikiforova & Rossella Berni & Jesús Fernando López‐Fidalgo, 2022. "Optimal approximate choice designs for a two‐step coffee choice, taste and choice again experiment," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1895-1917, November.
    18. KESSELS, Roselinde & BRADLEY, Jones & GOOS, Peter, 2012. "A comparison of partial profile designs for discrete choice experiments with an application in software development," Working Papers 2012004, University of Antwerp, Faculty of Business and Economics.
    19. Yu, Jie & Goos, Peter & Vandebroek, Martina, 2011. "Individually adapted sequential Bayesian conjoint-choice designs in the presence of consumer heterogeneity," International Journal of Research in Marketing, Elsevier, vol. 28(4), pages 378-388.
    20. Richard Yao & Riccardo Scarpa & John Rose & James Turner, 2015. "Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 433-455, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:transp:v:40:y:2013:i:5:p:1021-1041. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.