IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v55y2025ics1755534525000144.html
   My bibliography  Save this article

Constructing Bayesian optimal designs for discrete choice experiments by simulated annealing

Author

Listed:
  • Mao, Yicheng
  • Kessels, Roselinde
  • van der Zanden, Tom C.

Abstract

Discrete choice experiments (DCEs) investigate the attributes that influence individuals’ choices when selecting among various options. To enhance the quality of the estimated choice models, researchers opt for Bayesian optimal designs that utilize existing information about the attributes’ preferences. Given the nonlinear nature of choice models, the construction of an appropriate design requires efficient algorithms. Among these, the coordinate-exchange (CE) algorithm is commonly employed for constructing designs based on the MNL model. However, as a hill-climbing method, the CE algorithm tends to quickly converge to local optima, potentially limiting the quality of the resulting designs. We propose the use of a simulated annealing (SA) algorithm to construct Bayesian optimal designs. This algorithm accepts both superior and inferior solutions, avoiding premature convergence and allowing a more thorough exploration of potential solutions. Consequently, it ultimately obtains higher-quality choice designs compared to the CE algorithm. Our work represents the first application of an SA algorithm in constructing Bayesian optimal designs for DCEs. Through extensive computational experiments, we demonstrate that the SA designs generally outperform the CE designs in terms of statistical efficiency, especially when the prior preference information is highly uncertain.

Suggested Citation

  • Mao, Yicheng & Kessels, Roselinde & van der Zanden, Tom C., 2025. "Constructing Bayesian optimal designs for discrete choice experiments by simulated annealing," Journal of choice modelling, Elsevier, vol. 55(C).
  • Handle: RePEc:eee:eejocm:v:55:y:2025:i:c:s1755534525000144
    DOI: 10.1016/j.jocm.2025.100551
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534525000144
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jocm.2025.100551?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Goos, P. & Syafitri, U. & Sartono, B. & Vazquez, A.R., 2020. "A nonlinear multidimensional knapsack problem in the optimal design of mixture experiments," European Journal of Operational Research, Elsevier, vol. 281(1), pages 201-221.
    2. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    3. David S. Johnson & Cecilia R. Aragon & Lyle A. McGeoch & Catherine Schevon, 1989. "Optimization by Simulated Annealing: An Experimental Evaluation; Part I, Graph Partitioning," Operations Research, INFORMS, vol. 37(6), pages 865-892, December.
    4. Burkard, R. E. & Rendl, F., 1984. "A thermodynamically motivated simulation procedure for combinatorial optimization problems," European Journal of Operational Research, Elsevier, vol. 17(2), pages 169-174, August.
    5. Peter E. Rossi & Greg M. Allenby, 2003. "Bayesian Statistics and Marketing," Marketing Science, INFORMS, vol. 22(3), pages 304-328, July.
    6. Van Acker, Veronique & Kessels, Roselinde & Palhazi Cuervo, Daniel & Lannoo, Steven & Witlox, Frank, 2020. "Preferences for long-distance coach transport: Evidence from a discrete choice experiment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 132(C), pages 759-779.
    7. Roselinde Kessels & Peter Goos & Bradley Jones & Martina Vandebroek, 2011. "Rejoinder: the usefulness of Bayesian optimal designs for discrete choice experiments," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(3), pages 197-203, May.
    8. Caussade, Sebastián & Ortúzar, Juan de Dios & Rizzi, Luis I. & Hensher, David A., 2005. "Assessing the influence of design dimensions on stated choice experiment estimates," Transportation Research Part B: Methodological, Elsevier, vol. 39(7), pages 621-640, August.
    9. Kessels, Roselinde & Jones, Bradley & Goos, Peter & Vandebroek, Martina, 2009. "An Efficient Algorithm for Constructing Bayesian Optimal Choice Designs," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(2), pages 279-291.
    10. John Rose & Michiel Bliemer, 2013. "Sample size requirements for stated choice experiments," Transportation, Springer, vol. 40(5), pages 1021-1041, September.
    11. Aiste Ruseckaite & Peter Goos & Dennis Fok, 2017. "Bayesian D-optimal choice designs for mixtures," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(2), pages 363-386, February.
    12. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387, January.
    13. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    14. Angelis, L. & Bora-Senta, E. & Moyssiadis, C., 2001. "Optimal exact experimental designs with correlated errors through a simulated annealing algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 37(3), pages 275-296, September.
    15. Yu, Jie & Goos, Peter & Vandebroek, Martina, 2010. "Comparing different sampling schemes for approximating the integrals involved in the efficient design of stated choice experiments," Transportation Research Part B: Methodological, Elsevier, vol. 44(10), pages 1268-1289, December.
    16. Roselinde Kessels & Bradley Jones & Peter Goos & Martina Vandebroek, 2011. "The usefulness of Bayesian optimal designs for discrete choice experiments," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(3), pages 173-188, May.
    17. Connolly, David T., 1990. "An improved annealing scheme for the QAP," European Journal of Operational Research, Elsevier, vol. 46(1), pages 93-100, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Palhazi Cuervo, Daniel & Kessels, Roselinde & Goos, Peter & Sörensen, Kenneth, 2016. "An integrated algorithm for the optimal design of stated choice experiments with partial profiles," Transportation Research Part B: Methodological, Elsevier, vol. 93(PA), pages 648-669.
    2. Richard Yao & Riccardo Scarpa & John Rose & James Turner, 2015. "Experimental Design Criteria and Their Behavioural Efficiency: An Evaluation in the Field," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 62(3), pages 433-455, November.
    3. Frischknecht, Bart D. & Eckert, Christine & Geweke, John & Louviere, Jordan J., 2014. "A simple method for estimating preference parameters for individuals," International Journal of Research in Marketing, Elsevier, vol. 31(1), pages 35-48.
    4. Kessels, Roselinde & Jones, Bradley & Goos, Peter, 2019. "Using Firth's method for model estimation and market segmentation based on choice data," Journal of choice modelling, Elsevier, vol. 31(C), pages 1-21.
    5. Verhetsel, Ann & Kessels, Roselinde & Goos, Peter & Zijlstra, Toon & Blomme, Nele & Cant, Jeroen, 2015. "Location of logistics companies: a stated preference study to disentangle the impact of accessibility," Journal of Transport Geography, Elsevier, vol. 42(C), pages 110-121.
    6. Zijlstra, Toon & Goos, Peter & Verhetsel, Ann, 2019. "A mixture-amount stated preference study on the mobility budget," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 230-246.
    7. Yu, Jie & Goos, Peter & Vandebroek, Martina, 2011. "Individually adapted sequential Bayesian conjoint-choice designs in the presence of consumer heterogeneity," International Journal of Research in Marketing, Elsevier, vol. 28(4), pages 378-388.
    8. Haghani, Milad & Sarvi, Majid, 2018. "Hypothetical bias and decision-rule effect in modelling discrete directional choices," Transportation Research Part A: Policy and Practice, Elsevier, vol. 116(C), pages 361-388.
    9. Greiner, Romy & Bliemer, Michiel & Ballweg, Julie, 2014. "Design considerations of a choice experiment to estimate likely participation by north Australian pastoralists in contractual biodiversity conservation," Journal of choice modelling, Elsevier, vol. 10(C), pages 34-45.
    10. van Cranenburgh, Sander & Collins, Andrew T., 2019. "New software tools for creating stated choice experimental designs efficient for regret minimisation and utility maximisation decision rules," Journal of choice modelling, Elsevier, vol. 31(C), pages 104-123.
    11. Kessels, Roselinde, 2016. "Homogeneous versus heterogeneous designs for stated choice experiments: Ain't homogeneous designs all bad?," Journal of choice modelling, Elsevier, vol. 21(C), pages 2-9.
    12. Aiste Ruseckaite & Peter Goos & Dennis Fok, 2017. "Bayesian D-optimal choice designs for mixtures," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(2), pages 363-386, February.
    13. Großmann, Heiko, 2019. "A practical approach to designing partial-profile choice experiments with two alternatives for estimating main effects and interactions of many two-level attributes," Journal of choice modelling, Elsevier, vol. 32(C), pages 1-1.
    14. Jonker, Marcel F., 2024. "Level overlap and level color coding revisited: Improved attribute attendance and higher choice consistency in discrete choice experiments," Journal of choice modelling, Elsevier, vol. 52(C).
    15. John M. Rose & Michiel C.J. Bliemer, 2014. "Stated choice experimental design theory: the who, the what and the why," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 7, pages 152-177, Edward Elgar Publishing.
    16. Bliemer, Michiel C.J. & Rose, John M., 2011. "Experimental design influences on stated choice outputs: An empirical study in air travel choice," Transportation Research Part A: Policy and Practice, Elsevier, vol. 45(1), pages 63-79, January.
    17. Batarce, Marco & Muñoz, Juan Carlos & Ortúzar, Juan de Dios, 2016. "Valuing crowding in public transport: Implications for cost-benefit analysis," Transportation Research Part A: Policy and Practice, Elsevier, vol. 91(C), pages 358-378.
    18. Joan L. Walker & Yanqiao Wang & Mikkel Thorhauge & Moshe Ben-Akiva, 2018. "D-efficient or deficient? A robustness analysis of stated choice experimental designs," Theory and Decision, Springer, vol. 84(2), pages 215-238, March.
    19. Larranaga, Ana Margarita & Arellana, Julian & Senna, Luiz Afonso, 2017. "Encouraging intermodality: A stated preference analysis of freight mode choice in Rio Grande do Sul," Transportation Research Part A: Policy and Practice, Elsevier, vol. 102(C), pages 202-211.
    20. Danaf, Mazen & Atasoy, Bilge & de Azevedo, Carlos Lima & Ding-Mastera, Jing & Abou-Zeid, Maya & Cox, Nathaniel & Zhao, Fang & Ben-Akiva, Moshe, 2019. "Context-aware stated preferences with smartphone-based travel surveys," Journal of choice modelling, Elsevier, vol. 31(C), pages 35-50.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:55:y:2025:i:c:s1755534525000144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.