IDEAS home Printed from https://ideas.repec.org/a/eee/transb/v46y2012i2p321-332.html
   My bibliography  Save this article

A Monte Carlo experiment to analyze the curse of dimensionality in estimating random coefficients models with a full variance–covariance matrix

Author

Listed:
  • Cherchi, Elisabetta
  • Guevara, Cristian Angelo

Abstract

When the dimension of the vector of estimated parameters increases, simulation based methods become impractical, because the number of draws required for estimation grows exponentially with the number of parameters. In simulation methods, the lack of empirical identification when the number of parameters increases is usually known as the “curse of dimensionality” in the simulation methods. We investigate this problem in the case of the random coefficients Logit model. We compare the traditional Maximum Simulated Likelihood (MSL) method with two alternative estimation methods: the Expectation–Maximization (EM) and the Laplace Approximation (HH) methods that do not require simulation. We use Monte Carlo experimentation to investigate systematically the performance of the methods under different circumstances, including different numbers of variables, sample sizes and structures of the variance–covariance matrix. Results show that indeed MSL suffers from lack of empirical identification as the dimensionality grows while EM deals much better with this estimation problem. On the other hand, the HH method, although not being simulation-based, showed poor performance with large dimensions, principally because of the necessity of inverting large matrices. The results also show that when MSL is empirically identified this method seems superior to EM and HH in terms of ability to recover the true parameters and estimation time.

Suggested Citation

  • Cherchi, Elisabetta & Guevara, Cristian Angelo, 2012. "A Monte Carlo experiment to analyze the curse of dimensionality in estimating random coefficients models with a full variance–covariance matrix," Transportation Research Part B: Methodological, Elsevier, vol. 46(2), pages 321-332.
  • Handle: RePEc:eee:transb:v:46:y:2012:i:2:p:321-332
    DOI: 10.1016/j.trb.2011.10.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0191261511001469
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.trb.2011.10.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sándor, Zsolt & Train, Kenneth, 2004. "Quasi-random simulation of discrete choice models," Transportation Research Part B: Methodological, Elsevier, vol. 38(4), pages 313-327, May.
    2. Elisabetta Cherchi & Juan Dios Ortúzar, 2008. "Empirical Identification in the Mixed Logit Model: Analysing the Effect of Data Richness," Networks and Spatial Economics, Springer, vol. 8(2), pages 109-124, September.
    3. Chiou, Lesley & Walker, Joan L., 2007. "Masking identification of discrete choice models under simulation methods," Journal of Econometrics, Elsevier, vol. 141(2), pages 683-703, December.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. Borsch-Supan, Axel & Hajivassiliou, Vassilis A., 1993. "Smooth unbiased multivariate probability simulators for maximum likelihood estimation of limited dependent variable models," Journal of Econometrics, Elsevier, vol. 58(3), pages 347-368, August.
    6. Williams, H. C. W. L. & Ortuzar, J. D., 1982. "Behavioural theories of dispersion and the mis-specification of travel demand models," Transportation Research Part B: Methodological, Elsevier, vol. 16(3), pages 167-219, June.
    7. Erik Meijer & Jan Rouwendal, 2006. "Measuring welfare effects in models with random coefficients," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(2), pages 227-244.
    8. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    9. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    10. Bhat, Chandra R., 2001. "Quasi-random maximum simulated likelihood estimation of the mixed multinomial logit model," Transportation Research Part B: Methodological, Elsevier, vol. 35(7), pages 677-693, August.
    11. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, January.
    12. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    13. Bhat, Chandra R., 2011. "The maximum approximate composite marginal likelihood (MACML) estimation of multinomial probit-based unordered response choice models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 923-939, August.
    14. Hess, Stephane & Train, Kenneth E. & Polak, John W., 2006. "On the use of a Modified Latin Hypercube Sampling (MLHS) method in the estimation of a Mixed Logit Model for vehicle choice," Transportation Research Part B: Methodological, Elsevier, vol. 40(2), pages 147-163, February.
    15. Bhat, Chandra R., 2003. "Simulation estimation of mixed discrete choice models using randomized and scrambled Halton sequences," Transportation Research Part B: Methodological, Elsevier, vol. 37(9), pages 837-855, November.
    16. Matthew C. Harding & Jerry Hausman, 2007. "Using A Laplace Approximation To Estimate The Random Coefficients Logit Model By Nonlinear Least Squares," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1311-1328, November.
    17. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    18. Bhat, Chandra R. & Sidharthan, Raghuprasad, 2011. "A simulation evaluation of the maximum approximate composite marginal likelihood (MACML) estimator for mixed multinomial probit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 940-953, August.
    19. María Yáñez & Elisabetta Cherchi & Benjamin Heydecker & Juan de Dios Ortúzar, 2011. "On the Treatment of Repeated Observations in Panel Data: Efficiency of Mixed Logit Parameter Estimates," Networks and Spatial Economics, Springer, vol. 11(3), pages 393-418, September.
    20. J. S. Cramer, 2007. "Robustness of Logit Analysis: Unobserved Heterogeneity and Mis‐specified Disturbances," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 69(4), pages 545-555, August.
    21. Chandra R. Bhat, 1997. "An Endogenous Segmentation Mode Choice Model with an Application to Intercity Travel," Transportation Science, INFORMS, vol. 31(1), pages 34-48, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vij, Akshay & Krueger, Rico, 2017. "Random taste heterogeneity in discrete choice models: Flexible nonparametric finite mixture distributions," Transportation Research Part B: Methodological, Elsevier, vol. 106(C), pages 76-101.
    2. Keemin Sohn, 2017. "An Expectation-Maximization Algorithm to Estimate the Integrated Choice and Latent Variable Model," Transportation Science, INFORMS, vol. 51(3), pages 946-967, August.
    3. Arkoudi, Ioanna & Krueger, Rico & Azevedo, Carlos Lima & Pereira, Francisco C., 2023. "Combining discrete choice models and neural networks through embeddings: Formulation, interpretability and performance," Transportation Research Part B: Methodological, Elsevier, vol. 175(C).
    4. Yuan, Yuan & You, Wen & Boyle, Kevin J., 2015. "A guide to heterogeneity features captured by parametric and nonparametric mixing distributions for the mixed logit model," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205733, Agricultural and Applied Economics Association.
    5. Akshay Vij & Rico Krueger, 2018. "Random taste heterogeneity in discrete choice models: Flexible nonparametric finite mixture distributions," Papers 1802.02299, arXiv.org.
    6. Ioanna Arkoudi & Carlos Lima Azevedo & Francisco C. Pereira, 2021. "Combining Discrete Choice Models and Neural Networks through Embeddings: Formulation, Interpretability and Performance," Papers 2109.12042, arXiv.org, revised Sep 2021.
    7. Chenfeng Xiong & Xiqun Chen & Xiang He & Wei Guo & Lei Zhang, 2015. "The analysis of dynamic travel mode choice: a heterogeneous hidden Markov approach," Transportation, Springer, vol. 42(6), pages 985-1002, November.
    8. Youssef M Aboutaleb & Mazen Danaf & Yifei Xie & Moshe Ben-Akiva, 2020. "Sparse Covariance Estimation in Logit Mixture Models," Papers 2001.05034, arXiv.org.
    9. Guevara, C. Angelo & Ben-Akiva, Moshe E., 2013. "Sampling of alternatives in Logit Mixture models," Transportation Research Part B: Methodological, Elsevier, vol. 58(C), pages 185-198.
    10. Guevara, C. Angelo & Tang, Yue & Gao, Song, 2018. "The initial condition problem with complete history dependency in learning models for travel choices," Transportation Research Part B: Methodological, Elsevier, vol. 117(PB), pages 850-861.
    11. Bansal, Prateek & Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H., 2020. "Bayesian estimation of mixed multinomial logit models: Advances and simulation-based evaluations," Transportation Research Part B: Methodological, Elsevier, vol. 131(C), pages 124-142.
    12. Guevara, C. Angelo, 2015. "Critical assessment of five methods to correct for endogeneity in discrete-choice models," Transportation Research Part A: Policy and Practice, Elsevier, vol. 82(C), pages 240-254.
    13. Kim, Seheon & Rasouli, Soora, 2022. "The influence of latent lifestyle on acceptance of Mobility-as-a-Service (MaaS): A hierarchical latent variable and latent class approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 159(C), pages 304-319.
    14. Sobhani, Anae & Eluru, Naveen & Faghih-Imani, Ahmadreza, 2013. "A latent segmentation based multiple discrete continuous extreme value model," Transportation Research Part B: Methodological, Elsevier, vol. 58(C), pages 154-169.
    15. Bansal, Prateek & Daziano, Ricardo A & Guerra, Erick, 2018. "Minorization-Maximization (MM) algorithms for semiparametric logit models: Bottlenecks, extensions, and comparisons," Transportation Research Part B: Methodological, Elsevier, vol. 115(C), pages 17-40.
    16. Hess, Stephane & Train, Kenneth E., 2011. "Recovery of inter- and intra-personal heterogeneity using mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 973-990, August.
    17. Calastri, Chiara & Hess, Stephane & Daly, Andrew & Carrasco, Juan Antonio & Choudhury, Charisma, 2018. "Modelling the loss and retention of contacts in social networks: The role of dyad-level heterogeneity and tie strength," Journal of choice modelling, Elsevier, vol. 29(C), pages 63-77.
    18. Prateek Bansal & Rico Krueger & Michel Bierlaire & Ricardo A. Daziano & Taha H. Rashidi, 2019. "Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations," Papers 1904.03647, arXiv.org, revised Dec 2019.
    19. Chae, Dasol & Jung, Jaeyoung & Sohn, Keemin, 2018. "Facilitating an expectation-maximization (EM) algorithm to solve an integrated choice and latent variable (ICLV) model with fully correlated latent variables," Journal of choice modelling, Elsevier, vol. 26(C), pages 64-79.
    20. Keya, Nowreen & Anowar, Sabreena & Bhowmik, Tanmoy & Eluru, Naveen, 2021. "A joint framework for modeling freight mode and destination choice: Application to the US commodity flow survey data," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 146(C).
    21. James, Jonathan, 2018. "Estimation of factor structured covariance mixed logit models," Journal of choice modelling, Elsevier, vol. 28(C), pages 41-55.
    22. Mariel, Petr & Artabe, Alaitz, 2020. "Interpreting correlated random parameters in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Czajkowski, Mikołaj & Budziński, Wiktor, 2019. "Simulation error in maximum likelihood estimation of discrete choice models," Journal of choice modelling, Elsevier, vol. 31(C), pages 73-85.
    2. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    3. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    4. Heiss, Florian & Winschel, Viktor, 2008. "Likelihood approximation by numerical integration on sparse grids," Journal of Econometrics, Elsevier, vol. 144(1), pages 62-80, May.
    5. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    6. Staus, Alexander, 2008. "Standard and Shuffled Halton Sequences in a Mixed Logit Model," Working Papers 93856, Universitaet Hohenheim, Institute of Agricultural Policy and Agricultural Markets.
    7. Tinessa, Fiore & Marzano, Vittorio & Papola, Andrea, 2020. "Mixing distributions of tastes with a Combination of Nested Logit (CoNL) kernel: Formulation and performance analysis," Transportation Research Part B: Methodological, Elsevier, vol. 141(C), pages 1-23.
    8. Marco A. Palma & Dmitry V. Vedenov & David Bessler, 2020. "The order of variables, simulation noise, and accuracy of mixed logit estimates," Empirical Economics, Springer, vol. 58(5), pages 2049-2083, May.
    9. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    10. Xuemei Fu & Zhicai Juan, 2017. "Estimation of multinomial probit-kernel integrated choice and latent variable model: comparison on one sequential and two simultaneous approaches," Transportation, Springer, vol. 44(1), pages 91-116, January.
    11. Xiong, Yingge & Mannering, Fred L., 2013. "The heterogeneous effects of guardian supervision on adolescent driver-injury severities: A finite-mixture random-parameters approach," Transportation Research Part B: Methodological, Elsevier, vol. 49(C), pages 39-54.
    12. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Sustainability Indicators and Environmental Valuation Working Papers 12224, Fondazione Eni Enrico Mattei (FEEM).
    13. Heiss, Florian & Winschel, Viktor, 2006. "Estimation with Numerical Integration on Sparse Grids," Discussion Papers in Economics 916, University of Munich, Department of Economics.
    14. Campbell, Danny, 2007. "Combining mixed logit models and random effects models to identify the determinants of willingness to pay for rural landscape improvements," 81st Annual Conference, April 2-4, 2007, Reading University, UK 7975, Agricultural Economics Society.
    15. Kalouptsidis, N. & Psaraki, V., 2010. "Approximations of choice probabilities in mixed logit models," European Journal of Operational Research, Elsevier, vol. 200(2), pages 529-535, January.
    16. Angel Bujosa & Antoni Riera & Robert Hicks, 2010. "Combining Discrete and Continuous Representations of Preference Heterogeneity: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(4), pages 477-493, December.
    17. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Using Discrete Choice Experiments to Derive Individual-Specific WTP Estimates for Landscape Improvements under Agri-Environmental Schemes: Evidence from the Rural Environment Protection Scheme in Irel," Sustainability Indicators and Environmental Valuation Working Papers 12220, Fondazione Eni Enrico Mattei (FEEM).
    18. Krueger, Rico & Bierlaire, Michel & Daziano, Ricardo A. & Rashidi, Taha H. & Bansal, Prateek, 2021. "Evaluating the predictive abilities of mixed logit models with unobserved inter- and intra-individual heterogeneity," Journal of choice modelling, Elsevier, vol. 41(C).
    19. Junyi Shen, 2009. "Latent class model or mixed logit model? A comparison by transport mode choice data," Applied Economics, Taylor & Francis Journals, vol. 41(22), pages 2915-2924.
    20. Hess, Stephane & Train, Kenneth E., 2011. "Recovery of inter- and intra-personal heterogeneity using mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 973-990, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transb:v:46:y:2012:i:2:p:321-332. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/548/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.