IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.13851.html

Scalable likelihood-based inference for limited dependent variable models

Author

Listed:
  • David T. Frazier
  • Ruben Loaiza-Maya
  • Didier Nibbering

Abstract

Limited dependent variable models are central to empirical economics, but likelihood-based inference is infeasible when likelihoods involve high-dimensional integration over latent variables. This paper proposes Stochastically Estimated Gradient Ascent (SEGA), a scalable estimation approach for limited dependent variable models. Using Fisher's identity, SEGA replaces the intractable likelihood score with an unbiased augmented data score evaluated at a single conditional draw of the latent variables, and embeds this score in a stochastic gradient ascent algorithm. With sufficiently many iterations, we show that SEGA is asymptotically equivalent to the infeasible maximum likelihood estimator. A variance estimator based on Fisher's and Louis' identities is proposed that allows inference to proceed in the usual manner. Applications to brand choice and household demand demonstrate the usefulness of SEGA for conducting inference in large-scale discrete choice and censored demand models.

Suggested Citation

  • David T. Frazier & Ruben Loaiza-Maya & Didier Nibbering, 2026. "Scalable likelihood-based inference for limited dependent variable models," Papers 2608.13851, arXiv.org, revised Oct 2026.
  • Handle: RePEc:arx:papers:2608.13851
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.13851
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rubén Loaiza-Maya & Didier Nibbering, 2022. "Scalable Bayesian Estimation in the Multinomial Probit Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1678-1690, October.
    2. Debopam Bhattacharya & Pascaline Dupas & Shin Kanaya, 2024. "Demand and Welfare Analysis in Discrete Choice Models with Social Interactions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(2), pages 748-784.
    3. Bolduc, Denis, 1999. "A practical technique to estimate multinomial probit models in transportation," Transportation Research Part B: Methodological, Elsevier, vol. 33(1), pages 63-79, February.
    4. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    5. Geweke, John & Keane, Michael P & Runkle, David, 1994. "Alternative Computational Approaches to Inference in the Multinomial Probit Model," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 609-632, November.
    6. Patrick Kline & Christopher R. Walters, 2016. "Evaluating Public Programs with Close Substitutes: The Case of HeadStart," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1795-1848.
    7. Stéphane Bonhomme & Thibaut Lamadon & Elena Manresa, 2022. "Discretizing Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 90(2), pages 625-643, March.
    8. Loaiza-Maya, Rubén & Nibbering, Didier & Zhu, Dan, 2024. "Hybrid unadjusted Langevin methods for high-dimensional latent variable models," Journal of Econometrics, Elsevier, vol. 241(2).
    9. Z. I. Botev, 2017. "The normal law under linear restrictions: simulation and estimation via minimax tilting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 125-148, January.
    10. Paulo Natenzon, 2019. "Random Choice and Learning," Journal of Political Economy, University of Chicago Press, vol. 127(1), pages 419-457.
    11. Vassilis A. Hajivassiliou & Daniel L. McFadden, 1998. "The Method of Simulated Scores for the Estimation of LDV Models," Econometrica, Econometric Society, vol. 66(4), pages 863-896, July.
    12. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    13. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2023. "Forecasting with a panel Tobit model," Quantitative Economics, Econometric Society, vol. 14(1), pages 117-159, January.
    14. Borsch-Supan, Axel & Hajivassiliou, Vassilis A., 1993. "Smooth unbiased multivariate probability simulators for maximum likelihood estimation of limited dependent variable models," Journal of Econometrics, Elsevier, vol. 58(3), pages 347-368, August.
    15. Krinsky, Itzhak & Robb, A Leslie, 1990. "On Approximating the Statistical Properties of Elasticities: A Correction," The Review of Economics and Statistics, MIT Press, vol. 72(1), pages 189-190, February.
    16. Kyogo Kanazawa & Daiji Kawaguchi & Hitoshi Shigeoka & Yasutora Watanabe, 2026. "AI, Skill, and Productivity: The Case of Taxi Drivers," Management Science, INFORMS, vol. 72(2), pages 1376-1388, February.
    17. Rabe-Hesketh, Sophia & Skrondal, Anders & Pickles, Andrew, 2005. "Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects," Journal of Econometrics, Elsevier, vol. 128(2), pages 301-323, October.
    18. Richard Gates, 2006. "A Mata Geweke–Hajivassiliou–Keane multivariate normal simulator," Stata Journal, StataCorp LLC, vol. 6(2), pages 190-213, June.
    19. Ariel Pakes & Jack R. Porter & Mark Shepard & Sophie Calder-Wang, 2021. "Unobserved Heterogeneity, State Dependence, and Health Plan Choices," NBER Working Papers 29025, National Bureau of Economic Research, Inc.
    20. Rubén Loaiza-Maya & Didier Nibbering, 2023. "Fast Variational Bayes Methods for Multinomial Probit Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1352-1363, October.
    21. Shakeeb Khan & Fu Ouyang & Elie Tamer, 2021. "Inference on semiparametric multinomial response models," Quantitative Economics, Econometric Society, vol. 12(3), pages 743-777, July.
    22. Hajivassiliou, Vassilis & McFadden, Daniel & Ruud, Paul, 1996. "Simulation of multivariate normal rectangle probabilities and their derivatives theoretical and computational results," Journal of Econometrics, Elsevier, vol. 72(1-2), pages 85-134.
    23. John Geweke & Gautam Gowrisankaran & Robert J. Town, 2003. "Bayesian Inference for Hospital Quality in a Selection Model," Econometrica, Econometric Society, vol. 71(4), pages 1215-1238, July.
    24. Paetz, Friederike & Steiner, Winfried J., 2018. "Utility independence versus IIA property in independent probit models," Journal of choice modelling, Elsevier, vol. 26(C), pages 41-47.
    25. Bunch, David S., 1991. "Estimability in the Multinomial Probit Model," University of California Transportation Center, Working Papers qt1gf1t128, University of California Transportation Center.
    26. Bunch, David S., 1991. "Estimability in the multinomial probit model," Transportation Research Part B: Methodological, Elsevier, vol. 25(1), pages 1-12, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ziegler, Andreas, 2001. "Simulated z-tests in multinomial probit models," ZEW Discussion Papers 01-53, ZEW - Leibniz Centre for European Economic Research.
    2. David Roodman, 2009. "Estimating Fully Observed Recursive Mixed-Process Models with cmp," Working Papers 168, Center for Global Development.
    3. GRAMMIG, Joachim & HUJER, Reinhard & SCHEIDLER, Michael, 2001. "The econometrics of airline network management," LIDAM Discussion Papers CORE 2001055, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Ziegler Andreas, 2010. "Z-Tests in Multinomial Probit Models under Simulated Maximum Likelihood Estimation: Some Small Sample Properties," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 230(5), pages 630-652, October.
    5. David Roodman, 2011. "Fitting fully observed recursive mixed-process models with cmp," Stata Journal, StataCorp LLC, vol. 11(2), pages 159-206, June.
    6. Kerem Tuzcuoglu, 2019. "Composite Likelihood Estimation of an Autoregressive Panel Probit Model with Random Effects," Staff Working Papers 19-16, Bank of Canada.
    7. Maruyama, Shiko, 2014. "Estimation of finite sequential games," Journal of Econometrics, Elsevier, vol. 178(2), pages 716-726.
    8. Daziano, Ricardo A., 2015. "Inference on mode preferences, vehicle purchases, and the energy paradox using a Bayesian structural choice model," Transportation Research Part B: Methodological, Elsevier, vol. 76(C), pages 1-26.
    9. González, M. & Minguez, R., 2005. "The Method Of Simulated Maximum Likelihood For The Estimaton Of Dynamic Ordered Probit: An Application To Country-Risk For Non-Developed Countries," International Journal of Applied Econometrics and Quantitative Studies, Euro-American Association of Economic Development, vol. 2(3), pages 99-133.
    10. Rennings, Klaus & Ziegler, Andreas & Zwick, Thomas, 2001. "Employment changes in environmentally innovative firms," ZEW Discussion Papers 01-46, ZEW - Leibniz Centre for European Economic Research.
    11. Tobias Müller & Stefan Boes, 2020. "Disability insurance benefits and labor supply decisions: evidence from a discontinuity in benefit awards," Empirical Economics, Springer, vol. 58(5), pages 2513-2544, May.
    12. W. Kuiper & Anton Cozijnsen, 2011. "The Performance of German Firms in the Business-Related Service Sectors Revisited: Differential Evolution Markov Chain Estimation of the Multinomial Probit Model," Computational Economics, Springer;Society for Computational Economics, vol. 37(4), pages 331-362, April.
    13. Rinus Haaijer & Michel Wedel & Marco Vriens & Tom Wansbeek, 1998. "Utility Covariances and Context Effects in Conjoint MNP Models," Marketing Science, INFORMS, vol. 17(3), pages 236-252.
    14. Andreas Ziegler, 2007. "Simulated classical tests in multinomial probit models," Statistical Papers, Springer, vol. 48(4), pages 655-681, October.
    15. Klaus Rennings & Andreas Ziegler & Thomas Zwick, 2004. "The effect of environmental innovations on employment changes: an econometric analysis," Business Strategy and the Environment, Wiley Blackwell, vol. 13(6), pages 374-387, November.
    16. Müller, Tobias & Boes, Stefan, 2016. "Disability Insurance Benefits and Labor Supply Choices: Evidence from a Discontinuity in Benefit Awards," MPRA Paper 70957, University Library of Munich, Germany.
    17. Haaijer, Marinus E., 1996. "Predictions in conjoint choice experiments : the x-factor probit model," Research Report 96B22, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    18. Yai, Tetsuo & Iwakura, Seiji & Morichi, Shigeru, 1997. "Multinomial probit with structured covariance for route choice behavior," Transportation Research Part B: Methodological, Elsevier, vol. 31(3), pages 195-207, June.
    19. Ziegler, Andreas, 2002. "Simulated Classical Tests in the Multiperiod Multinomial Probit Model," ZEW Discussion Papers 02-38, ZEW - Leibniz Centre for European Economic Research.
    20. Geweke, John F. & Keane, Michael P. & Runkle, David E., 1997. "Statistical inference in the multinomial multiperiod probit model," Journal of Econometrics, Elsevier, vol. 80(1), pages 125-165, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.13851. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.