IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0106136.html
   My bibliography  Save this article

Obtaining Reliable Likelihood Ratio Tests from Simulated Likelihood Functions

Author

Listed:
  • Laura Mørch Andersen

Abstract

Mixed models: Models allowing for continuous heterogeneity by assuming that value of one or more parameters follow a specified distribution have become increasingly popular. This is known as ‘mixing’ parameters, and it is standard practice by researchers - and the default option in many statistical programs - to base test statistics for mixed models on simulations using asymmetric draws (e.g. Halton draws). Problem 1: Inconsistent LR tests due to asymmetric draws:: This paper shows that when the estimated likelihood functions depend on standard deviations of mixed parameters this practice is very likely to cause misleading test results for the number of draws usually used today. The paper illustrates that increasing the number of draws is a very inefficient solution strategy requiring very large numbers of draws to ensure against misleading test statistics. The main conclusion of this paper is that the problem can be solved completely by using fully antithetic draws, and that using one dimensionally antithetic draws is not enough to solve the problem. Problem 2: Maintaining the correct dimensions when reducing the mixing distribution:: A second point of the paper is that even when fully antithetic draws are used, models reducing the dimension of the mixing distribution must replicate the relevant dimensions of the quasi-random draws in the simulation of the restricted likelihood. Again this is not standard in research or statistical programs. The paper therefore recommends using fully antithetic draws replicating the relevant dimensions of the quasi-random draws in the simulation of the restricted likelihood and that this should become the default option in statistical programs. JEL classification: C15; C25.

Suggested Citation

  • Laura Mørch Andersen, 2014. "Obtaining Reliable Likelihood Ratio Tests from Simulated Likelihood Functions," PLOS ONE, Public Library of Science, vol. 9(10), pages 1-12, October.
    • Handle: RePEc:plo:pone00:0106136
    DOI: 10.1371/journal.pone.0106136
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0106136
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0106136&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0106136?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. repec:cdl:econwp:qt3tb6j874 is not listed on IDEAS
    2. repec:cdl:uctcwp:qt3tb6j874 is not listed on IDEAS
    3. Geweke, John, 1996. "Monte carlo simulation and numerical integration," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 15, pages 731-800, Elsevier.
    4. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    5. Geweke, John, 1988. "Antithetic acceleration of Monte Carlo integration in Bayesian inference," Journal of Econometrics, Elsevier, vol. 38(1-2), pages 73-89.
    6. Jae Bong Chang & Jayson L. Lusk, 2011. "Mixed logit models: accuracy and software choice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 167-172, January/F.
    7. repec:cdl:uctcwp:qt1j6814b3 is not listed on IDEAS
    8. repec:cdl:econwp:qt1j6814b3 is not listed on IDEAS
    9. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-890, July.
    10. Ben-Akiva, M. & Bolduc, D. & Bradley, M., 1993. "Estimation of Travel Choice Models with Randomly Distributed Values of Time," Papers 9303, Laval - Recherche en Energie.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zijlstra, Toon & Goos, Peter & Verhetsel, Ann, 2019. "A mixture-amount stated preference study on the mobility budget," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 230-246.
    2. Czajkowski, Mikołaj & Budziński, Wiktor, 2019. "Simulation error in maximum likelihood estimation of discrete choice models," Journal of choice modelling, Elsevier, vol. 31(C), pages 73-85.
    3. Czajkowski, Mikołaj & Barczak, Anna & Budziński, Wiktor & Giergiczny, Marek & Hanley, Nick, 2016. "Preference and WTP stability for public forest management," Forest Policy and Economics, Elsevier, vol. 71(C), pages 11-22.
    4. Becker, Felix & Danaf, Mazen & Song, Xiang & Atasoy, Bilge & Ben-Akiva, Moshe, 2018. "Bayesian estimator for Logit Mixtures with inter- and intra-consumer heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 117(PA), pages 1-17.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura Mørch Andersen, 2013. "Obtaining reliable Likelihood Ratio tests from simulated likelihood functions," IFRO Working Paper 2013/1, University of Copenhagen, Department of Food and Resource Economics.
    2. William Greene, 2001. "Fixed and Random Effects in Nonlinear Models," Working Papers 01-01, New York University, Leonard N. Stern School of Business, Department of Economics.
    3. Bernard Fortin & Nicolas Jacquemet & Bruce Shearer, 2008. "Policy Analysis in Health-Services Market: Accounting for Quality and Quantity," Annals of Economics and Statistics, GENES, issue 91-92, pages 293-319.
    4. William Greene, 2004. "Convenient estimators for the panel probit model: Further results," Empirical Economics, Springer, vol. 29(1), pages 21-47, January.
    5. Amine Ouazad & Romain Rancière, 2019. "City Equilibrium With Borrowing Constraints: Structural Estimation And General Equilibrium Effects," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 60(2), pages 721-749, May.
    6. Pereira, Pedro & Ribeiro, Tiago, 2011. "The impact on broadband access to the Internet of the dual ownership of telephone and cable networks," International Journal of Industrial Organization, Elsevier, vol. 29(2), pages 283-293, March.
    7. Mogens Fosgerau & André de Palma, 2016. "Generalized entropy models," Working Papers hal-01291347, HAL.
    8. Allais, Olivier & Etilé, Fabrice & Lecocq, Sébastien, 2015. "Mandatory labels, taxes and market forces: An empirical evaluation of fat policies," Journal of Health Economics, Elsevier, vol. 43(C), pages 27-44.
    9. Arlan Brucal & Michael Roberts, 2015. "Can Energy Efficiency Standards Reduce Prices and Improve Quality? Evidence from the US Clothes Washer Market," Working Papers 2015-5, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    10. Wong, Maisy, 2010. "The Relationship between Marginal Willingness-to-Pay in the Hedonic and Discrete Choice Models," MPRA Paper 51218, University Library of Munich, Germany.
    11. van Putten, Marloes & Lijesen, Mark & Özel, Tanju & Vink, Nancy & Wevers, Harm, 2014. "Valuing the preferences for micro-generation of renewables by househoulds," Energy, Elsevier, vol. 71(C), pages 596-604.
    12. Huse, Cristian & Lucinda, Claudio & Cardoso, Andre Ribeiro, 2020. "Consumer response to energy label policies: Evidence from the Brazilian energy label program," Energy Policy, Elsevier, vol. 138(C).
    13. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    14. Rachel Griffith & Lars Nesheim & Martin O'Connell, 2018. "Income effects and the welfare consequences of tax in differentiated product oligopoly," Quantitative Economics, Econometric Society, vol. 9(1), pages 305-341, March.
    15. Lawrence Goulder, 2007. "Distributional and Efficiency Impacts of Increased U.S. Gasoline Taxes," Discussion Papers 07-009, Stanford Institute for Economic Policy Research.
    16. Caroline Dieckhoener & Harald Hecking, 2012. "Greenhouse Gas Abatement Cost Curves of the Residential Heating Market – a Microeconomic Approach," EWI Working Papers 2012-16, Energiewirtschaftliches Institut an der Universitaet zu Koeln (EWI).
    17. Céline Bonnet & Pierre Dubois, 2010. "Inference on vertical contracts between manufacturers and retailers allowing for nonlinear pricing and resale price maintenance," RAND Journal of Economics, RAND Corporation, vol. 41(1), pages 139-164, March.
    18. Peter Davis & Pasquale Schiraldi, 2014. "The flexible coefficient multinomial logit (FC-MNL) model of demand for differentiated products," RAND Journal of Economics, RAND Corporation, vol. 45(1), pages 32-63, March.
    19. Kidokoro, Yukihiro, 2016. "A micro foundation for discrete choice models with multiple categories of goods," Journal of choice modelling, Elsevier, vol. 19(C), pages 54-72.
    20. Siying Ding & Ahmad Lashkaripour & Volodymyr Lugovskyy, 2024. "A Global Perspective on the Incidence of Monopoly Distortions," CESifo Working Paper Series 11211, CESifo.

    More about this item

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0106136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.