IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v74y2014icp110-124.html
   My bibliography  Save this article

Improved likelihood inference in generalized linear models

Author

Listed:
  • Vargas, Tiago M.
  • Ferrari, Silvia L.P.
  • Lemonte, Artur J.

Abstract

We address the issue of performing testing inference in generalized linear models when the sample size is small. This class of models provides a straightforward way of modeling normal and non-normal data and has been widely used in several practical situations. The likelihood ratio, Wald and score statistics, and the recently proposed gradient statistic provide the basis for testing inference on the parameters in these models. We focus on the small-sample case, where the reference chi-squared distribution gives a poor approximation to the true null distribution of these test statistics. We derive a general Bartlett-type correction factor in matrix notation for the gradient test which reduces the size distortion of the test, and numerically compare the proposed test with the usual likelihood ratio, Wald, score and gradient tests, and with the Bartlett-corrected likelihood ratio and score tests, and bootstrap-corrected tests. Our simulation results suggest that the corrected test we propose can be an interesting alternative to the other tests since it leads to very accurate inference even for very small samples. We also present an empirical application for illustrative purposes.11Supplementary Material presents derivation of Bartlett-type corrections to the gradient tests, and the computer code used in Section 6 (Appendix A).

Suggested Citation

  • Vargas, Tiago M. & Ferrari, Silvia L.P. & Lemonte, Artur J., 2014. "Improved likelihood inference in generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 74(C), pages 110-124.
  • Handle: RePEc:eee:csdana:v:74:y:2014:i:c:p:110-124
    DOI: 10.1016/j.csda.2013.12.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313004714
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2013.12.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Manor, Orly & Zucker, D.M.David M., 2004. "Small sample inference for the fixed effects in the mixed linear model," Computational Statistics & Data Analysis, Elsevier, vol. 46(4), pages 801-817, July.
    2. David M. Zucker & Offer Lieberman & Orly Manor, 2000. "Improved small sample inference in the mixed linear model: Bartlett correction and adjusted likelihood," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(4), pages 827-838.
    3. Bernardo M. Lagos & Pedro A. Morettin, 2004. "Improvement of the Likelihood Ratio Test Statistic in ARMA Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 25(1), pages 83-101, January.
    4. Lemonte, Artur J. & Ferrari, Silvia L.P. & Cribari-Neto, Francisco, 2010. "Improved likelihood inference in Birnbaum-Saunders regressions," Computational Statistics & Data Analysis, Elsevier, vol. 54(5), pages 1307-1316, May.
    5. Bai, Peng, 2009. "Sphericity test in a GMANOVA-MANOVA model with normal error," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2305-2312, November.
    6. van Giersbergen, Noud P.A., 2009. "Bartlett Correction In The Stable Ar(1) Model With Intercept And Trend," Econometric Theory, Cambridge University Press, vol. 25(3), pages 857-872, June.
    7. Artur Lemonte & Silvia Ferrari, 2012. "The local power of the gradient test," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(2), pages 373-381, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Diego Ramos Canterle & Fábio Mariano Bayer, 2019. "Variable dispersion beta regressions with parametric link functions," Statistical Papers, Springer, vol. 60(5), pages 1541-1567, October.
    2. Francisco M. C. Medeiros & Silvia L. P. Ferrari, 2017. "Small-sample testing inference in symmetric and log-symmetric linear regression models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 71(3), pages 200-224, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francisco M. C. Medeiros & Silvia L. P. Ferrari, 2017. "Small-sample testing inference in symmetric and log-symmetric linear regression models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 71(3), pages 200-224, August.
    2. Ito, Tsubasa & Sugasawa, Shonosuke, 2021. "Improved confidence regions in meta-analysis of diagnostic test accuracy," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    3. Ortega, Edwin M.M. & Cordeiro, Gauss M. & Lemonte, Artur J., 2012. "A log-linear regression model for the β-Birnbaum–Saunders distribution with censored data," Computational Statistics & Data Analysis, Elsevier, vol. 56(3), pages 698-718.
    4. Guanghui Min & Muhui Lin & Ying Liu & Ning Yang & Zhe Li, 2023. "Research on the Evaluation Model of School Management Quality in the Compulsory Education Stage Based on Big Data Technology," Sustainability, MDPI, vol. 15(13), pages 1-15, June.
    5. Noud P.A. van Giersbergen, 2013. "Bartlett correction in the stable second‐order autoregressive model with intercept and trend," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 67(4), pages 482-498, November.
    6. Yoshifumi Ukyo & Hisashi Noma & Kazushi Maruo & Masahiko Gosho, 2019. "Improved Small Sample Inference Methods for a Mixed-Effects Model for Repeated Measures Approach in Incomplete Longitudinal Data Analysis," Stats, MDPI, vol. 2(2), pages 1-15, March.
    7. David M. Zucker & Jonathan Denne, 2002. "Sample–Size Redetermination for Repeated Measures Studies," Biometrics, The International Biometric Society, vol. 58(3), pages 548-559, September.
    8. Lemonte, Artur J., 2013. "On the gradient statistic under model misspecification," Statistics & Probability Letters, Elsevier, vol. 83(1), pages 390-398.
    9. Lemonte, Artur J. & Ferrari, Silvia L.P., 2011. "Size and power properties of some tests in the Birnbaum-Saunders regression model," Computational Statistics & Data Analysis, Elsevier, vol. 55(2), pages 1109-1117, February.
    10. Lemonte, Artur J., 2013. "A new extended Birnbaum–Saunders regression model for lifetime modeling," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 34-50.
    11. Kunnummal Muralidharan, 2014. "Inferences on inliers in Rayleigh distribution," METRON, Springer;Sapienza Università di Roma, vol. 72(3), pages 307-315, October.
    12. McNabb, Carolyn Beth & Murayama, Kou, 2021. "Unnecessary reliance on multilevel modelling to analyse nested data in neuroscience: When a traditional summary-statistics approach suffices," OSF Preprints h4s9f, Center for Open Science.
    13. Canepa Alessandra, 2022. "Small Sample Adjustment for Hypotheses Testing on Cointegrating Vectors," Journal of Time Series Econometrics, De Gruyter, vol. 14(1), pages 51-85, January.
    14. Artur Lemonte, 2015. "On local power properties of the LR, Wald, score and gradient tests in nonlinear mixed-effects models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(5), pages 885-895, October.
    15. Felix Zimmer & Clemens Draxler & Rudolf Debelak, 2023. "Power Analysis for the Wald, LR, Score, and Gradient Tests in a Marginal Maximum Likelihood Framework: Applications in IRT," Psychometrika, Springer;The Psychometric Society, vol. 88(4), pages 1249-1298, December.
    16. Li, Ai-Ping & Xie, Feng-Chang, 2012. "Diagnostics for a class of survival regression models with heavy-tailed errors," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4204-4214.
    17. Melo, Tatiane F.N. & Ferrari, Silvia L.P. & Cribari-Neto, Francisco, 2009. "Improved testing inference in mixed linear models," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2573-2582, May.
    18. Marton Gosztonyi, 2023. "Comparative Analysis of X-Y-Z Generation Entrepreneurs in a Semi-Peripheral EU Member Country: Insights from Regularized Regression Techniques," European Research Studies Journal, European Research Studies Journal, vol. 0(4), pages 191-217.
    19. Stein, Markus Chagas & da Silva, Michel Ferreira & Duczmal, Luiz Henrique, 2014. "Alternatives to the usual likelihood ratio test in mixed linear models," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 184-197.
    20. Guolo, Annamaria & Brazzale, Alessandra R. & Salvan, Alessandra, 2006. "Improved inference on a scalar fixed effect of interest in nonlinear mixed-effects models," Computational Statistics & Data Analysis, Elsevier, vol. 51(3), pages 1602-1613, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:74:y:2014:i:c:p:110-124. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.