IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v058i08.html
   My bibliography  Save this article

%HPGLIMMIX: A High-Performance SAS Macro for GLMM Estimation

Author

Listed:
  • Xie, Liang
  • Madden, Laurence V.

Abstract

Generalized linear mixed models (GLMMs) comprise a class of widely used statistical tools for data analysis with fixed and random effects when the response variable has a conditional distribution in the exponential family. GLMM analysis also has a close relationship with actuarial credibility theory. While readily available programs such as the GLIMMIX procedure in SAS and the lme4 package in R are powerful tools for using this class of models, these progarms are not able to handle models with thousands of levels of fixed and random effects. By using sparse-matrix and other high performance techniques, procedures such as HPMIXED in SAS can easily fit models with thousands of factor levels, but only for normally distributed response variables. In this paper, we present the %HPGLIMMIX SAS macro that fits GLMMs with large number of sparsely populated design matrices using the doubly-iterative linearization (pseudo-likelihood) method, in which the sparse-matrix-based HPMIXED is used for the inner iterations with the pseudo-variable constructed from the inverse-link function and the chosen model. Although the macro does not have the full functionality of the GLIMMIX procedure, time and memory savings can be large with the new macro. In applications in which design matrices contain many zeros and there are hundreds or thousands of factor levels, models can be fitted without exhausting computer memory, and 90% or better reduction in running time can be observed. Examples with a Poisson, binomial, and gamma conditional distribution are presented to demonstrate the usage and efficiency of this macro.

Suggested Citation

  • Xie, Liang & Madden, Laurence V., 2014. "%HPGLIMMIX: A High-Performance SAS Macro for GLMM Estimation," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i08).
    • Handle: RePEc:jss:jstsof:v:058:i08
    DOI: http://hdl.handle.net/10.18637/jss.v058.i08
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v058i08/v58i08.pdf
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v058i08/HPGLIMMIX.sas
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v058i08/v58i08.sas
    Download Restriction: no
    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v058.i08?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Antonio, Katrien & Beirlant, Jan, 2007. "Actuarial statistics with generalized linear mixed models," Insurance: Mathematics and Economics, Elsevier, vol. 40(1), pages 58-76, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shengkun Xie & Chong Gan, 2023. "Estimating Territory Risk Relativity Using Generalized Linear Mixed Models and Fuzzy C -Means Clustering," Risks, MDPI, vol. 11(6), pages 1-20, May.
    2. Pitselis, Georgios & Grigoriadou, Vasiliki & Badounas, Ioannis, 2015. "Robust loss reserving in a log-linear model," Insurance: Mathematics and Economics, Elsevier, vol. 64(C), pages 14-27.
    3. Pigeon, Mathieu & Henry de Frahan, Bruno & Denuit, Michel, 2014. "Evaluation of the EU Proposed Farm Income Stabilisation Tool by Skew Normal Linear Mixed Models," LIDAM Discussion Papers ISBA 2014003, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. Michal Gerthofer & Michal Pešta, 2017. "Stochastic Claims Reserving in Insurance Using Random Effects," Prague Economic Papers, Prague University of Economics and Business, vol. 2017(5), pages 542-560.
    5. Baumgartner, Carolin & Gruber, Lutz F. & Czado, Claudia, 2015. "Bayesian total loss estimation using shared random effects," Insurance: Mathematics and Economics, Elsevier, vol. 62(C), pages 194-201.
    6. Alicja Wolny-Dominiak & Tomasz Żądło, 2021. "The Measures of Accuracy of Claim Frequency Credibility Predictor," Sustainability, MDPI, vol. 13(21), pages 1-13, October.
    7. Paulsen, Jostein & Lunde, Astrid & Skaug, Hans Julius, 2008. "Fitting mixed-effects models when data are left truncated," Insurance: Mathematics and Economics, Elsevier, vol. 43(1), pages 121-133, August.
    8. Eguchi, Shoichi, 2018. "Model comparison for generalized linear models with dependent observations," Econometrics and Statistics, Elsevier, vol. 5(C), pages 171-188.
    9. Meng Sun & Yi Lu, 2022. "A Generalized Linear Mixed Model for Data Breaches and Its Application in Cyber Insurance," Risks, MDPI, vol. 10(12), pages 1-23, November.
    10. Pešta, Michal & Okhrin, Ostap, 2014. "Conditional least squares and copulae in claims reserving for a single line of business," Insurance: Mathematics and Economics, Elsevier, vol. 56(C), pages 28-37.
    11. Andreas Bayerstadler & Franz Benstetter & Christian Heumann & Fabian Winter, 2014. "A predictive modeling approach to increasing the economic effectiveness of disease management programs," Health Care Management Science, Springer, vol. 17(3), pages 284-301, September.
    12. Norbert Paska, 2018. "Zastosowanie modeli ZINB GLMM z efektem losowym agenta w taryfikacji ubezpieczeń majątkowych," Collegium of Economic Analysis Annals, Warsaw School of Economics, Collegium of Economic Analysis, issue 53, pages 63-76.
    13. Katrien Antonio & Jan Beirlant, 2008. "Issues in Claims Reserving and Credibility: A Semiparametric Approach With Mixed Models," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 75(3), pages 643-676, September.
    14. Gigante, Patrizia & Picech, Liviana & Sigalotti, Luciano, 2013. "Claims reserving in the hierarchical generalized linear model framework," Insurance: Mathematics and Economics, Elsevier, vol. 52(2), pages 381-390.
    15. Mahani, Alireza S. & Sharabiani, Mansour T.A., 2015. "SIMD parallel MCMC sampling with applications for big-data Bayesian analytics," Computational Statistics & Data Analysis, Elsevier, vol. 88(C), pages 75-99.
    16. Fabienne Comte & Celine Duval & Valentine Genon-Catalot & Johanna Kappus, 2015. "Estimation of the Jump Size Density in a Mixed Compound Poisson Process," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 1023-1044, December.
    17. Michal Gerthofer & Michal Pešta, . "Stochastic Claims Reserving in Insurance Using Random Effects," Prague Economic Papers, University of Economics, Prague, vol. 0, pages 1-19.
    18. Dietsch, Michel & Petey, Joël, 2015. "The credit-risk implications of home ownership promotion: The effects of public subsidies and adjustable-rate loans," Journal of Housing Economics, Elsevier, vol. 28(C), pages 103-120.
    19. Dornheim, Harald & Brazauskas, Vytaras, 2011. "Robust-efficient credibility models with heavy-tailed claims: A mixed linear models perspective," Insurance: Mathematics and Economics, Elsevier, vol. 48(1), pages 72-84, January.
    20. Meyricke, Ramona & Sherris, Michael, 2013. "The determinants of mortality heterogeneity and implications for pricing annuities," Insurance: Mathematics and Economics, Elsevier, vol. 53(2), pages 379-387.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:058:i08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.