IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1903.01690.html

ppmlhdfe: Fast Poisson Estimation with High-Dimensional Fixed Effects

Author

Listed:
  • Sergio Correia
  • Paulo Guimar~aes
  • Thomas Zylkin

Abstract

In this paper we present ppmlhdfe, a new Stata command for estimation of (pseudo) Poisson regression models with multiple high-dimensional fixed effects (HDFE). Estimation is implemented using a modified version of the iteratively reweighted least-squares (IRLS) algorithm that allows for fast estimation in the presence of HDFE. Because the code is built around the reghdfe package, it has similar syntax, supports many of the same functionalities, and benefits from reghdfe's fast convergence properties for computing high-dimensional least squares problems. Performance is further enhanced by some new techniques we introduce for accelerating HDFE-IRLS estimation specifically. ppmlhdfe also implements a novel and more robust approach to check for the existence of (pseudo) maximum likelihood estimates.

Suggested Citation

  • Sergio Correia & Paulo Guimar~aes & Thomas Zylkin, 2019. "ppmlhdfe: Fast Poisson Estimation with High-Dimensional Fixed Effects," Papers 1903.01690, arXiv.org, revised Aug 2019.
    • Handle: RePEc:arx:papers:1903.01690
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1903.01690
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sergio Correia, 2016. "reghdfe: Estimating linear models with multi-way fixed effects," 2016 Stata Conference 24, Stata Users Group.
    2. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Trends in Economic Research: An International Perspective," Kyklos, Wiley Blackwell, vol. 63(4), pages 479-494, November.
    3. John M. Abowd & Robert H. Creecy & Francis Kramarz, 2002. "Computing Person and Firm Effects Using Linked Longitudinal Employer-Employee Data," Longitudinal Employer-Household Dynamics Technical Papers 2002-06, Center for Economic Studies, U.S. Census Bureau.
    4. Thomas Cornelissen, 2008. "The Stata command felsdvreg to fit a linear model with two high-dimensional fixed effects," Stata Journal, StataCorp LLC, vol. 8(2), pages 170-189, June.
    5. Blackburn, McKinley L., 2007. "Estimating wage differentials without logarithms," Labour Economics, Elsevier, vol. 14(1), pages 73-98, January.
    6. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    7. Thomas Zylkin, 2019. "Verifying the Existence of Maximum Likelihood Estimates in Generalized Linear Models," 2019 Stata Conference 47, Stata Users Group.
    8. Sergio Correia & Paulo Guimar~aes & Thomas Zylkin, 2019. "Verifying the existence of maximum likelihood estimates for generalized linear models," Papers 1903.01633, arXiv.org, revised Sep 2025.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nilsen, Øivind Anti & Raknerud, Arvid & Skjerpen, Terje, 2011. "Using the Helmert-transformation to reduce dimensionality in a mixed model: Application to a wage equation with worker and firm heterogeneity," Discussion Paper Series in Economics 11/2011, Norwegian School of Economics, Department of Economics, revised 04 Oct 2011.
    2. Cho, Chanho & Halford, Joseph T. & Hsu, Scott & Ng, Lilian, 2016. "Do managers matter for corporate innovation?," Journal of Corporate Finance, Elsevier, vol. 36(C), pages 206-229.
    3. Ajay Bhaskarbhatla & Luis Cabral & Deepak Hegde & Thomas (T.L.P.R.) Peeters, 2017. "Human Capital, Firm Capabilities, and Innovation," Tinbergen Institute Discussion Papers 17-115/VII, Tinbergen Institute, revised 03 Mar 2020.
    4. Cornelißen Thomas & Hübler Olaf, 2011. "Unobserved Individual and Firm Heterogeneity in Wage and Job-Duration Functions: Evidence from German Linked Employer–Employee Data," German Economic Review, De Gruyter, vol. 12(4), pages 469-489, December.
    5. J. M. C. Santos Silva & Silvana Tenreyro, 2022. "The Log of Gravity at 15," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 21(3), pages 423-437, September.
    6. Michael Ewens & Matthew Rhodes-Kropf, 2015. "Is a VC Partnership Greater Than the Sum of Its Partners?," Journal of Finance, American Finance Association, vol. 70(3), pages 1081-1113, June.
    7. Swati Dhingra & Rebecca Freeman & Hanwei Huang, 2023. "The Impact of Non‐tariff Barriers on Trade and Welfare," Economica, London School of Economics and Political Science, vol. 90(357), pages 140-177, January.
    8. Samuel Nocito & Marcello Sartarelli & Francesco Sobbrio, 2021. "A Beam of Light: Media, Tourism & Economic Development," CESifo Working Paper Series 9055, CESifo.
    9. Bailey, Michael & Gupta, Abhinav & Hillenbrand, Sebastian & Kuchler, Theresa & Richmond, Robert & Stroebel, Johannes, 2021. "International trade and social connectedness," Journal of International Economics, Elsevier, vol. 129(C).
    10. Ajay Bhaskarabhatla & Luis Cabral & Deepak Hegde & Thomas Peeters, 2021. "Are Inventors or Firms the Engines of Innovation?," Management Science, INFORMS, vol. 67(6), pages 3899-3920, June.
    11. Haroon Bhorat & Morné Oosthuizen & Kezia Lilenstein & François Steenkamp, 2017. "Firm-level determinants of earnings in the formal sector of the South African labour market," WIDER Working Paper Series wp-2017-25, World Institute for Development Economic Research (UNU-WIDER).
    12. Behn, Markus & Schramm, Alexander, 2020. "The impact of G-SIB identification on bank lending: evidence from syndicated loans," Working Paper Series 2479, European Central Bank.
    13. Davidson, Carl & Heyman, Fredrik & Matusz, Steven & Sjöholm, Fredrik & Zhu, Susan Chun, 2014. "Globalization and imperfect labor market sorting," Journal of International Economics, Elsevier, vol. 94(2), pages 177-194.
    14. Yang Yao & Muyang Zhang, 2015. "Subnational leaders and economic growth: evidence from Chinese cities," Journal of Economic Growth, Springer, vol. 20(4), pages 405-436, December.
    15. Alfaro, Laura & García-Santana, Manuel & Moral-Benito, Enrique, 2021. "On the direct and indirect real effects of credit supply shocks," Journal of Financial Economics, Elsevier, vol. 139(3), pages 895-921.
    16. Robert W. Fairlie & Florian Hoffmann & Philip Oreopoulos, 2014. "A Community College Instructor Like Me: Race and Ethnicity Interactions in the Classroom," American Economic Review, American Economic Association, vol. 104(8), pages 2567-2591, August.
    17. Ulrich Schetter, 2019. "A Structural Ranking of Economic Complexity," Growth Lab Working Papers 148, Harvard's Growth Lab.
    18. Picchio, Matteo & van Ours, Jan C., 2016. "Temporary Jobs and the Severity of Workplace Accidents," IZA Discussion Papers 10121, Institute of Labor Economics (IZA).
    19. Piekkola, Hannu, 2005. "Public Funding of R&D and Growth: Firm-level Evidence from Finland," Discussion Papers 996, The Research Institute of the Finnish Economy.
    20. Paulo Guimarães & Pedro Portugal, 2010. "A simple feasible procedure to fit models with high-dimensional fixed effects," Stata Journal, StataCorp LLC, vol. 10(4), pages 628-649, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1903.01690. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.