IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.19627.html

Total Factor Productivity and its determinants: an analysis of the relationship at firm level through unsupervised learning techniques

Author

Listed:
  • Paolo Pedotti

Abstract

The paper is related to the identification of firm's features which serve as determinants for firm's total factor productivity through unsupervised learning techniques (principal component analysis, self organizing maps, clustering). This bottom-up approach can effectively manage the problem of the heterogeneity of the firms and provides new ways to look at firms' standard classifications. Using the large sample provided by the ORBIS database, the analyses covers the years before the outbreak of Covid-19 (2015-2019) and the immediate post-Covid period (year 2020). It has been shown that in both periods, the main determinants of productivity growth are related to profitability, credit/debts measures, cost and capital efficiency, and effort and outcome of the R&D activity conducted by the firms. Finally, a linear relationship between determinants and productivity growth has been found.

Suggested Citation

  • Paolo Pedotti, 2025. "Total Factor Productivity and its determinants: an analysis of the relationship at firm level through unsupervised learning techniques," Papers 2511.19627, arXiv.org.
  • Handle: RePEc:arx:papers:2511.19627
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.19627
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:bla:ecpoli:v:29:y:2014:i:78:p:253-296 is not listed on IDEAS
    2. Giulia Faggio & Kjell G. Salvanes & John Van Reenen, 2010. "The evolution of inequality in productivity and wages: panel data evidence," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(6), pages 1919-1951, December.
    3. Emerick, Kyle & Burke, Marshall & Maue, Casey, 2020. "Productivity dispersion and persistence among the world’s most numerous firms," CEPR Discussion Papers 14553, C.E.P.R. Discussion Papers.
    4. Giovanni Dosi & Marco Grazzi & Chiara Tomasi & Alessandro Zeli, 2012. "Turbulence underneath the big calm? The micro-evidence behind Italian productivity dynamics," Small Business Economics, Springer, vol. 39(4), pages 1043-1067, November.
    5. Dan Andrews & Chiara Criscuolo & Peter N. Gal, 2016. "The Best versus the Rest: The Global Productivity Slowdown, Divergence across Firms and the Role of Public Policy," OECD Productivity Working Papers 5, OECD Publishing.
    6. Matias Covarrubias & Germán Gutiérrez & Thomas Philippon, 2020. "From Good to Bad Concentration? US Industries over the Past 30 Years," NBER Macroeconomics Annual, University of Chicago Press, vol. 34(1), pages 1-46.
    7. Crepon, B. & Duguet, E. & Mairesse, J., 1998. "Research Investment, Innovation and Productivity: An Econometric Analysis at the Firm Level," Papiers d'Economie Mathématique et Applications 98.15, Université Panthéon-Sorbonne (Paris 1).
    8. Massimo Del Gatto & Gianmarco I. P. Ottaviano & Marcello Pagnini, 2008. "Openness To Trade And Industry Cost Dispersion: Evidence From A Panel Of Italian Firms," Journal of Regional Science, Wiley Blackwell, vol. 48(1), pages 97-129, February.
    9. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    10. Daron Acemoglu & Philippe Aghion & Fabrizio Zilibotti, 2006. "Distance to Frontier, Selection, and Economic Growth," Journal of the European Economic Association, MIT Press, vol. 4(1), pages 37-74, March.
    11. Chad Syverson, 2004. "Market Structure and Productivity: A Concrete Example," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1181-1222, December.
    12. D. W. Jorgenson & Z. Griliches, 1967. "The Explanation of Productivity Change," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 34(3), pages 249-283.
    13. Malerba, Franco & Orsenigo, Luigi, 1995. "Schumpeterian Patterns of Innovation," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 47-65, February.
    14. Marc J. Melitz, 2003. "The Impact of Trade on Intra-Industry Reallocations and Aggregate Industry Productivity," Econometrica, Econometric Society, vol. 71(6), pages 1695-1725, November.
    15. Steven J. Davis & John Haltiwanger, 1992. "Gross Job Creation, Gross Job Destruction, and Employment Reallocation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 819-863.
    16. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    17. Casey C. Maue & Marshall Burke & Kyle J. Emerick, 2020. "Productivity Dispersion and Persistence Among the World's Most Numerous Firms," NBER Working Papers 26924, National Bureau of Economic Research, Inc.
    18. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    19. Dale W. Jorgenson, 1966. "The Embodiment Hypothesis," Journal of Political Economy, University of Chicago Press, vol. 74(1), pages 1-1.
    20. Marc J. Melitz & Gianmarco I. P. Ottaviano, 2008. "Market Size, Trade, and Productivity (DOI:10.111/j.1467-937x.2007.00463.x)," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 985-985.
    21. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    22. Bernard, Andrew B. & Jensen, J. Bradford & Schott, Peter K., 2006. "Trade costs, firms and productivity," Journal of Monetary Economics, Elsevier, vol. 53(5), pages 917-937, July.
    23. Dan Andrews & Federico Cingano, 2014. "Public policy and resource allocation: evidence from firms in Oecd countries [‘Joseph Schumpeter Lecture. Appropriate growth policy: a unifying framework]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 29(78), pages 253-296.
    24. Daniel A. Ackerberg & Kevin Caves & Garth Frazer, 2015. "Identification Properties of Recent Production Function Estimators," Econometrica, Econometric Society, vol. 83, pages 2411-2451, November.
    25. Marc J. Melitz & Giancarlo I. P. Ottaviano, 2021. "Market Size, Trade, and Productivity," World Scientific Book Chapters, in: Firms and Workers in a Globalized World Larger Markets, Tougher Competition, chapter 4, pages 87-108, World Scientific Publishing Co. Pte. Ltd..
    26. Romain Duval & Gee Hee Hong & Yannick Timmer & Philip Strahan, 2020. "Financial Frictions and the Great Productivity Slowdown," The Review of Financial Studies, Society for Financial Studies, vol. 33(2), pages 475-503.
    27. Cohen, Wesley M & Klepper, Steven, 1996. "Firm Size and the Nature of Innovation within Industries: The Case of Process and Product R&D," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 232-243, May.
    28. German Gutierrez & Thomas Philippon, 2023. "How European Markets Became Free: A Study of Institutional Drift," Journal of the European Economic Association, European Economic Association, vol. 21(1), pages 251-292.
    29. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    30. Pieri, Fabio & Vecchi, Michela & Venturini, Francesco, 2018. "Modelling the joint impact of R&D and ICT on productivity: A frontier analysis approach," Research Policy, Elsevier, vol. 47(9), pages 1842-1852.
    31. Ryan Decker & John Haltiwanger & Ron Jarmin & Javier Miranda, 2014. "The Role of Entrepreneurship in US Job Creation and Economic Dynamism," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 3-24, Summer.
    32. Jan De Loecker & Jan Eeckhout & Gabriel Unger, 2020. "The Rise of Market Power and the Macroeconomic Implications [“Econometric Tools for Analyzing Market Outcomes”]," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(2), pages 561-644.
    33. Pavitt, Keith, 1984. "Sectoral patterns of technical change: Towards a taxonomy and a theory," Research Policy, Elsevier, vol. 13(6), pages 343-373, December.
    34. Gabriele Rovigatti & Vincenzo Mollisi, 2018. "Theory and practice of total-factor productivity estimation: The control function approach using Stata," Stata Journal, StataCorp LLC, vol. 18(3), pages 618-662, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stiebale, Joel & Suedekum, Jens & Woessner, Nicole, 2024. "Robots and the rise of European superstar firms," International Journal of Industrial Organization, Elsevier, vol. 97(C).
    2. Matteo Bugamelli & Francesca Lotti & Monica Amici & Emanuela Ciapanna & Fabrizio Colonna & Francesco D�Amuri & Silvia Giacomelli & Andrea Linarello & Francesco Manaresi & Giuliana Palumbo & Filippo , 2018. "Productivity growth in Italy: a tale of a slow-motion change," Questioni di Economia e Finanza (Occasional Papers) 422, Bank of Italy, Economic Research and International Relations Area.
    3. Jaan Masso & Amaresh K Tiwari, 2021. "Productivity Implications Of R&D, Innovation And Capital Accumulation For Incumbents And Entrants: The Case Of Estonia," University of Tartu - Faculty of Economics and Business Administration Working Paper Series 130, Faculty of Economics and Business Administration, University of Tartu (Estonia).
    4. Jan Bena & Peter Ondko & Evangelia Vourvachaki, 2011. "Productivity Gains from Services Liberalization in Europe," CERGE-EI Working Papers wp452, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    5. Massimo Del Gatto & Adriana Di Liberto & Carmelo Petraglia, 2011. "Measuring Productivity," Journal of Economic Surveys, Wiley Blackwell, vol. 25(5), pages 952-1008, December.
    6. Dolores Añon Higón & Ionnanis Bournakis, 2024. "Global Value Chains (GVCs) participation and Markups," Working Papers 2403, Department of Applied Economics II, Universidad de Valencia.
    7. Antonietti, Roberto & Marzucchi, Alberto, 2014. "Green tangible investment strategies and export performance: A firm-level investigation," Ecological Economics, Elsevier, vol. 108(C), pages 150-161.
    8. Berlingieri, Giuseppe & Blanchenay, Patrick & Criscuolo, Chiara, 2024. "The great divergence(s)," Research Policy, Elsevier, vol. 53(3).
    9. Hsu, Wen-Tai & Lu, Yi & Luo, Xuan & Zhu, Lianming, 2023. "Foreign direct investment and industrial agglomeration: Evidence from China," Journal of Comparative Economics, Elsevier, vol. 51(2), pages 610-639.
    10. Umut Kılınç, 2018. "Assessing Productivity Gains from International Trade in a Small Open Economy," Open Economies Review, Springer, vol. 29(5), pages 953-980, November.
    11. Pardesi, Mantej, 2024. "Productivity convergence and firm’s training strategy," ROA Research Memorandum 003, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    12. Bloom, Nick & Manova, Kalina & Teng Sun, Stephen & Van Reenen, John & Yu, Zhihong, 2018. "Managing trade: evidence from China and the US," LSE Research Online Documents on Economics 88703, London School of Economics and Political Science, LSE Library.
    13. Exadaktylos, Dimitrios & Riccaboni, Massimo & Rungi, Armando, 2024. "Talents from abroad. Foreign managers and productivity in the United Kingdom," International Economics, Elsevier, vol. 177(C).
    14. Montresor, Sandro & Vezzani, Antonio, 2015. "The production function of top R&D investors: Accounting for size and sector heterogeneity with quantile estimations," Research Policy, Elsevier, vol. 44(2), pages 381-393.
    15. Fang Wang & Zhaoyuan Xu & Xiaoyong Dai, 2023. "Is learning by exporting technology specific? Evidence from Chinese firms," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 32(2), pages 275-304, February.
    16. Qiu, Larry D. & Yu, Miaojie, 2020. "Export scope, managerial efficiency, and trade liberalization: Evidence from Chinese firms," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 71-90.
    17. Marie Le Mouel & Alexander Schiersch, 2020. "Knowledge-Based Capital and Productivity Divergence," Discussion Papers of DIW Berlin 1868, DIW Berlin, German Institute for Economic Research.
    18. Stiebale, Joel & Vencappa, Dev, 2022. "Import competition and vertical integration: Evidence from India," Journal of Development Economics, Elsevier, vol. 155(C).
    19. Ian Goldin & Pantelis Koutroumpis & François Lafond & Julian Winkler, 2024. "Why Is Productivity Slowing Down?," Journal of Economic Literature, American Economic Association, vol. 62(1), pages 196-268, March.
    20. Segundo Camino‐Mogro & Natalia Bermudez‐Barrezueta, 2021. "Productivity determinants in the construction sector in emerging country: New evidence from Ecuadorian firms," Review of Development Economics, Wiley Blackwell, vol. 25(4), pages 2391-2413, November.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.19627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.