IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.19627.html

Total Factor Productivity and its determinants: an analysis of the relationship at firm level through unsupervised learning techniques

Author

Listed:
  • Paolo Pedotti

Abstract

The paper is related to the identification of firm's features which serve as determinants for firm's total factor productivity through unsupervised learning techniques (principal component analysis, self organizing maps, clustering). This bottom-up approach can effectively manage the problem of the heterogeneity of the firms and provides new ways to look at firms' standard classifications. Using the large sample provided by the ORBIS database, the analyses covers the years before the outbreak of Covid-19 (2015-2019) and the immediate post-Covid period (year 2020). It has been shown that in both periods, the main determinants of productivity growth are related to profitability, credit/debts measures, cost and capital efficiency, and effort/efficiency of the R&D activity conducted by the firms. Finally, a linear relationship between determinants and productivity growth has been found.

Suggested Citation

  • Paolo Pedotti, 2025. "Total Factor Productivity and its determinants: an analysis of the relationship at firm level through unsupervised learning techniques," Papers 2511.19627, arXiv.org, revised May 2026.
  • Handle: RePEc:arx:papers:2511.19627
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.19627
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:bla:ecpoli:v:29:y:2014:i:78:p:253-296 is not listed on IDEAS
    2. Giulia Faggio & Kjell G. Salvanes & John Van Reenen, 2010. "The evolution of inequality in productivity and wages: panel data evidence," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(6), pages 1919-1951, December.
    3. Emerick, Kyle & Burke, Marshall & Maue, Casey, 2020. "Productivity dispersion and persistence among the world’s most numerous firms," CEPR Discussion Papers 14553, Centre for Economic Policy Research.
    4. Giovanni Dosi & Marco Grazzi & Chiara Tomasi & Alessandro Zeli, 2012. "Turbulence underneath the big calm? The micro-evidence behind Italian productivity dynamics," Small Business Economics, Springer, vol. 39(4), pages 1043-1067, November.
    5. Dan Andrews & Chiara Criscuolo & Peter N. Gal, 2016. "The Best versus the Rest: The Global Productivity Slowdown, Divergence across Firms and the Role of Public Policy," OECD Productivity Working Papers 5, OECD Publishing.
    6. Matias Covarrubias & Germán Gutiérrez & Thomas Philippon, 2020. "From Good to Bad Concentration? US Industries over the Past 30 Years," NBER Macroeconomics Annual, University of Chicago Press, vol. 34(1), pages 1-46.
    7. Crepon, B. & Duguet, E. & Mairesse, J., 1998. "Research Investment, Innovation and Productivity: An Econometric Analysis at the Firm Level," Papiers d'Economie Mathématique et Applications 98.15, Université Panthéon-Sorbonne (Paris 1).
    8. Massimo Del Gatto & Gianmarco I. P. Ottaviano & Marcello Pagnini, 2008. "Openness To Trade And Industry Cost Dispersion: Evidence From A Panel Of Italian Firms," Journal of Regional Science, Wiley Blackwell, vol. 48(1), pages 97-129, February.
    9. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    10. Mark Doms & Eric J. Bartelsman, 2000. "Understanding Productivity: Lessons from Longitudinal Microdata," Journal of Economic Literature, American Economic Association, vol. 38(3), pages 569-594, September.
    11. Daron Acemoglu & Philippe Aghion & Fabrizio Zilibotti, 2006. "Distance to Frontier, Selection, and Economic Growth," Journal of the European Economic Association, MIT Press, vol. 4(1), pages 37-74, March.
    12. Chad Syverson, 2004. "Market Structure and Productivity: A Concrete Example," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1181-1222, December.
    13. D. W. Jorgenson & Z. Griliches, 1967. "The Explanation of Productivity Change," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 34(3), pages 249-283.
    14. Malerba, Franco & Orsenigo, Luigi, 1995. "Schumpeterian Patterns of Innovation," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 47-65, February.
    15. Marc J. Melitz, 2003. "The Impact of Trade on Intra-Industry Reallocations and Aggregate Industry Productivity," Econometrica, Econometric Society, vol. 71(6), pages 1695-1725, November.
    16. Steven J. Davis & John Haltiwanger, 1992. "Gross Job Creation, Gross Job Destruction, and Employment Reallocation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 819-863.
    17. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    18. Casey C. Maue & Marshall Burke & Kyle J. Emerick, 2020. "Productivity Dispersion and Persistence Among the World's Most Numerous Firms," NBER Working Papers 26924, National Bureau of Economic Research, Inc.
    19. Nicholas Bloom & John Van Reenen, 2007. "Measuring and Explaining Management Practices Across Firms and Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1351-1408.
    20. Dale W. Jorgenson, 1966. "The Embodiment Hypothesis," Journal of Political Economy, University of Chicago Press, vol. 74(1), pages 1-1.
    21. Marc J. Melitz & Gianmarco I. P. Ottaviano, 2008. "Market Size, Trade, and Productivity (DOI:10.111/j.1467-937x.2007.00463.x)," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(3), pages 985-985.
    22. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    23. Caselli, Francesco, 2005. "Accounting for Cross-Country Income Differences," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 1, chapter 9, pages 679-741, Elsevier.
    24. Bernard, Andrew B. & Jensen, J. Bradford & Schott, Peter K., 2006. "Trade costs, firms and productivity," Journal of Monetary Economics, Elsevier, vol. 53(5), pages 917-937, July.
    25. Dan Andrews & Federico Cingano, 2014. "Public policy and resource allocation: evidence from firms in Oecd countries [‘Joseph Schumpeter Lecture. Appropriate growth policy: a unifying framework]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 29(78), pages 253-296.
    26. Daniel A. Ackerberg & Kevin Caves & Garth Frazer, 2015. "Identification Properties of Recent Production Function Estimators," Econometrica, Econometric Society, vol. 83, pages 2411-2451, November.
    27. Marc J. Melitz & Giancarlo I. P. Ottaviano, 2021. "Market Size, Trade, and Productivity," World Scientific Book Chapters, in: Firms and Workers in a Globalized World Larger Markets, Tougher Competition, chapter 4, pages 87-108, World Scientific Publishing Co. Pte. Ltd..
    28. Romain Duval & Gee Hee Hong & Yannick Timmer & Philip Strahan, 2020. "Financial Frictions and the Great Productivity Slowdown," The Review of Financial Studies, Society for Financial Studies, vol. 33(2), pages 475-503.
    29. Cohen, Wesley M & Klepper, Steven, 1996. "Firm Size and the Nature of Innovation within Industries: The Case of Process and Product R&D," The Review of Economics and Statistics, MIT Press, vol. 78(2), pages 232-243, May.
    30. German Gutierrez & Thomas Philippon, 2023. "How European Markets Became Free: A Study of Institutional Drift," Journal of the European Economic Association, European Economic Association, vol. 21(1), pages 251-292.
    31. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    32. Pieri, Fabio & Vecchi, Michela & Venturini, Francesco, 2018. "Modelling the joint impact of R&D and ICT on productivity: A frontier analysis approach," Research Policy, Elsevier, vol. 47(9), pages 1842-1852.
    33. Ryan Decker & John Haltiwanger & Ron Jarmin & Javier Miranda, 2014. "The Role of Entrepreneurship in US Job Creation and Economic Dynamism," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 3-24, Summer.
    34. Draca, Mirko & Sadun, Raffaella & Van Reenen, John, 2006. "Productivity and ICT: A Review of the Evidence," LSE Research Online Documents on Economics 4561, London School of Economics and Political Science, LSE Library.
    35. Jan De Loecker & Jan Eeckhout & Gabriel Unger, 2020. "The Rise of Market Power and the Macroeconomic Implications [“Econometric Tools for Analyzing Market Outcomes”]," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(2), pages 561-644.
    36. Pavitt, Keith, 1984. "Sectoral patterns of technical change: Towards a taxonomy and a theory," Research Policy, Elsevier, vol. 13(6), pages 343-373, December.
    37. Gabriele Rovigatti & Vincenzo Mollisi, 2018. "Theory and practice of total-factor productivity estimation: The control function approach using Stata," Stata Journal, StataCorp LLC, vol. 18(3), pages 618-662, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stiebale, Joel & Suedekum, Jens & Woessner, Nicole, 2024. "Robots and the rise of European superstar firms," International Journal of Industrial Organization, Elsevier, vol. 97(C).
    2. Massimo Del Gatto & Adriana Di Liberto & Carmelo Petraglia, 2011. "Measuring Productivity," Journal of Economic Surveys, Wiley Blackwell, vol. 25(5), pages 952-1008, December.
    3. Matteo Bugamelli & Francesca Lotti & Monica Amici & Emanuela Ciapanna & Fabrizio Colonna & Francesco D�Amuri & Silvia Giacomelli & Andrea Linarello & Francesco Manaresi & Giuliana Palumbo & Filippo , 2018. "Productivity growth in Italy: a tale of a slow-motion change," Questioni di Economia e Finanza (Occasional Papers) 422, Bank of Italy, Economic Research and International Relations Area.
    4. Jaan Masso & Amaresh K Tiwari, 2021. "Productivity Implications Of R&D, Innovation And Capital Accumulation For Incumbents And Entrants: The Case Of Estonia," University of Tartu - Faculty of Economics and Business Administration Working Paper Series 130, Faculty of Economics and Business Administration, University of Tartu (Estonia).
    5. Pardesi, Mantej, 2024. "Productivity convergence and firm’s training strategy," ROA Research Memorandum 003, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    6. Jan Bena & Peter Ondko & Evangelia Vourvachaki, 2011. "Productivity Gains from Services Liberalization in Europe," CERGE-EI Working Papers wp452, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    7. Ian Goldin & Pantelis Koutroumpis & François Lafond & Julian Winkler, 2024. "Why Is Productivity Slowing Down?," Journal of Economic Literature, American Economic Association, vol. 62(1), pages 196-268, March.
    8. Riandy Laksono & Arianto A. Patunru, 2024. "The dynamics of labor share decline in manufacturing: Evidence from Indonesia," Departmental Working Papers 2024-3, The Australian National University, Arndt-Corden Department of Economics.
    9. Matthias Kehrig, 2011. "The Cyclicality of Productivity Dispersion," Working Papers 11-15, Center for Economic Studies, U.S. Census Bureau.
    10. Dolores Añon Higón & Ionnanis Bournakis, 2024. "Global Value Chains (GVCs) participation and Markups," Working Papers 2403, Department of Applied Economics II, Universidad de Valencia.
    11. Matthew Backus, 2020. "Why Is Productivity Correlated With Competition?," Econometrica, Econometric Society, vol. 88(6), pages 2415-2444, November.
    12. Antonietti, Roberto & Marzucchi, Alberto, 2014. "Green tangible investment strategies and export performance: A firm-level investigation," Ecological Economics, Elsevier, vol. 108(C), pages 150-161.
    13. Berlingieri, Giuseppe & Blanchenay, Patrick & Criscuolo, Chiara, 2024. "The great divergence(s)," Research Policy, Elsevier, vol. 53(3).
    14. Pardesi, Mantej, 2024. "Productivity Convergence and Firm’s Training Strategy," Research Memorandum 003, Maastricht University, Graduate School of Business and Economics (GSBE).
    15. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    16. Hsu, Wen-Tai & Lu, Yi & Luo, Xuan & Zhu, Lianming, 2023. "Foreign direct investment and industrial agglomeration: Evidence from China," Journal of Comparative Economics, Elsevier, vol. 51(2), pages 610-639.
    17. Umut Kılınç, 2018. "Assessing Productivity Gains from International Trade in a Small Open Economy," Open Economies Review, Springer, vol. 29(5), pages 953-980, November.
    18. Dolores Añón Higón & Ioannis Bournakis, 2024. "Participation in global value chains (GVCs) and markups: firm evidence from six European countries," International Economics and Economic Policy, Springer, vol. 21(2), pages 515-539, May.
    19. Eric J. Bartelsman & Martin Falk & Eva Hagsten & Michael Polder, 2019. "Productivity, technological innovations and broadband connectivity: firm-level evidence for ten European countries," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 9(1), pages 25-48, March.
    20. Bloom, Nick & Manova, Kalina & Teng Sun, Stephen & Van Reenen, John & Yu, Zhihong, 2018. "Managing trade: evidence from China and the US," LSE Research Online Documents on Economics 88703, London School of Economics and Political Science, LSE Library.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.19627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.