IDEAS home Printed from https://ideas.repec.org/a/eee/telpol/v50y2026i2s0308596125002356.html

Does AI boost firm productivity? A web scraping and LLMs approach

Author

Listed:
  • Pastor-Merino, Ana
  • Martínez-Barbero, Xavier
  • Vicente, María R.
  • Domenech, Josep

Abstract

Artificial Intelligence (AI) is widely seen as a transformative technology with the potential to reshape firm productivity across sectors. However, empirical evidence on its actual impact at the firm level remains limited, mainly due to the lack of extensive firm-level data. Leveraging web scraping and Large Language Models (LLMs), this study develops a novel framework to detect and quantify AI adoption among 62,525 Spanish firms. The approach distinguishes between firms that adopt AI and those that integrate it intensively across business functions, constructing both binary and continuous measures of AI use. Using entropy-balanced instrumental variable estimations to address endogeneity, we find that AI-adopting firms exhibit approximately 53%–55% higher sales and 48% higher value added than comparable non-adopters. Moreover, increasing the intensity of AI use is associated with an even larger productivity premium of 74%–76% in sales and up to 67% in value added, highlighting the substantial returns from deeper AI integration. In dynamic terms, AI adoption is linked to 9%–13% faster annual sales growth. These findings provide evidence that AI significantly enhances firm performance, underscoring its role as a key driver of productivity growth.

Suggested Citation

  • Pastor-Merino, Ana & Martínez-Barbero, Xavier & Vicente, María R. & Domenech, Josep, 2026. "Does AI boost firm productivity? A web scraping and LLMs approach," Telecommunications Policy, Elsevier, vol. 50(2).
  • Handle: RePEc:eee:telpol:v:50:y:2026:i:2:s0308596125002356
    DOI: 10.1016/j.telpol.2025.103138
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0308596125002356
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.telpol.2025.103138?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Ryota Nakatani, 2023. "Productivity drivers of infrastructure companies: Network industries utilizing economies of scale in the digital era," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 94(4), pages 1273-1298, December.
    3. Rammer, Christian & Fernández, Gastón P. & Czarnitzki, Dirk, 2022. "Artificial intelligence and industrial innovation: Evidence from German firm-level data," Research Policy, Elsevier, vol. 51(7).
    4. Ryota Nakatani, 2024. "Multifactor productivity growth enhancers across industries and countries: firm-level evidence," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 14(2), pages 401-446, June.
    5. Abdullah Gök & Alec Waterworth & Philip Shapira, 2015. "Use of web mining in studying innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 653-671, January.
    6. Agrawal, Ajay & Gans, Joshua S. & Goldfarb, Avi, 2019. "Exploring the impact of artificial Intelligence: Prediction versus judgment," Information Economics and Policy, Elsevier, vol. 47(C), pages 1-6.
    7. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    8. Cyrille Schwellnus & Mathilde Pak & Pierre-Alain Pionnier & Elena Crivellaro, 2018. "Labour share developments over the past two decades: The role of technological progress, globalisation and “winner-takes-most” dynamics," OECD Economics Department Working Papers 1503, OECD Publishing.
    9. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2018. "Artificial Intelligence and the Modern Productivity Paradox: A Clash of Expectations and Statistics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 23-57, National Bureau of Economic Research, Inc.
    10. Matej Bajgar & Giuseppe Berlingieri & Sara Calligaris & Chiara Criscuolo & Jonathan Timmis, 2020. "Coverage and representativeness of Orbis data," OECD Science, Technology and Industry Working Papers 2020/06, OECD Publishing.
    11. Daniel A. Ackerberg & Kevin Caves & Garth Frazer, 2015. "Identification Properties of Recent Production Function Estimators," Econometrica, Econometric Society, vol. 83, pages 2411-2451, November.
    12. Nakatani, Ryota, 2021. "Total factor productivity enablers in the ICT industry: A cross-country firm-level analysis," Telecommunications Policy, Elsevier, vol. 45(9).
    13. Hunt, Jennifer & Cockburn, Iain & Bessen, James, 2024. "Is distance from innovation a barrier to the adoption of artificial intelligence," LSE Research Online Documents on Economics 126840, London School of Economics and Political Science, LSE Library.
    14. repec:iab:iabjlr:v:53:i:1:p:art.7 is not listed on IDEAS
    15. Amit Gandhi & Salvador Navarro & David A. Rivers, 2020. "On the Identification of Gross Output Production Functions," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 2973-3016.
    16. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    17. Janna Axenbeck & Patrick Breithaupt, 2021. "Innovation indicators based on firm websites—Which website characteristics predict firm-level innovation activity?," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-23, April.
    18. Kristina McElheran & J. Frank Li & Erik Brynjolfsson & Zachary Kroff & Emin Dinlersoz & Lucia Foster & Nikolas Zolas, 2024. "AI adoption in America: Who, what, and where," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 375-415, March.
    19. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    20. Babina, Tania & Fedyk, Anastassia & He, Alex & Hodson, James, 2024. "Artificial intelligence, firm growth, and product innovation," Journal of Financial Economics, Elsevier, vol. 151(C).
    21. Stockinger, Bastian, 2019. "Broadband internet availability and establishments' employment growth in Germany : evidence from instrumental variables estimations," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 53, pages 1-007.
    22. Bastian Stockinger, 2019. "Broadband internet availability and establishments’ employment growth in Germany: evidence from instrumental variables estimations," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 53(1), pages 1-23, December.
    23. Jan Kinne & Janna Axenbeck, 2020. "Web mining for innovation ecosystem mapping: a framework and a large-scale pilot study," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2011-2041, December.
    24. Marioni, Larissa da Silva & Rincon-Aznar, Ana & Venturini, Francesco, 2024. "Productivity performance, distance to frontier and AI innovation: Firm-level evidence from Europe," Journal of Economic Behavior & Organization, Elsevier, vol. 228(C).
    25. Giacomo Damioli & Vincent Van Roy & Daniel Vertesy, 2021. "The impact of artificial intelligence on labor productivity," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 11(1), pages 1-25, March.
    26. Lisa Crosato & Josep Domenech & Caterina Liberati, 2024. "Websites’ data: a new asset for enhancing credit risk modeling," Annals of Operations Research, Springer, vol. 342(3), pages 1671-1686, November.
    27. repec:iab:iabjlr:v:53:p:art.07 is not listed on IDEAS
    28. Dahlke, Johannes & Beck, Mathias & Kinne, Jan & Lenz, David & Dehghan, Robert & Wörter, Martin & Ebersberger, Bernd, 2024. "Epidemic effects in the diffusion of emerging digital technologies: evidence from artificial intelligence adoption," Research Policy, Elsevier, vol. 53(2).
    29. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    30. Ashouri, Sajad & Hajikhani, Arash & Suominen, Arho & Pukelis, Lukas & Cunningham, Scott W., 2024. "Measuring digitalization at scale using web scraped data," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    31. Daron Acemoglu & Pascual Restrepo, 2020. "Robots and Jobs: Evidence from US Labor Markets," Journal of Political Economy, University of Chicago Press, vol. 128(6), pages 2188-2244.
    32. Bottai, Carlo & Crosato, Lisa & Domenech, Josep & Guerzoni, Marco & Liberati, Caterina, 2024. "Scraping innovativeness from corporate websites: Empirical evidence on Italian manufacturing SMEs," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    33. Blazquez, Desamparados & Domenech, Josep, 2018. "Big Data sources and methods for social and economic analyses," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 99-113.
    34. Alejandro Fernández Cerezo & Ignacio Hidalgo & Mario Izquierdo, 2025. "Adoption of artificial intelligence in Spanish firms: an initial analysis based on the Banco de España Business Activity Survey," Economic Bulletin, Banco de España, issue 2025/Q2.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    2. Flavio Calvino & Luca Fontanelli, 2026. "Decoding AI: an early look at how French firms use AI," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 16(1), pages 51-93, March.
    3. Andres, Raphaela & Niebel, Thomas & Sack, Robin, 2025. "Big data and firm-level productivity – A cross-country comparison," Information Economics and Policy, Elsevier, vol. 71(C).
    4. Fontanelli, Luca & Guerini, Mattia & Miniaci, Raffaele & Secchi, Angelo, 2025. "Predictive AI and productivity growth dynamics: Evidence from French firms," Journal of Economic Behavior & Organization, Elsevier, vol. 240(C).
    5. Flavio Calvino & Luca Fontanelli, 2025. "Decoding AI: Nine facts about how firms use artificial intelligence in France," LEM Papers Series 2025/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    6. Ryota Nakatani, 2024. "Multifactor productivity growth enhancers across industries and countries: firm-level evidence," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 14(2), pages 401-446, June.
    7. Sébastien Houde & Wenjun Wang, 2026. "AI Adoption and Carbon Intensity: Evidence from China," CESifo Working Paper Series 12803, CESifo.
    8. gert Bijnens & Joep Konings & Aaron Putseys, 2025. "Unveiling the J-curve: How Intangibles Drive Productivity Mismeasurement," Working Papers of VIVES - Research Centre for Regional Economics 779815, KU Leuven, Faculty of Economics and Business (FEB), VIVES - Research Centre for Regional Economics.
    9. Calvino, Flavio & Fontanelli, Luca, 2026. "AI users are not all alike: The characteristics of French firms buying and developing AI," Research Policy, Elsevier, vol. 55(5).
    10. Roth, Felix & Rammer, Christian, 2025. "Intangible Assets and Productivity at the Firm Level: R&D versus non-R&D Intangibles," Hamburg Discussion Papers in International Economics 20, University of Hamburg, Department of Economics.
    11. Nucci, Francesco & Puccioni, Chiara & Ricchi, Ottavio, 2023. "Digital technologies and productivity: A firm-level investigation," Economic Modelling, Elsevier, vol. 128(C).
    12. Jacques Mairesse & Pierre Mohnen & Ad Notten, 2025. "Innovation and productivity: the recent empirical literature and the state of the art," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 15(1), pages 1-27, March.
    13. Park, Gangmin & Kang, Songhee & Yi, Sangyoon & Kim, Junyoun, 2026. "Diverse impacts of AI investments on productivity gains: Effects of industry and innovation characteristics," Technological Forecasting and Social Change, Elsevier, vol. 224(C).
    14. Wu, Yongqiu & Lin, Zhiwei & Zhang, Qingcui & Wang, Wei, 2024. "Artificial intelligence, wage dynamics, and inequality: Empirical evidence from Chinese listed firms," International Review of Economics & Finance, Elsevier, vol. 96(PC).
    15. Tao Chen & Shuwen Pi & Qing Sophie Wang, 2025. "Artificial Intelligence and Corporate Investment Efficiency: Evidence from Chinese Listed Companies," Working Papers in Economics 25/05, University of Canterbury, Department of Economics and Finance.
    16. Anastasios Evgenidis & Apostolos Fasianos, 2025. "AI news shocks and the macroeconomy: evidence from UK patent data," IFS Working Papers W25/48, Institute for Fiscal Studies.
    17. Chen, Jia & Wang, Ning & Lin, Tongzhi & Liu, Baoliu & Hu, Jin, 2024. "Shock or empowerment? Artificial intelligence technology and corporate ESG performance," Economic Analysis and Policy, Elsevier, vol. 83(C), pages 1080-1096.
    18. Fu, Yu & Chen, Yijun & Zhang, Yulin & Wang, Menghan & Yu, Yuanchun, 2026. "Corporate productivity transformation under the innovation paradigm: The role and impact of artificial intelligence," Technology in Society, Elsevier, vol. 84(C).
    19. Duran-Vanegas, Juan, 2026. "Early AI Adoption and Firm Productivity Growth in a Middle-Income Economy: Evidence from Colombia," SocArXiv 64nmf_v1, Center for Open Science.
    20. Minniti, Antonio & Prettner, Klaus & Venturini, Francesco, 2025. "AI innovation and the labor share in European regions," European Economic Review, Elsevier, vol. 177(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:telpol:v:50:y:2026:i:2:s0308596125002356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/30471/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.