IDEAS home Printed from https://ideas.repec.org/p/hig/wpaper/116sti2020.html

How To Measure Ai: Trends, Challenges And Implications

Author

Listed:
  • Yulia Turovets

    (National Research University Higher School of Economics)

  • Konstantin Vishnevskiy

    (National Research University Higher School of Economics)

  • Artem Altynov

    (National Research University Higher School of Economics)

Abstract

How do comparable and similar indicators to measure artificial intelligence (AI) look across countries? In answering this question, our study addresses two main aims. Firstly, the paper introduces a holistic approach as operational tool to measure AI development (supply side) and adoption (demand side), which covers AI definition, AI technologies taxonomy, and a set of indicators. Secondly, the suggested methodology combines several sources of information like survey, bibliometric, and patent analysis. Next, by analyzing the results of a pilot survey and calculations, the reliability of indicators and a tentative assessment the state of the art of AI development and adoption in Russia is provided. Taking into consideration the complex nature of AI, the study represents a number of baseline parameters that give an overview of AI progress on a country level. The next step will be an elaboration of detailed indicators that at capture AI characteristics to a greater extent in different economic sectors

Suggested Citation

  • Yulia Turovets & Konstantin Vishnevskiy & Artem Altynov, 2020. "How To Measure Ai: Trends, Challenges And Implications," HSE Working papers WP BRP 116/STI/2020, National Research University Higher School of Economics.
    • Handle: RePEc:hig:wpaper:116sti2020
    as

    Download full text from publisher

    File URL: https://wp.hse.ru/data/2020/11/24/1352643519/116STI2020.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Aghion & Céline Antonin & Simon Bunel, 2019. "Artificial Intelligence, Growth and Employment: The Role of Policy," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 510-511-5, pages 149-164.
    2. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    3. Fujii, Hidemichi & Managi, Shunsuke, 2018. "Trends and priority shifts in artificial intelligence technology invention: A global patent analysis," Economic Analysis and Policy, Elsevier, vol. 58(C), pages 60-69.
    4. Daron Acemoglu & Pascual Restrepo, 2019. "Automation and New Tasks: How Technology Displaces and Reinstates Labor," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 3-30, Spring.
    5. Bresnahan, Timothy F. & Trajtenberg, M., 1995. "General purpose technologies 'Engines of growth'?," Journal of Econometrics, Elsevier, vol. 65(1), pages 83-108, January.
    6. Sangsung Park & Sunghae Jun, 2020. "Patent Keyword Analysis of Disaster Artificial Intelligence Using Bayesian Network Modeling and Factor Analysis," Sustainability, MDPI, vol. 12(2), pages 1-11, January.
    7. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    8. Mikhail Gershman & Galina Kitova, 2017. "Erratum to: Assessing Government Support for Research and Innovation in Russian Universities," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 8(3), pages 1085-1085, September.
    9. Dolores Añón Higón & Jaime Gómez & Pilar Vargas, 2017. "Complementarities in innovation strategy: do intangibles play a role in enhancing firm performance?," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(5), pages 865-886.
    10. James Bessen, 2019. "Automation and jobs: when technology boosts employment," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 34(100), pages 589-626.
    11. Xi Zhang & Xianhai Wang & Hongke Zhao & Patricia Ordóñez de Pablos & Yongqiang Sun & Hui Xiong, 2019. "An effectiveness analysis of altmetrics indices for different levels of artificial intelligence publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1311-1344, June.
    12. Cette, G. & Clerc, C. & Bresson, L., 2016. "Contribution of information and communication technologies (ICT) to growth," Rue de la Banque, Banque de France, issue 22, April..
    13. Stefano Baruffaldi & Brigitte van Beuzekom & Hélène Dernis & Dietmar Harhoff & Nandan Rao & David Rosenfeld & Mariagrazia Squicciarini, 2020. "Identifying and measuring developments in artificial intelligence: Making the impossible possible," OECD Science, Technology and Industry Working Papers 2020/05, OECD Publishing.
    14. repec:spo:wpmain:info:hdl:2441/7n49nkmngd8448a5ts5gt5ade0 is not listed on IDEAS
    15. Pantano, Eleonora & Pizzi, Gabriele, 2020. "Forecasting artificial intelligence on online customer assistance: Evidence from chatbot patents analysis," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    16. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    2. Venturini, Francesco, 2022. "Intelligent technologies and productivity spillovers: Evidence from the Fourth Industrial Revolution," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 220-243.
    3. Anastasios Evgenidis & Apostolos Fasianos, 2025. "AI news shocks and the macroeconomy: evidence from UK patent data," IFS Working Papers W25/48, Institute for Fiscal Studies.
    4. Parteka, Aleksandra & Kordalska, Aleksandra, 2023. "Artificial intelligence and productivity: global evidence from AI patent and bibliometric data," Technovation, Elsevier, vol. 125(C).
    5. Cui, Huijie & Liang, Shangkun & Xu, Canyu & Junli, Yu, 2024. "Robots and analyst forecast precision: Evidence from Chinese manufacturing," International Review of Financial Analysis, Elsevier, vol. 94(C).
    6. Johanna Deperi & Ludovic Dibiaggio & Mohamed Keita & Lionel Nesta, 2023. "Ideas Without Scale in French Artificial Intelligence Innovations," Sciences Po Economics Publications (main) hal-04144817, HAL.
    7. Fabien Petit & Florencia Jaccoud & Tommaso Ciarli, 2023. "Heterogeneous Adjustments of Labor Markets to Automation Technologies," CESifo Working Paper Series 10237, CESifo.
    8. Heyman, Fredrik & Norbäck, Pehr-Johan & Persson, Lars, 2021. "Automation, Work and Productivity: The Role of Firm Heterogeneity," Working Paper Series 1382, Research Institute of Industrial Economics, revised 09 Mar 2023.
    9. Ekaterina Prytkova, 2021. "ICT's Wide Web: a System-Level Analysis of ICT's Industrial Diffusion with Algorithmic Links," Jena Economics Research Papers 2021-005, Friedrich-Schiller-University Jena.
    10. Mahuaqing Zuo & Yuhan Zhao & Shasha Yu, 2024. "Industrial robot applications and individual migration decision: evidence from households in China," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-15, December.
    11. Schneider, Florian, 2024. "Do robots boost productivity? A quantitative meta-study," MPRA Paper 123392, University Library of Munich, Germany.
    12. Gambardella, Alfonso & Conti, Raffaele & Novelli, Elena, 2018. "Specializing in Generality: Firm Strategies When Intermediate Markets Work," CEPR Discussion Papers 12782, C.E.P.R. Discussion Papers.
    13. Caselli, Mauro & Fracasso, Andrea & Scicchitano, Sergio & Traverso, Silvio & Tundis, Enrico, 2025. "What workers and robots do: An activity-based analysis of the impact of robotization on changes in local employment," Research Policy, Elsevier, vol. 54(1).
    14. Chris Forman & Avi Goldfarb & Shane Greenstein, 2003. "How did Location Affect Adoption of the Commercial Internet? Global Village, Urban Density, and Industry Composition," NBER Working Papers 9979, National Bureau of Economic Research, Inc.
    15. Ajay Agrawal & Joshua Gans & Avi Goldfarb, 2019. "Economic Policy for Artificial Intelligence," Innovation Policy and the Economy, University of Chicago Press, vol. 19(1), pages 139-159.
    16. Jurkat, Anne & Klump, Rainer & Schneider, Florian, 2025. "Robots and wages: A meta-analysis," Structural Change and Economic Dynamics, Elsevier, vol. 75(C), pages 541-567.
    17. Lach, Saul & Trajtenberg, Manuel & Shiff, Gil, 2008. "Together but Apart: ICT and Productivity Growth in Israel," CEPR Discussion Papers 6732, C.E.P.R. Discussion Papers.
    18. Piva, Mariacristina & Santarelli, Enrico & Vivarelli, Marco, 2005. "The skill bias effect of technological and organisational change: Evidence and policy implications," Research Policy, Elsevier, vol. 34(2), pages 141-157, March.
    19. Engel, Dirk & Dehio, Jochen & Döhrn, Roland & Janßen-Timmen, Ronald & Scheuer, Markus & Stiebale, Joel, 2007. "Internationalisierung der IT-Dienstleister: Eine Bestandsaufnahme," RWI Materialien 36, RWI - Leibniz-Institut für Wirtschaftsforschung.
    20. Chris Forman & Avi Goldfarb, 2021. "Concentration and Agglomeration of IT Innovation and Entrepreneurship: Evidence from Patenting," NBER Chapters, in: The Role of Innovation and Entrepreneurship in Economic Growth, pages 95-121, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:wpaper:116sti2020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Shamil Abdulaev or Shamil Abdulaev (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.