IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i9d10.1007_s11192-022-04325-6.html
   My bibliography  Save this article

Reframing evidence in evidence-based policy making and role of bibliometrics: toward transdisciplinary scientometric research

Author

Listed:
  • Yuya Kajikawa

    (Tokyo Institute of Technology
    The University of Tokyo)

Abstract

Bibliometric and scientometric analyses are widely in university headquarters, across multiple disciplines, in companies, and governments. Therefore, we need further research and expertise on how this analysis can be used in practice. In this study, we focus on the role of bibliometric analysis in evidence-based policymaking (EBPM). We divide the type of analysis into descriptive, predictive, and explorative analyses, and their different roles in EBPM processes. To discuss the role of scientometrics in EBPM, we illustrate a case of hydrogen energy technologies. We derive four propositions based on arguments on evidence and prerequisites for the analysis, that are necessary for: (1) strict distinction between policy evidence and policy reason, (2) application of relevant type of analysis to each unit process of policymaking, (3) multi-layered expertise including data and algorithms, domain knowledge, and understanding of policy context and social issues, and (4) a knowledge system to archive data, algorithms, and results. This paper contributes broadly to transdisciplinary bibliometric research, and specifically to scientometric research and science-based policymaking.

Suggested Citation

  • Yuya Kajikawa, 2022. "Reframing evidence in evidence-based policy making and role of bibliometrics: toward transdisciplinary scientometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5571-5585, September.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:9:d:10.1007_s11192-022-04325-6
    DOI: 10.1007/s11192-022-04325-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04325-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04325-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Neil R. Smalheiser, 2012. "Literature‐based discovery: Beyond the ABCs," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(2), pages 218-224, February.
    2. Naoki Shibata & Yuya Kajikawa & Katsumori Matsushima, 2007. "Topological analysis of citation networks to discover the future core articles," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(6), pages 872-882, April.
    3. Guan-Can Yang & Gang Li & Chun-Ya Li & Yun-Hua Zhao & Jing Zhang & Tong Liu & Dar-Zen Chen & Mu-Hsuan Huang, 2015. "Using the comprehensive patent citation network (CPC) to evaluate patent value," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1319-1346, December.
    4. Luciano Kay & Nils Newman & Jan Youtie & Alan L. Porter & Ismael Rafols, 2014. "Patent overlay mapping: Visualizing technological distance," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(12), pages 2432-2443, December.
    5. Martin, Ben R., 2012. "The evolution of science policy and innovation studies," Research Policy, Elsevier, vol. 41(7), pages 1219-1239.
    6. Duncan A Thomas & Maria Nedeva & Mayra M Tirado & Merle Jacob, 2020. "Changing research on research evaluation: A critical literature review to revisit the agenda," Research Evaluation, Oxford University Press, vol. 29(3), pages 275-288.
    7. Sterman, J.D., 2006. "Learning from evidence in a complex world," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 505-514.
    8. Kazuhiro Hikima & Masaharu Tsujimoto & Mizutomo Takeuchi & Yuya Kajikawa, 2020. "Transition Analysis of Budgetary Allocation for Projects on Hydrogen-Related Technologies in Japan," Sustainability, MDPI, vol. 12(20), pages 1-15, October.
    9. Naoki Shibata & Yuya Kajikawa & Ichiro Sakata, 2011. "Measuring relatedness between communities in a citation network," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(7), pages 1360-1369, July.
    10. Takano, Yasutomo & Mejia, Cristian & Kajikawa, Yuya, 2016. "Unconnected component inclusion technique for patent network analysis: Case study of Internet of Things-related technologies," Journal of Informetrics, Elsevier, vol. 10(4), pages 967-980.
    11. Ismael Rafols & Alan L. Porter & Loet Leydesdorff, 2010. "Science overlay maps: A new tool for research policy and library management," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(9), pages 1871-1887, September.
    12. Small, Henry & Boyack, Kevin W. & Klavans, Richard, 2014. "Identifying emerging topics in science and technology," Research Policy, Elsevier, vol. 43(8), pages 1450-1467.
    13. Kevin W. Boyack & Richard Klavans, 2010. "Co‐citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(12), pages 2389-2404, December.
    14. Neil R. Smalheiser, 2012. "Literature-based discovery: Beyond the ABCs," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(2), pages 218-224, February.
    15. Li, Yung-Ta & Huang, Mu-Hsuan & Chen, Dar-Zen, 2014. "Positioning and shifting of technology focus for integrated device manufacturers by patent perspectives," Technological Forecasting and Social Change, Elsevier, vol. 81(C), pages 363-375.
    16. Jacopo Torriti, 2010. "Impact Assessment and the Liberalization of the EU Energy Markets: Evidence‐Based Policy‐Making or Policy‐Based Evidence‐Making?," Journal of Common Market Studies, Wiley Blackwell, vol. 48(4), pages 1065-1081, September.
    17. Hsieh, Chih-Hung, 2013. "Patent value assessment and commercialization strategy," Technological Forecasting and Social Change, Elsevier, vol. 80(2), pages 307-319.
    18. Richard Klavans & Kevin W Boyack & Dewey A Murdick, 2020. "A novel approach to predicting exceptional growth in research," PLOS ONE, Public Library of Science, vol. 15(9), pages 1-24, September.
    19. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    20. Jacopo Torriti, 2010. "Impact Assessment and the Liberalization of the EU Energy Markets: Evidence-Based Policy-Making or Policy-Based Evidence-Making?," Journal of Common Market Studies, Wiley Blackwell, vol. 48, pages 1065-1081, September.
    21. Lovro Šubelj & Nees Jan van Eck & Ludo Waltman, 2016. "Clustering Scientific Publications Based on Citation Relations: A Systematic Comparison of Different Methods," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-23, April.
    22. Kevin W. Boyack & Richard Klavans & Katy Börner, 2005. "Mapping the backbone of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(3), pages 351-374, August.
    23. Naoki Shibata & Yuya Kajikawa & Ichiro Sakata, 2011. "Measuring relatedness between communities in a citation network," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1360-1369, July.
    24. Kevin W. Boyack & Richard Klavans, 2010. "Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(12), pages 2389-2404, December.
    25. Nakamura, Hiroko & Suzuki, Shinji & Sakata, Ichiro & Kajikawa, Yuya, 2015. "Knowledge combination modeling: The measurement of knowledge similarity between different technological domains," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 187-201.
    26. Morlacchi, Piera & Martin, Ben R., 2009. "Emerging challenges for science, technology and innovation policy research: A reflexive overview," Research Policy, Elsevier, vol. 38(4), pages 571-582, May.
    27. Ogawa, Takaya & Kajikawa, Yuya, 2017. "Generating novel research ideas using computational intelligence: A case study involving fuel cells and ammonia synthesis," Technological Forecasting and Social Change, Elsevier, vol. 120(C), pages 41-47.
    28. Marc Weeber & Henny Klein & Lolkje T.W. de Jong‐van den Berg & Rein Vos, 2001. "Using concepts in literature‐based discovery: Simulating Swanson's Raynaud–fish oil and migraine–magnesium discoveries," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(7), pages 548-557.
    29. Kimitaka Asatani & Junichiro Mori & Masanao Ochi & Ichiro Sakata, 2018. "Detecting trends in academic research from a citation network using network representation learning," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-13, May.
    30. Takaya Ogawa & Mizutomo Takeuchi & Yuya Kajikawa, 2018. "Analysis of Trends and Emerging Technologies in Water Electrolysis Research Based on a Computational Method: A Comparison with Fuel Cell Research," Sustainability, MDPI, vol. 10(2), pages 1-24, February.
    31. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    32. Christopher W. Belter, 2016. "Citation analysis as a literature search method for systematic reviews," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2766-2777, November.
    33. Naoki Shibata & Yuya Kajikawa & Yoshiyuki Takeda & Katsumori Matsushima, 2009. "Comparative study on methods of detecting research fronts using different types of citation," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(3), pages 571-580, March.
    34. Ben R Martin, 2011. "The Research Excellence Framework and the ‘impact agenda’: are we creating a Frankenstein monster?," Research Evaluation, Oxford University Press, vol. 20(3), pages 247-254, September.
    35. Ming-Yueh Tsay, 2008. "A bibliometric analysis of hydrogen energy literature, 1965–2005," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 421-438, June.
    36. Takano, Yasutomo & Kajikawa, Yuya, 2019. "Extracting commercialization opportunities of the Internet of Things: Measuring text similarity between papers and patents," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 45-68.
    37. Takaya Ogawa & Mizutomo Takeuchi & Yuya Kajikawa, 2018. "Comprehensive Analysis of Trends and Emerging Technologies in All Types of Fuel Cells Based on a Computational Method," Sustainability, MDPI, vol. 10(2), pages 1-30, February.
    38. Dobrow, Mark J. & Goel, Vivek & Upshur, R. E. G., 2004. "Evidence-based health policy: context and utilisation," Social Science & Medicine, Elsevier, vol. 58(1), pages 207-217, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kajikawa, Yuya & Mejia, Cristian & Wu, Mengjia & Zhang, Yi, 2022. "Academic landscape of Technological Forecasting and Social Change through citation network and topic analyses," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    2. Sjögårde, Peter & Ahlgren, Per, 2018. "Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics," Journal of Informetrics, Elsevier, vol. 12(1), pages 133-152.
    3. Kose, Toshihiro & Sakata, Ichiro, 2019. "Identifying technology convergence in the field of robotics research," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 751-766.
    4. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    5. Matthias Held & Grit Laudel & Jochen Gläser, 2021. "Challenges to the validity of topic reconstruction," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4511-4536, May.
    6. Zhang, Yi & Shang, Lining & Huang, Lu & Porter, Alan L. & Zhang, Guangquan & Lu, Jie & Zhu, Donghua, 2016. "A hybrid similarity measure method for patent portfolio analysis," Journal of Informetrics, Elsevier, vol. 10(4), pages 1108-1130.
    7. Jochen Gläser & Wolfgang Glänzel & Andrea Scharnhorst, 2017. "Same data—different results? Towards a comparative approach to the identification of thematic structures in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 981-998, May.
    8. Peter Sjögårde & Fereshteh Didegah, 2022. "The association between topic growth and citation impact of research publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1903-1921, April.
    9. Shuo Xu & Liyuan Hao & Xin An & Hongshen Pang & Ting Li, 2020. "Review on emerging research topics with key-route main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 607-624, January.
    10. Ludo Waltman & Nees Jan Eck, 2012. "A new methodology for constructing a publication-level classification system of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    11. Li, Heyang & Wu, Meijun & Wang, Yougui & Zeng, An, 2022. "Bibliographic coupling networks reveal the advantage of diversification in scientific projects," Journal of Informetrics, Elsevier, vol. 16(3).
    12. Li, Menghui & Yang, Liying & Zhang, Huina & Shen, Zhesi & Wu, Chensheng & Wu, Jinshan, 2017. "Do mathematicians, economists and biomedical scientists trace large topics more strongly than physicists?," Journal of Informetrics, Elsevier, vol. 11(2), pages 598-607.
    13. Liu, Xiang & Jiang, Tingting & Ma, Feicheng, 2013. "Collective dynamics in knowledge networks: Emerging trends analysis," Journal of Informetrics, Elsevier, vol. 7(2), pages 425-438.
    14. Xu, Shuo & Hao, Liyuan & Yang, Guancan & Lu, Kun & An, Xin, 2021. "A topic models based framework for detecting and forecasting emerging technologies," Technological Forecasting and Social Change, Elsevier, vol. 162(C).
    15. Takano, Yasutomo & Kajikawa, Yuya, 2019. "Extracting commercialization opportunities of the Internet of Things: Measuring text similarity between papers and patents," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 45-68.
    16. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    17. Chiara Carusi & Giuseppe Bianchi, 2020. "A look at interdisciplinarity using bipartite scholar/journal networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 867-894, February.
    18. Fan, Yangliu & Lehmann, Sune & Blok, Anders, 2022. "Extracting the interdisciplinary specialty structures in social media data-based research: A clustering-based network approach," Journal of Informetrics, Elsevier, vol. 16(3).
    19. Wang, Feifei & Jia, Chenran & Wang, Xiaohan & Liu, Junwan & Xu, Shuo & Liu, Yang & Yang, Chenyuyan, 2019. "Exploring all-author tripartite citation networks: A case study of gene editing," Journal of Informetrics, Elsevier, vol. 13(3), pages 856-873.
    20. Fang Han & Christopher L. Magee, 2018. "Testing the science/technology relationship by analysis of patent citations of scientific papers after decomposition of both science and technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 767-796, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:9:d:10.1007_s11192-022-04325-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.