IDEAS home Printed from https://ideas.repec.org/a/hig/fsight/v6y2012i3p62-74.html
   My bibliography  Save this article

The Best Practices of Evaluating S&T Foresight: Basic Elements and Key Criteria

Author

Listed:
  • Ekaterina Makarova
  • Anna Sokolova

    (Institute for Statistical Studies and Economics of Knowledge, National Research University Higher School of Economics)

Abstract

As the impact of strategic decision-making at the corporate, sectoral and national levels increase, there are growing demands for high quality and solid Foresight outputs. In this regard, a timely detection and elimination of problems in Foresight projects is of great importance. A thorough evaluation of criteria and methods used in Foresight analysis would permit the improved effectiveness of Foresight activities. The results could be set against the aims to decide on the feasibility of projects and identify ways to improve them. Despite great interest in Foresight evaluation demonstrated by stakeholders at various levels, the general principles for conducting it have not yet been formulated, which hinders its development and the diffusion of successful expertise. The purpose of this paper is to identify the basic elements-criteria and methods—used in evaluating national Foresight. It presents the most interesting results for specific tasks, the themes examined, the methods and the findings, in general. In addition, the study allowed some inference about theory and practice of project management. The study reveals that a key motivation for evaluation of Foresight projects is to provide feedback to national Foresight organizations and identify areas for further development. Evaluation is used to guide Foresight (in varying degrees) and provide lessons learned for future projects (for example, simplifying implementation, involving business and social organizations, recognizing the need for better compliance with the methodology and objectives of the study participants). The paper serves to develop a general methodology for assessing national Foresight programmes. A further agenda is to develop a comprehensive analysis of Foresight, ensure comparability of results of Foresight evaluation initiatives in different countries, promote standardization of evaluation procedures. Note: Downloadable document is in Russian.

Suggested Citation

  • Ekaterina Makarova & Anna Sokolova, 2012. "The Best Practices of Evaluating S&T Foresight: Basic Elements and Key Criteria," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 6(3), pages 62-74.
  • Handle: RePEc:hig:fsight:v:6:y:2012:i:3:p:62-74
    as

    Download full text from publisher

    File URL: http://foresight-journal.hse.ru/data/2013/09/23/1279019338/06-Sokolova-62-75.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dirk Meissner & Mario Cervantes, 2010. "Successful Foresight Study: Implications for Design, Preparatory Activities and Tools to Uses," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 4(1), pages 74-81.
    2. Attila Havas & Doris Schartinger & Matthias Weber, 2010. "The impact of foresight on innovation policy-making: recent experiences and future perspectives," Research Evaluation, Oxford University Press, vol. 19(2), pages 91-104, June.
    3. Kerstin Cuhls, 2003. "From forecasting to foresight processes-new participative foresight activities in Germany," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(2-3), pages 93-111.
    4. Remer, Donald S. & Nieto, Armando P., 1995. "A compendium and comparison of 25 project evaluation techniques. Part 2: Ratio, payback, and accounting methods," International Journal of Production Economics, Elsevier, vol. 42(2), pages 101-129, December.
    5. Ozcan Saritas & Erol Taymaz & Turgut Tumer, 2006. "Vision 2023: Turkey’s National Technology Foresight Program – a contextualist description and analysis," ERC Working Papers 0601, ERC - Economic Research Center, Middle East Technical University, revised Jan 2006.
    6. Remer, Donald S. & Nieto, Armando P., 1995. "A compendium and comparison of 25 project evaluation techniques. Part 1: Net present value and rate of return methods," International Journal of Production Economics, Elsevier, vol. 42(1), pages 79-96, November.
    7. Eilat, Harel & Golany, Boaz & Shtub, Avraham, 2008. "R&D project evaluation: An integrated DEA and balanced scorecard approach," Omega, Elsevier, vol. 36(5), pages 895-912, October.
    8. Remer, Donald S. & Stokdyk, Scott B. & Van Driel, Mike, 1993. "Survey of project evaluation techniques currently used in industry," International Journal of Production Economics, Elsevier, vol. 32(1), pages 103-115, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anatoliy Alabugin & Sergei Aliukov & Tatyana Khudyakova, 2022. "Review of Models for and Socioeconomic Approaches to the Formation of Foresight Control Mechanisms: A Genesis," Sustainability, MDPI, vol. 14(19), pages 1-19, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ekaterina Makarova & Anna Sokolova, 2012. "Foresight Evaluation: Lessons from Project Management," HSE Working papers WP BRP 01/MAN/2012, National Research University Higher School of Economics.
    2. Anna Sokolova, 2013. "The integrated approach for Foresight evaluation: the Russian case," HSE Working papers WP BRP 20/STI/2013, National Research University Higher School of Economics.
    3. Magni, Carlo Alberto, 2016. "Capital depreciation and the underdetermination of rate of return: A unifying perspective," Journal of Mathematical Economics, Elsevier, vol. 67(C), pages 54-79.
    4. Cuthbert, James R. & Magni, Carlo Alberto, 2016. "Measuring the inadequacy of IRR in PFI schemes using profitability index and AIRR," International Journal of Production Economics, Elsevier, vol. 179(C), pages 130-140.
    5. Carlo Alberto Magni & Ken V. Peasnell, 2015. "The Term Structure of Capital Values:An accounting-based framework for measuring economic profitability," Department of Economics 0060, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    6. Dodoo, Ambrose & Gustavsson, Leif & Tettey, Uniben Y.A., 2017. "Final energy savings and cost-effectiveness of deep energy renovation of a multi-storey residential building," Energy, Elsevier, vol. 135(C), pages 563-576.
    7. García Kerdan, Iván & Raslan, Rokia & Ruyssevelt, Paul & Morillón Gálvez, David, 2017. "A comparison of an energy/economic-based against an exergoeconomic-based multi-objective optimisation for low carbon building energy design," Energy, Elsevier, vol. 128(C), pages 244-263.
    8. Francisco Campuzano-Bolarín & Fulgencio Marín-García & José Andrés Moreno-Nicolás & Marija Bogataj & David Bogataj, 2021. "Network Simulation Method for the evaluation of perturbed supply chains on a finite horizon," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 29(3), pages 823-839, September.
    9. Hosseininasab, Amin & Ahmadi, Abbas, 2015. "Selecting a supplier portfolio with value, development, and risk consideration," European Journal of Operational Research, Elsevier, vol. 245(1), pages 146-156.
    10. Yasser Alizadeh & Antonie J. Jetter, 2019. "Pathways for Balancing Exploration and Exploitation in Innovations: A Review and Expansion of Ambidexterity Theory," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 16(05), pages 1-33, August.
    11. Aurora Greta Ruggeri & Laura Gabrielli & Massimiliano Scarpa, 2020. "Energy Retrofit in European Building Portfolios: A Review of Five Key Aspects," Sustainability, MDPI, vol. 12(18), pages 1-38, September.
    12. Cuéllar-Franca, Rosa & García-Gutiérrez, Pelayo & Dimitriou, Ioanna & Elder, Rachael H. & Allen, Ray W.K. & Azapagic, Adisa, 2019. "Utilising carbon dioxide for transport fuels: The economic and environmental sustainability of different Fischer-Tropsch process designs," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    13. Man Ying (Annie) Ho & Joseph H. K. Lai & Huiying (Cynthia) Hou & Dadi Zhang, 2021. "Key Performance Indicators for Evaluation of Commercial Building Retrofits: Shortlisting via an Industry Survey," Energies, MDPI, vol. 14(21), pages 1-30, November.
    14. Sommerfeldt, Nelson & Madani, Hatef, 2017. "Revisiting the techno-economic analysis process for building-mounted, grid-connected solar photovoltaic systems: Part one – Review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 1379-1393.
    15. Magni, Carlo Alberto, 2015. "Aggregate Return On Investment for investments under uncertainty," International Journal of Production Economics, Elsevier, vol. 165(C), pages 29-37.
    16. Joan Carles FERRER-COMALAT & Salvador LINARES-MUSTAROS & Dolors COROMINAS-COLL, 2016. "A Model For Optimal Investment Project Choice Using Fuzzy Probability," ECONOMIC COMPUTATION AND ECONOMIC CYBERNETICS STUDIES AND RESEARCH, Faculty of Economic Cybernetics, Statistics and Informatics, vol. 50(4), pages 187-203.
    17. Morelli, Martin & Harrestrup, Maria & Svendsen, Svend, 2014. "Method for a component-based economic optimisation in design of whole building renovation versus demolishing and rebuilding," Energy Policy, Elsevier, vol. 65(C), pages 305-314.
    18. Laura Gabrielli & Aurora Greta Ruggeri & Massimiliano Scarpa, 2023. "Roadmap to a Sustainable Energy System: Is Uncertainty a Major Barrier to Investments for Building Energy Retrofit Projects in Wide City Compartments?," Energies, MDPI, vol. 16(11), pages 1-21, May.
    19. Kayser, Victoria & Blind, Knut, 2017. "Extending the knowledge base of foresight: The contribution of text mining," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 208-215.
    20. Copiello, Sergio & Gabrielli, Laura & Bonifaci, Pietro, 2017. "Evaluation of energy retrofit in buildings under conditions of uncertainty: The prominence of the discount rate," Energy, Elsevier, vol. 137(C), pages 104-117.

    More about this item

    Keywords

    foresight; evaluation; project management; best practices;
    All these keywords.

    JEL classification:

    • O21 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Planning Models; Planning Policy
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:fsight:v:6:y:2012:i:3:p:62-74. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nataliya Gavrilicheva or Mikhail Salazkin (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.