IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v21y2012i1p33-47.html
   My bibliography  Save this article

Evaluating the demand side: New challenges for evaluation

Author

Listed:
  • J. Edler
  • L. Georghiou
  • K. Blind
  • E. Uyarra

Abstract

Evaluation of research and innovation policy faces radical challenges arising from a new policy emphasis upon demand-side measures and linked to this an understanding of innovation policy as a means to achieve societal goals. This article considers the implications for the practice of evaluation at both micro and meso-levels. It uses the exemplar of an evaluation design for the European Union's Lead Market Initiative to expose the extent to which classical approaches to evaluation are valid and where new issues arise. Some problems highlighted include the difficulty of establishing a relevant baseline, the inability of public statistics constructed in supply-side mode to capture actions, the need to engage with actors who do not necessarily see themselves as part of the initiative being evaluated, long timescales and potential wide geographical scope, measures that span from micro to macro, and blurred boundaries between implementation and impact. It is concluded that there is a key role for evaluators to become involved in co-learning and co-evolution of these policy instruments in a manner analogous to the relationship between evaluation and policy development that characterized the emergence of collaborative R&D support programmes. Copyright The Author 2012. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com, Oxford University Press.

Suggested Citation

  • J. Edler & L. Georghiou & K. Blind & E. Uyarra, 2012. "Evaluating the demand side: New challenges for evaluation," Research Evaluation, Oxford University Press, vol. 21(1), pages 33-47, February.
  • Handle: RePEc:oup:rseval:v:21:y:2012:i:1:p:33-47
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvr002
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jillian Yeow & Elvira Uyarra & Sally Gee, 2015. "Closing the loop: examining the case of the procurement of a sustainable innovation," Chapters,in: Public Procurement for Innovation, chapter 9, pages 235-262 Edward Elgar Publishing.
    2. Robert Gampfer & Jessica Mitchell & Blagoy Stamenow & Jana Zifciakova & Koen Jonkers, 2016. "Improving access to finance: which schemes best support the emergence of high-growth innovative enterprises? A mapping, analysis and assessment of finance instruments in selected EU Member States," JRC Working Papers JRC102928, Joint Research Centre (Seville site).
    3. repec:eee:tefoso:v:125:y:2017:i:c:p:178-187 is not listed on IDEAS
    4. Falck, Oliver & Wiederhold, Simon, 2013. "Nachfrageorientierte Innovationspolitik," Studien zum deutschen Innovationssystem 12-2013, Expertenkommission Forschung und Innovation (EFI) - Commission of Experts for Research and Innovation, Berlin.
    5. Katarzyna Szkuta & Blagoy Stamenov & Anna Ianshyna, 2017. "Improving access to finance for young innovative enterprises with growth potential: evidence of impact on firms' outputs: Part 1. Equity instruments: lessons learned from policy evaluations," JRC Working Papers JRC109163, Joint Research Centre (Seville site).
    6. Jakob Edler & Luke Georghiou & Elvira Uyarra & Jillian Yeow, 2015. "The meaning and limitations of public procurement for innovation: a supplier’s experience," Chapters,in: Public Procurement for Innovation, chapter 2, pages 35-64 Edward Elgar Publishing.
    7. Juliana Subtil Lacerda & Jeroen C. J. M. van den Bergh, 2014. "International Diffusion of Renewable Energy Innovations: Lessons from the Lead Markets for Wind Power in China, Germany and USA," Energies, MDPI, Open Access Journal, vol. 7(12), pages 1-28, December.
    8. Chicot, J. & Matt, M., 2015. "Public procurement of innovation: a review of rationales, instruments and design," Working Papers 2015-05, Grenoble Applied Economics Laboratory (GAEL).
    9. Charles Edquist & Nicholas S. Vonortas & Jon Mikel Zabala-Iturriagagoitia, 2015. "Introduction," Chapters,in: Public Procurement for Innovation, chapter 1, pages 1-32 Edward Elgar Publishing.
    10. Tamura, Suguru, 2016. "A new intellectual property metric for standardization activities," Technovation, Elsevier, vol. 48, pages 87-98.
    11. Oliver Falck & Simon Wiederhold, 2013. "Nachfrageorientierte Innovationspolitik: Bestandsaufnahme und ökonomische Bewertung," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 51, June.
    12. repec:spr:scient:v:102:y:2015:i:2:d:10.1007_s11192-014-1462-9 is not listed on IDEAS
    13. TAMURA Suguru & IWAMI Shino & SAKATA Ichiro, 2016. "Does Standardization Affect Science Linkage? Implications for society and organizational management: Evidence from artificial intelligence-related technology," Policy Discussion Papers 16007, Research Institute of Economy, Trade and Industry (RIETI).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:21:y:2012:i:1:p:33-47. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Oxford University Press) or (Christopher F. Baum). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.