IDEAS home Printed from https://ideas.repec.org/a/eee/agisys/v78y2003i2p166-184.html
   My bibliography  Save this article

Why impact analysis should not be used for research evaluation and what the alternatives are

Author

Listed:
  • Ekboir, Javier

Abstract

No abstract is available for this item.

Suggested Citation

  • Ekboir, Javier, 2003. "Why impact analysis should not be used for research evaluation and what the alternatives are," Agricultural Systems, Elsevier, vol. 78(2), pages 166-184, November.
  • Handle: RePEc:eee:agisys:v:78:y:2003:i:2:p:166-184
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0308-521X(03)00125-2
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Echeverria, Ruben G., 1998. "Agricultural research policy issues in Latin America: An Overview," World Development, Elsevier, vol. 26(6), pages 1103-1111, June.
    2. Salter, Ammon J. & Martin, Ben R., 2001. "The economic benefits of publicly funded basic research: a critical review," Research Policy, Elsevier, vol. 30(3), pages 509-532, March.
    3. Wallace E. Huffman & Richard E. Just, 2000. "Setting Efficient Incentives for Agricultural Research: Lessons from Principal-Agent Theory," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(4), pages 828-841.
    4. Ekboir, Javier, 2002. "Developing No-Till Packages for Small-Scale Farmers," Facts and Trends/Overview and Outlook 298005, CIMMYT: International Maize and Wheat Improvement Center.
    5. Hare, Paul & Wyatt, Geoffrey, 1988. "Modelling the determination of research output in British universities," Research Policy, Elsevier, vol. 17(6), pages 315-328, December.
    6. Yoshiko Okubo, 1997. "Bibliometric Indicators and Analysis of Research Systems: Methods and Examples," OECD Science, Technology and Industry Working Papers 1997/1, OECD Publishing.
    7. Scott Rozelle & Carl Pray & Jikun Huang, 1997. "Agricultural Research Policy in China: Testing the Limits of Commercialization-Led Reform*," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 39(2), pages 37-71, July.
    8. Morris, Michael L. & Risopoulos, Jean & Beck, David, 1999. "Genetic Change in Farmer-Recycled Maize Seed: A Review of the Evidence," Economics Working Papers 7683, CIMMYT: International Maize and Wheat Improvement Center.
    9. Anderson, J. R. & Hardaker, J. B., 1992. "Efficacy and efficiency in agricultural research: A systems view," Agricultural Systems, Elsevier, vol. 40(1-3), pages 105-123.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    2. Peter Weißhuhn & Katharina Helming & Johanna Ferretti, 2018. "Research impact assessment in agriculture—A review of approaches and impact areas," Research Evaluation, Oxford University Press, vol. 27(1), pages 36-42.
    3. Kuehne, Geoff & Llewellyn, Rick & Pannell, David J. & Wilkinson, Roger & Dolling, Perry & Ouzman, Jackie & Ewing, Mike, 2017. "Predicting farmer uptake of new agricultural practices: A tool for research, extension and policy," Agricultural Systems, Elsevier, vol. 156(C), pages 115-125.
    4. Raina, Rajeswari S. & Sangar, Sunita & Rasheed Sulaiman, V. & Hall, Andrew J., 2006. "The soil sciences in India: Policy lessons for agricultural innovation," Research Policy, Elsevier, vol. 35(5), pages 691-714, June.
    5. Pant, Laxmi P., 2010. "Assessing Innovations in International Research and Development Practice," MERIT Working Papers 2010-043, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    6. Birner, Regina & Davis, Kristin & Pender, John & Nkonya, Ephraim & Anandajayasekeram, Ponniah & Ekboir, Javier & Mbabu, Adiel & Spielman, David & Horna, Daniela & Benin, Samuel & Cohen, Marc J., 2006. "From "best practice" to "best fit": a framework for designing and analyzing pluralistic agricultural advisory services worldwide," FCND discussion papers 210, International Food Policy Research Institute (IFPRI).
    7. Klerkx, Laurens & Leeuwis, Cees, 2008. "Institutionalizing end-user demand steering in agricultural R&D: Farmer levy funding of R&D in The Netherlands," Research Policy, Elsevier, vol. 37(3), pages 460-472, April.
    8. Matteo Pedrini & Valentina Langella & Mario Alberto Battaglia & Paola Zaratin, 2018. "Assessing the health research’s social impact: a systematic review," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1227-1250, March.
    9. Klerkx, Laurens & Aarts, Noelle & Leeuwis, Cees, 2010. "Adaptive management in agricultural innovation systems: The interactions between innovation networks and their environment," Agricultural Systems, Elsevier, vol. 103(6), pages 390-400, July.
    10. Andy Hall & Norman Clark, 2010. "What do complex adaptive systems look like and what are the implications for innovation policy?," Journal of International Development, John Wiley & Sons, Ltd., vol. 22(3), pages 308-324.
    11. Raltzer, David A. & Lindner, Robert K., 2005. "Review of the Returns to ACIAR's Bilateral R&D Investments," Impact Assessment Series (IAS) 113215, Australian Centre for International Agricultural Research.
    12. Douthwaite, Boru & Gummert, Martin, 2010. "Learning selection revisited: How can agricultural researchers make a difference?," Agricultural Systems, Elsevier, vol. 103(5), pages 245-255, June.
    13. Raitzer, David A. & Kelley, Timothy G., 2008. "Benefit-cost meta-analysis of investment in the International Agricultural Research Centers of the CGIAR," Agricultural Systems, Elsevier, vol. 96(1-3), pages 108-123, March.
    14. Kuehne, Geoff & Nicholson, Cam & Robertson, Michael & Llewellyn, Rick & McDonald, Cam, 2012. "Engaging project proponents in R&D evaluation using bio-economic and socio-economic tools," Agricultural Systems, Elsevier, vol. 108(C), pages 94-103.
    15. Hall, Andy & Sulaiman, Rasheed & Bezkorowajnyj, Peter, 2008. "Reframing technical change: Livestock Fodder Scarcity Revisited as Innovation Capacity Scarcity: Part 2. A Framework for Analysis," MERIT Working Papers 2008-003, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    16. Blackstock, K.L. & Kelly, G.J. & Horsey, B.L., 2007. "Developing and applying a framework to evaluate participatory research for sustainability," Ecological Economics, Elsevier, vol. 60(4), pages 726-742, February.
    17. Hall, Andy & Dijkman, Jeroen & Sulaiman, Rasheed, 2010. "Research Into Use: Investigating the Relationship between Agricultural Research and Innovation," MERIT Working Papers 2010-044, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ashkan Ebadi & Andrea Schiffauerova, 2013. "Impact of Funding on Scientific Output and Collaboration: A Survey of Literature," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 12(04), pages 1-16.
    2. Cox, Michael & Mincey, Sarah & Ruseva, Tatyana & Villamayor-Tomas, Sergio & Fischer, Burney, 2013. "Evaluating the USFS State and Private Forestry Redesign: A first look at policy implications," Ecological Economics, Elsevier, vol. 85(C), pages 35-42.
    3. Ashkan Ebadi & Andrea Schiffauerova, 2016. "How to boost scientific production? A statistical analysis of research funding and other influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1093-1116, March.
    4. Albahari, Alberto & Pérez-Canto, Salvador & Barge-Gil, Andrés & Modrego, Aurelia, 2017. "Technology Parks versus Science Parks: Does the university make the difference?," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 13-28.
    5. Gersbach, Hans & Schneider, Maik & Schneller, Olivier, 2010. "Optimal Mix of Applied and Basic Research, Distance to Frontier, and Openness," CEPR Discussion Papers 7795, C.E.P.R. Discussion Papers.
    6. Yin, Zhifeng & Liang, Zheng & Zhi, Qiang, 2018. "Does the concentration of scientific research funding in institutions promote knowledge output?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1146-1159.
    7. Ward-Warmedinger, Melanie E., 1999. "Salary and the Gender Salary Gap in the Academic Profession," IZA Discussion Papers 64, Institute of Labor Economics (IZA).
    8. Laxmi, Vijay & Erenstein, Olaf & Gupta, Raj K., 2007. "Impact of Zero Tillage in India's Rice-Wheat Systems," Impact Studies 56093, CIMMYT: International Maize and Wheat Improvement Center.
    9. Dusan Lesjak, 2019. "Measuring Impacts of Science and Research on the Society: Development, Issues and Solutions," Management, University of Primorska, Faculty of Management Koper, vol. 14(3), pages 219-236.
    10. Parellada, Gabriel H. & Ekboir, Javier M., 2003. "Analisis del sistema argentino de investigacion agropecuaria," Economics Working Papers 7694, CIMMYT: International Maize and Wheat Improvement Center.
    11. Çağlar, Musa & Gürel, Sinan, 2019. "Impact assessment based sectoral balancing in public R&D project portfolio selection," Socio-Economic Planning Sciences, Elsevier, vol. 66(C), pages 68-81.
    12. Krishna, Vijesh V. & Aravindakshan, Sreejith & Chowdhury, Apurba & Rudra, Bankim, 2012. "Farmer Access and Differential Impacts of Zero Tillage Technology in the Subsistence Wheat Farming Systems of West Bengal, India," Socioeconomics Program Working Papers 147204, CIMMYT: International Maize and Wheat Improvement Center.
    13. Julia Olmos‐Peñuela & Paul Benneworth & Elena Castro‐Martínez, 2015. "Exploring the factors related with scientists’ willingness to incorporating external knowledge," CHEPS Working Papers 201504, University of Twente, Center for Higher Education Policy Studies (CHEPS).
    14. Barge-Gil, Andrés & López, Alberto, 2014. "R&D determinants: Accounting for the differences between research and development," Research Policy, Elsevier, vol. 43(9), pages 1634-1648.
    15. Haskel, Jonathan & Wallis, Gavin, 2013. "Public support for innovation, intangible investment and productivity growth in the UK market sector," Economics Letters, Elsevier, vol. 119(2), pages 195-198.
    16. Beck, Mathias & Junge, Martin & Kaiser, Ulrich, 2017. "Public Funding and Corporate Innovation," IZA Discussion Papers 11196, Institute of Labor Economics (IZA).
    17. Beatriz Pereira Almeida & Eduardo Gonçalves & André Suriane Silva & Raquel Coelho Reis, 2021. "Internalization of knowledge spillovers by regions: a measure based on self-citation patents," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 66(2), pages 309-330, April.
    18. Suominen, Arho & Kauppinen, Henni & Hyytinen, Kirsi, 2021. "‘Gold’, ‘Ribbon’ or ‘Puzzle’: What motivates researchers to work in Research and Technology Organizations," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    19. Alex Coad & Agustí Segarra-Blasco & Mercedes Teruel, 2021. "A bit of basic, a bit of applied? R&D strategies and firm performance," The Journal of Technology Transfer, Springer, vol. 46(6), pages 1758-1783, December.
    20. Klaus Jaffe & Mario Caicedo & Marcos Manzanares & Mario Gil & Alfredo Rios & Astrid Florez & Claudia Montoreano & Vicente Davila, 2013. "Productivity in Physical and Chemical Science Predicts the Future Economic Growth of Developing Countries Better than Other Popular Indices," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-10, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:agisys:v:78:y:2003:i:2:p:166-184. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/agsy .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/agsy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.