IDEAS home Printed from https://ideas.repec.org/p/unm/unumer/2018031.html
   My bibliography  Save this paper

A guide for the evaluation of programs of human capital training for science, technology and innovation

Author

Listed:
  • Aboal, Diego

    (Centro de Investigaciones Economicas, Montevideo)

  • Perera, Marcelo

    (Centro de Investigaciones Economicas, Montevideo)

  • Tacsir, Ezequiel

    (UNU-MERIT, and Centro de Investigaciones Economicas, Montevideo)

  • Vairo, Maren

    (Centro de Investigaciones Economicas, Montevideo)

Abstract

We provide a practical guide for impact evaluation of Training and Human Capital programs in Science Technology and Innovation (STI). This document addresses specific challenges that arise when evaluating this type of programs, discussing its logic, the advantages and drawbacks of the different sources of information, the strategies which may be appropriate for evaluation, and the suitability of applying the different experimental and quasi-experimental available methods. For each technique, the document highlights the characteristics and assumptions, the strengths and weaknesses, and the practical issues related to their application to programs of human capital training for STI. Also, some specific issues, as for example the time after which the effects and externalities are expected to materialize, are discussed. Discussion is based on specific examples of existing evaluations.

Suggested Citation

  • Aboal, Diego & Perera, Marcelo & Tacsir, Ezequiel & Vairo, Maren, 2018. "A guide for the evaluation of programs of human capital training for science, technology and innovation," MERIT Working Papers 2018-031, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    • Handle: RePEc:unm:unumer:2018031
    as

    Download full text from publisher

    File URL: https://www.merit.unu.edu/publications/wppdf/2018/wp2018-031.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stucchi, Rodolfo & Rojo, Sofía & Maffioli, Alessandro & Castillo, Victoria, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 4779, Inter-American Development Bank.
    2. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    3. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085.
    4. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    5. Moretti, Enrico, 2004. "Estimating the social return to higher education: evidence from longitudinal and repeated cross-sectional data," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 175-212.
    6. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    7. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    8. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    9. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    10. Todd Stinebrickner & Ralph Stinebrickner, 2012. "Learning about Academic Ability and the College Dropout Decision," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 707-748.
    11. Crespi, Gustavo & Zuniga, Pluvia, 2012. "Innovation and Productivity: Evidence from Six Latin American Countries," World Development, Elsevier, vol. 40(2), pages 273-290.
    12. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    13. John B. Loomis, 2013. "Incorporating distributional issues into benefit–cost analysis: why, how, and two empirical examples using non-market valuation," Chapters, in: Scott O. Farrow & Richard Zerbe, Jr. (ed.), Principles and Standards for Benefit–Cost Analysis, chapter 9, pages 294-316, Edward Elgar Publishing.
    14. Basit Zafar, 2011. "How Do College Students Form Expectations?," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 301-348.
    15. Rodolfo Stucchi & Sofía Rojo & Alessandro Maffioli & Victoria Castillo, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 83894, Inter-American Development Bank.
    16. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    17. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    18. Robert E. Hall & Charles I. Jones, 1999. "Why do Some Countries Produce So Much More Output Per Worker than Others?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 83-116.
    19. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    20. Diego Aboal & Paula Garda, 2016. "Technological and non-technological innovation and productivity in services vis-à-vis manufacturing sectors," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 25(5), pages 435-454, July.
    21. Sen, Amartya, 1999. "Commodities and Capabilities," OUP Catalogue, Oxford University Press, number 9780195650389.
    22. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    23. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    24. John V. Winters, 2018. "Do higher levels of education and skills in an area benefit wider society?," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-10, December.
    25. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    26. Richard R. Nelson, 1959. "The Economics of Invention: A Survey of the Literature," The Journal of Business, University of Chicago Press, vol. 32, pages 101-101.
    27. Basit Zafar, 2013. "College Major Choice and the Gender Gap," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 545-595.
    28. Shahidur R. Khandker & Gayatri B. Koolwal & Hussain A. Samad, . "Handbook on Impact Evaluation : Quantitative Methods and Practices," World Bank Publications, The World Bank, number 2693, September.
    29. Diego Aboal & Ezequiel Tacsir, 2017. "The impact of subsidies on researcher’s productivity: Evidence from a developing country," Research Evaluation, Oxford University Press, vol. 26(4), pages 269-283.
    30. repec:idb:brikps:62598 is not listed on IDEAS
    31. Jairo Núnez Méndez & Felipe Castro & Fernando Estupiñan & Andrés Gordillo & Carlos Medina, 2014. "Evaluación de impacto y análisis costo beneficio de los programas de formación de capital intelectual de Colciencias: Jóvenes Investigadores y Becas de Doctorados," Informes de Investigación 12612, Fedesarrollo.
    32. Crespi, G. & Tacsir, E. & Vargas, F., 2014. "Innovation and productivity in services: Empirical evidence from Latin America," MERIT Working Papers 2014-069, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    33. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    34. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    35. Lucas, Robert Jr., 1988. "On the mechanics of economic development," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 3-42, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    2. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    3. Grimsby, Gjermund, 2018. "Partly risky, partly solid – Performance study of public innovation loans," Research Policy, Elsevier, vol. 47(7), pages 1344-1365.
    4. Casaburi, Gabriel & Crespi, Gustavo & De León, Ignacio L. & Figal Garone, Lucas & Grazzi, Matteo & Guaipatín, Carlos & Katz, Jorge & Llisterri, Juan J. & Maffioli, Alessandro & Navarro, Juan Carlos & , 2016. "La política de innovación en América Latina y el Caribe: Nuevos caminos," IDB Publications (Books), Inter-American Development Bank, number 7705, May.
    5. Bratti, Massimiliano & Leombruni, Roberto, 2014. "Local human capital externalities and wages at the firm level: Evidence from Italian manufacturing," Economics of Education Review, Elsevier, vol. 41(C), pages 161-175.
    6. Aboal D. & Tacsir E., 2015. "Innovation and productivity in services and manufacturing : The role of ICT investment," MERIT Working Papers 2015-012, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    7. Luis Fernando Gamboa & Paul Andrés Rodríguez-Lesmes, 2018. "Subjective Earnings and Academic Expectations of Tertiary Education in Colombia," Revista ESPE - Ensayos sobre Política Económica, Banco de la Republica de Colombia, vol. 36(86), pages 159-177, June.
    8. Marques, André M., 2022. "Is income inequality good or bad for growth? Further empirical evidence using data for all Brazilian cities," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 360-376.
    9. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    10. Justine S. Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2013. "Are Some Degrees Worth More than Others? Evidence from college admission cutoffs in Chile," NBER Working Papers 19241, National Bureau of Economic Research, Inc.
    11. Ruben Fotso, 2022. "Evaluating the indirect effects of cluster-based innovation policies: the case of the Technological Research Institutes in France," The Journal of Technology Transfer, Springer, vol. 47(4), pages 1070-1114, August.
    12. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    13. Ribas, Rafael P. & Sampaio, Breno & Trevisan, Giuseppe, 2020. "Short- and long-term effects of class assignment: Evidence from a flagship university in Brazil," Labour Economics, Elsevier, vol. 64(C).
    14. Matthew Wiswall & Basit Zafar, 2015. "Determinants of College Major Choice: Identification using an Information Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(2), pages 791-824.
    15. Anabela Santos & Michele Cincera & Paulo Neto & Maria Manuel Serrano, 2019. "Which projects are selected for an innovation subsidy? The Portuguese case," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 18(3), pages 165-202, October.
    16. Lex Borghans & Bart H H Golsteyn & Anders Stenberg, 2015. "Does Expert Advice Improve Educational Choice?," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-28, December.
    17. Freier, Ronny & Schumann, Mathias & Siedler, Thomas, 2015. "The earnings returns to graduating with honors — Evidence from law graduates," Labour Economics, Elsevier, vol. 34(C), pages 39-50.
    18. Ricardo Estrada & Jérémie Gignoux, 2014. "Benefits to elite schools and the formation of expected returns to education: Evidence from Mexico City," Working Papers halshs-00951763, HAL.
    19. Jaison Abel & Todd Gabe, 2011. "Human Capital and Economic Activity in Urban America," Regional Studies, Taylor & Francis Journals, vol. 45(8), pages 1079-1090.
    20. Matthew Wiswall & Basit Zafar, 2011. "Belief updating among college students: evidence from experimental variation in information," Staff Reports 516, Federal Reserve Bank of New York.

    More about this item

    Keywords

    Impact Evaluation; Human Capital; Training Programs; Science; Technology and Innovation; Effectiveness for Development;
    All these keywords.

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unm:unumer:2018031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ad Notten (email available below). General contact details of provider: https://edirc.repec.org/data/meritnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.