IDEAS home Printed from https://ideas.repec.org/p/unm/unumer/2018031.html

A guide for the evaluation of programs of human capital training for science, technology and innovation

Author

Listed:
  • Aboal, Diego

    (Centro de Investigaciones Economicas, Montevideo)

  • Perera, Marcelo

    (Centro de Investigaciones Economicas, Montevideo)

  • Tacsir, Ezequiel

    (UNU-MERIT, and Centro de Investigaciones Economicas, Montevideo)

  • Vairo, Maren

    (Centro de Investigaciones Economicas, Montevideo)

Abstract

We provide a practical guide for impact evaluation of Training and Human Capital programs in Science Technology and Innovation (STI). This document addresses specific challenges that arise when evaluating this type of programs, discussing its logic, the advantages and drawbacks of the different sources of information, the strategies which may be appropriate for evaluation, and the suitability of applying the different experimental and quasi-experimental available methods. For each technique, the document highlights the characteristics and assumptions, the strengths and weaknesses, and the practical issues related to their application to programs of human capital training for STI. Also, some specific issues, as for example the time after which the effects and externalities are expected to materialize, are discussed. Discussion is based on specific examples of existing evaluations.

Suggested Citation

  • Aboal, Diego & Perera, Marcelo & Tacsir, Ezequiel & Vairo, Maren, 2018. "A guide for the evaluation of programs of human capital training for science, technology and innovation," MERIT Working Papers 2018-031, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    • Handle: RePEc:unm:unumer:2018031
    as

    Download full text from publisher

    File URL: https://unu-merit.nl/publications/wppdf/2018/wp2018-031.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stucchi, Rodolfo & Rojo, Sofía & Maffioli, Alessandro & Castillo, Victoria, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 4779, Inter-American Development Bank.
    2. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    3. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085, December.
    4. Moretti, Enrico, 2004. "Estimating the social return to higher education: evidence from longitudinal and repeated cross-sectional data," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 175-212.
    5. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    6. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    7. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    8. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    9. Todd Stinebrickner & Ralph Stinebrickner, 2012. "Learning about Academic Ability and the College Dropout Decision," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 707-748.
    10. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    11. John B. Loomis, 2013. "Incorporating distributional issues into benefit–cost analysis: why, how, and two empirical examples using non-market valuation," Chapters, in: Scott O. Farrow & Richard Zerbe, Jr. (ed.), Principles and Standards for Benefit–Cost Analysis, chapter 9, pages 294-316, Edward Elgar Publishing.
    12. Rodolfo Stucchi & Sofía Rojo & Alessandro Maffioli & Victoria Castillo, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 83894, Inter-American Development Bank.
    13. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    14. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    15. Diego Aboal & Paula Garda, 2016. "Technological and non-technological innovation and productivity in services vis-à-vis manufacturing sectors," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 25(5), pages 435-454, July.
    16. Sen, Amartya, 1999. "Commodities and Capabilities," OUP Catalogue, Oxford University Press, number 9780195650389.
    17. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    18. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    19. John V. Winters, 2018. "Do higher levels of education and skills in an area benefit wider society?," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-10, December.
    20. Robert E. Hall & Charles I. Jones, 1999. "Why do Some Countries Produce So Much More Output Per Worker than Others?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 83-116.
    21. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    22. Richard R. Nelson, 1959. "The Economics of Invention: A Survey of the Literature," The Journal of Business, University of Chicago Press, vol. 32, pages 101-101.
    23. Basit Zafar, 2013. "College Major Choice and the Gender Gap," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 545-595.
    24. Shahidur R. Khandker & Gayatri B. Koolwal & Hussain A. Samad, 2010. "Handbook on Impact Evaluation : Quantitative Methods and Practices," World Bank Publications - Books, The World Bank Group, number 2693, April.
    25. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    26. Diego Aboal & Ezequiel Tacsir, 2017. "The impact of subsidies on researcher’s productivity: Evidence from a developing country," Research Evaluation, Oxford University Press, vol. 26(4), pages 269-283.
    27. Crespi, Gustavo & Zuniga, Pluvia, 2012. "Innovation and Productivity: Evidence from Six Latin American Countries," World Development, Elsevier, vol. 40(2), pages 273-290.
    28. repec:idb:brikps:62598 is not listed on IDEAS
    29. Jairo Núnez Méndez & Felipe Castro & Fernando Estupi�an & Andr�s Gordillo & Carlos Medina, 2014. "Evaluación de impacto y análisis costo beneficio de los programas de formación de capital intelectual de Colciencias: Jóvenes Investigadores y Becas de Doctorados," Informes de Investigación 12612, Fedesarrollo.
    30. Crespi, G. & Tacsir, E. & Vargas, F., 2014. "Innovation and productivity in services: Empirical evidence from Latin America," MERIT Working Papers 2014-069, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    31. Basit Zafar, 2011. "How Do College Students Form Expectations?," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 301-348.
    32. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    33. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue nov.
    34. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    35. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    36. Lucas, Robert Jr., 1988. "On the mechanics of economic development," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 3-42, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David J. Deming & Mikko I. Silliman, 2024. "Skills and Human Capital in the Labor Market," NBER Working Papers 32908, National Bureau of Economic Research, Inc.
    2. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    3. Grimsby, Gjermund, 2018. "Partly risky, partly solid – Performance study of public innovation loans," Research Policy, Elsevier, vol. 47(7), pages 1344-1365.
    4. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    5. Casaburi, Gabriel & Crespi, Gustavo & De León, Ignacio L. & Figal Garone, Lucas & Grazzi, Matteo & Guaipatín, Carlos & Katz, Jorge & Llisterri, Juan J. & Maffioli, Alessandro & Navarro, Juan Carlos & , 2016. "La política de innovación en América Latina y el Caribe: Nuevos caminos," IDB Publications (Books), Inter-American Development Bank, number 7705, November.
    6. Bratti, Massimiliano & Leombruni, Roberto, 2014. "Local human capital externalities and wages at the firm level: Evidence from Italian manufacturing," Economics of Education Review, Elsevier, vol. 41(C), pages 161-175.
    7. Gaglio, Cyrielle & Kraemer-Mbula, Erika & Lorenz, Edward, 2022. "The effects of digital transformation on innovation and productivity: Firm-level evidence of South African manufacturing micro and small enterprises," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    8. Matthias Firgo & Peter Mayerhofer, 2015. "Wissens-Spillovers und regionale Entwicklung - welche strukturpolitische Ausrichtung optimiert des Wachstum?," Working Paper Reihe der AK Wien - Materialien zu Wirtschaft und Gesellschaft 144, Kammer für Arbeiter und Angestellte für Wien, Abteilung Wirtschaftswissenschaft und Statistik.
    9. Kerekes, Monika, 2007. "Analyzing patterns of economic growth: a production frontier approach," Discussion Papers 2007/15, Free University Berlin, School of Business & Economics.
    10. Biavaschi, Costanza & Burzyński, Michał & Elsner, Benjamin & Machado, Joël, 2020. "Taking the skill bias out of global migration," Journal of Development Economics, Elsevier, vol. 142(C).
    11. Luis Fernando Gamboa & Paul AndrÔøΩs RodrÔøΩguez, 2014. "Do Colombian students underestimate higher education returns?," Documentos de Trabajo 12050, Universidad del Rosario.
    12. Paul Gaggl & Greg C. Wright, 2017. "A Short-Run View of What Computers Do: Evidence from a UK Tax Incentive," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 262-294, July.
    13. Mariana Pereira-López & Isidro Soloaga, 2015. "External returns to higher education in Mexico 2000-2010," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(1), pages 1-34, May.
    14. Matthias Firgo & Peter Mayerhofer, 2015. "Wissensintensive Unternehmensdienste, Wissens-Spillovers und regionales Wachstum. Teilprojekt 1: Wissens-Spillovers und regionale Entwicklung – Welche strukturpolitische Ausrichtung optimiert das Wachstum?," WIFO Studies, WIFO, number 58342.
    15. Marques, André M., 2022. "Is income inequality good or bad for growth? Further empirical evidence using data for all Brazilian cities," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 360-376.
    16. Gust, Sarah & Hanushek, Eric A. & Woessmann, Ludger, 2024. "Global universal basic skills: Current deficits and implications for world development," Journal of Development Economics, Elsevier, vol. 166(C).
    17. Mark Doms & Ethan Lewis, 2006. "Labor supply and personal computer adoption," Working Papers 06-10, Federal Reserve Bank of Philadelphia.
    18. Konstantin Koerner & Michael Moritz & Johannes Schäffler, 2022. "Foreign direct investment and onshore employment dynamics: Evidence from German firms with affiliates in the Czech Republic," The World Economy, Wiley Blackwell, vol. 45(6), pages 1773-1829, June.
    19. Brosch, Hanna & Lergetporer, Philipp & Schoner, Florian, 2025. "Worker Beliefs about Firm Training," IZA Discussion Papers 18186, Institute of Labor Economics (IZA).
    20. Mazzutti, Caio Cícero Toledo Piza da Costa, . "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses, Department of Economics, University of Sussex Business School, number 0616, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unm:unumer:2018031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ad Notten The email address of this maintainer does not seem to be valid anymore. Please ask Ad Notten to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/meritnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.