IDEAS home Printed from https://ideas.repec.org/p/unm/unumer/2018031.html
   My bibliography  Save this paper

A guide for the evaluation of programs of human capital training for science, technology and innovation

Author

Listed:
  • Aboal, Diego

    (Centro de Investigaciones Economicas, Montevideo)

  • Perera, Marcelo

    (Centro de Investigaciones Economicas, Montevideo)

  • Tacsir, Ezequiel

    (UNU-MERIT, and Centro de Investigaciones Economicas, Montevideo)

  • Vairo, Maren

    (Centro de Investigaciones Economicas, Montevideo)

Abstract

We provide a practical guide for impact evaluation of Training and Human Capital programs in Science Technology and Innovation (STI). This document addresses specific challenges that arise when evaluating this type of programs, discussing its logic, the advantages and drawbacks of the different sources of information, the strategies which may be appropriate for evaluation, and the suitability of applying the different experimental and quasi-experimental available methods. For each technique, the document highlights the characteristics and assumptions, the strengths and weaknesses, and the practical issues related to their application to programs of human capital training for STI. Also, some specific issues, as for example the time after which the effects and externalities are expected to materialize, are discussed. Discussion is based on specific examples of existing evaluations.

Suggested Citation

  • Aboal, Diego & Perera, Marcelo & Tacsir, Ezequiel & Vairo, Maren, 2018. "A guide for the evaluation of programs of human capital training for science, technology and innovation," MERIT Working Papers 2018-031, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    • Handle: RePEc:unm:unumer:2018031
    as

    Download full text from publisher

    File URL: https://unu-merit.nl/publications/wppdf/2018/wp2018-031.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    2. Moretti, Enrico, 2004. "Estimating the social return to higher education: evidence from longitudinal and repeated cross-sectional data," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 175-212.
    3. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    4. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    5. Crespi, Gustavo & Zuniga, Pluvia, 2012. "Innovation and Productivity: Evidence from Six Latin American Countries," World Development, Elsevier, vol. 40(2), pages 273-290.
    6. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    7. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    8. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    9. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    10. David Card, 1993. "Using Geographic Variation in College Proximity to Estimate the Return to Schooling," Working Papers 696, Princeton University, Department of Economics, Industrial Relations Section..
    11. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    12. Richard R. Nelson, 1959. "The Economics of Invention: A Survey of the Literature," The Journal of Business, University of Chicago Press, vol. 32, pages 101-101.
    13. Diego Aboal & Ezequiel Tacsir, 2017. "The impact of subsidies on researcher’s productivity: Evidence from a developing country," Research Evaluation, Oxford University Press, vol. 26(4), pages 269-283.
    14. John V. Winters, 2018. "Do higher levels of education and skills in an area benefit wider society?," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-10, December.
    15. repec:idb:brikps:62598 is not listed on IDEAS
    16. Todd Stinebrickner & Ralph Stinebrickner, 2012. "Learning about Academic Ability and the College Dropout Decision," Journal of Labor Economics, University of Chicago Press, vol. 30(4), pages 707-748.
    17. Basit Zafar, 2011. "How Do College Students Form Expectations?," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 301-348.
    18. Crespi, G. & Tacsir, E. & Vargas, F., 2014. "Innovation and productivity in services: Empirical evidence from Latin America," MERIT Working Papers 2014-069, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    19. Robert E. Hall & Charles I. Jones, 1999. "Why do Some Countries Produce So Much More Output Per Worker than Others?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 83-116.
    20. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue nov.
    21. Lucas, Robert Jr., 1988. "On the mechanics of economic development," Journal of Monetary Economics, Elsevier, vol. 22(1), pages 3-42, July.
    22. Stucchi, Rodolfo & Rojo, Sofía & Maffioli, Alessandro & Castillo, Victoria, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 4779, Inter-American Development Bank.
    23. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    24. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085.
    25. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    26. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    27. John B. Loomis, 2013. "Incorporating distributional issues into benefit–cost analysis: why, how, and two empirical examples using non-market valuation," Chapters, in: Scott O. Farrow & Richard Zerbe, Jr. (ed.), Principles and Standards for Benefit–Cost Analysis, chapter 9, pages 294-316, Edward Elgar Publishing.
    28. Rodolfo Stucchi & Sofía Rojo & Alessandro Maffioli & Victoria Castillo, 2014. "Knowledge Spillovers of Innovation Policy through Labor Mobility: An Impact Evaluation of the FONTAR Program in Argentina," IDB Publications (Working Papers) 83894, Inter-American Development Bank.
    29. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    30. Diego Aboal & Paula Garda, 2016. "Technological and non-technological innovation and productivity in services vis-à-vis manufacturing sectors," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 25(5), pages 435-454, July.
    31. Sen, Amartya, 1999. "Commodities and Capabilities," OUP Catalogue, Oxford University Press, number 9780195650389.
    32. Basit Zafar, 2013. "College Major Choice and the Gender Gap," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 545-595.
    33. Shahidur R. Khandker & Gayatri B. Koolwal & Hussain A. Samad, 2010. "Handbook on Impact Evaluation : Quantitative Methods and Practices," World Bank Publications - Books, The World Bank Group, number 2693.
    34. Jairo Núnez Méndez & Felipe Castro & Fernando Estupi�an & Andr�s Gordillo & Carlos Medina, 2014. "Evaluación de impacto y análisis costo beneficio de los programas de formación de capital intelectual de Colciencias: Jóvenes Investigadores y Becas de Doctorados," Informes de Investigación 12612, Fedesarrollo.
    35. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    36. Loomis, John B., 2011. "Incorporating Distributional Issues into Benefit Cost Analysis: Why, How, and Two Empirical Examples Using Non-market Valuation," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 2(1), pages 1-24, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David J. Deming & Mikko I. Silliman, 2024. "Skills and Human Capital in the Labor Market," NBER Working Papers 32908, National Bureau of Economic Research, Inc.
    2. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    3. Gaglio, Cyrielle & Kraemer-Mbula, Erika & Lorenz, Edward, 2022. "The effects of digital transformation on innovation and productivity: Firm-level evidence of South African manufacturing micro and small enterprises," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    4. Gustavo A. Crespi & Alessandro Maffioli & Pierre Mohnen & Gonzalo Vázquez, 2011. "Evaluating the Impact of Science, Technology and Innovation Programs: a Methodological Toolkit," SPD Working Papers 1104, Inter-American Development Bank, Office of Strategic Planning and Development Effectiveness (SPD).
    5. Grimsby, Gjermund, 2018. "Partly risky, partly solid – Performance study of public innovation loans," Research Policy, Elsevier, vol. 47(7), pages 1344-1365.
    6. Casaburi, Gabriel & Crespi, Gustavo & De León, Ignacio L. & Figal Garone, Lucas & Grazzi, Matteo & Guaipatín, Carlos & Katz, Jorge & Llisterri, Juan J. & Maffioli, Alessandro & Navarro, Juan Carlos & , 2016. "La política de innovación en América Latina y el Caribe: Nuevos caminos," IDB Publications (Books), Inter-American Development Bank, number 7705.
    7. Bratti, Massimiliano & Leombruni, Roberto, 2014. "Local human capital externalities and wages at the firm level: Evidence from Italian manufacturing," Economics of Education Review, Elsevier, vol. 41(C), pages 161-175.
    8. Kerekes, Monika, 2007. "Analyzing patterns of economic growth: a production frontier approach," Discussion Papers 2007/15, Free University Berlin, School of Business & Economics.
    9. Matthias Firgo & Peter Mayerhofer, 2015. "Wissensintensive Unternehmensdienste, Wissens-Spillovers und regionales Wachstum. Teilprojekt 1: Wissens-Spillovers und regionale Entwicklung – Welche strukturpolitische Ausrichtung optimiert das Wach," WIFO Studies, WIFO, number 58342, October.
    10. Marques, André M., 2022. "Is income inequality good or bad for growth? Further empirical evidence using data for all Brazilian cities," Structural Change and Economic Dynamics, Elsevier, vol. 62(C), pages 360-376.
    11. Savona, María, 2016. "Global structural change and value chains in services: a reappraisal," Coediciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 43200.
    12. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    13. Jones, C.I., 2016. "The Facts of Economic Growth," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 3-69, Elsevier.
    14. Jiang, Wei & Lu, Yi & Xie, Huihua, 2020. "Education and mental health: Evidence and mechanisms," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 407-437.
    15. Justine S. Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2013. "Are Some Degrees Worth More than Others? Evidence from college admission cutoffs in Chile," NBER Working Papers 19241, National Bureau of Economic Research, Inc.
    16. Larissa Fuchs & Pia Pinger & Philipp Seegers, 2025. "Relative Grades and Gender Differences in STEM Enrollment," CRC TR 224 Discussion Paper Series crctr224_2025_633, University of Bonn and University of Mannheim, Germany.
    17. Kaplanis, Ioannis, 2010. "Wage effects from changes in local human capital in Britain," LSE Research Online Documents on Economics 33615, London School of Economics and Political Science, LSE Library.
    18. Ruben Fotso, 2022. "Evaluating the indirect effects of cluster-based innovation policies: the case of the Technological Research Institutes in France," The Journal of Technology Transfer, Springer, vol. 47(4), pages 1070-1114, August.
    19. Gust, Sarah & Hanushek, Eric A. & Woessmann, Ludger, 2024. "Global universal basic skills: Current deficits and implications for world development," Journal of Development Economics, Elsevier, vol. 166(C).
    20. Patrick Bennett, 2021. "The Work-To-School Transition: Job Displacement and Skill Upgrading among Young High School Dropouts," CESifo Working Paper Series 9417, CESifo.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unm:unumer:2018031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ad Notten The email address of this maintainer does not seem to be valid anymore. Please ask Ad Notten to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/meritnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.