IDEAS home Printed from https://ideas.repec.org/p/rri/wpaper/2010wp04.html
   My bibliography  Save this paper

Methodological Challenges and Institutional Barriers in the Use of Experimental Method for the Evaluation of Business Incubators: Lessons from the US, EU, and China

Author

Listed:
  • Junbo Yu

    (Regional Research Institute, West Virginia University)

  • Peter Nijkamp

    (Department of Spatial Economics, Free University, Amsterdam)

Abstract

Despite their worldwide adoption by policy makers as the Holy Grail for entrepreneurship and business development, the effectiveness of business incubation programs remain elusive, primarily plagued by untenable evaluation methods. This paper develops an in-depth analysis on those methodological and institutional factors that prohibit the use of theoretically sound solutions such as the Experimental Method in evaluation practice.

Suggested Citation

  • Junbo Yu & Peter Nijkamp, 2010. "Methodological Challenges and Institutional Barriers in the Use of Experimental Method for the Evaluation of Business Incubators: Lessons from the US, EU, and China," Working Papers Working Paper 2010-04, Regional Research Institute, West Virginia University.
    • Handle: RePEc:rri:wpaper:2010wp04
    as

    Download full text from publisher

    File URL: https://researchrepository.wvu.edu/rri_pubs/90/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rustam Lalkaka, 2003. "Business incubators in developing countries: characteristics and performance," International Journal of Entrepreneurship and Innovation Management, Inderscience Enterprises Ltd, vol. 3(1/2), pages 31-55.
    2. J Rees & R Bradley, 1988. "Research Policy and Review 24. State Science Policy and Economic Development in the United States: A Critical Perspective," Environment and Planning A, , vol. 20(8), pages 999-1012, August.
    3. Hugh Sherman & David S. Chappell, 1998. "Methodological Challenges in Evaluating Business Incubator Outcomes," Economic Development Quarterly, , vol. 12(4), pages 313-321, November.
    4. Candace Campbell & David N. Allen, 1987. "The Small Business Incubator Industry: Micro-Level Economic Development," Economic Development Quarterly, , vol. 1(2), pages 178-191, May.
    5. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    6. Clemente J. Navarro Yáñez & Annick Magnier & M. Antonia Ramírez, 2008. "Local Governance as Government–Business Cooperation in Western Democracies: Analysing Local and Intergovernmental Effects by Multi‐Level Comparison," International Journal of Urban and Regional Research, Wiley Blackwell, vol. 32(3), pages 531-547, September.
    7. Richard Blundell & Monica Costa Dias, 2000. "Evaluation methods for non-experimental data," Fiscal Studies, Institute for Fiscal Studies, vol. 21(4), pages 427-468, January.
    8. Shiuh-Shen Chien & Ian Gordon, 2008. "Territorial Competition in China and the West," Regional Studies, Taylor & Francis Journals, vol. 42(1), pages 31-49.
    9. Cynthia L. Rogers & Jill L. Tao, 2004. "Quasi-Experimental Analysis of Targeted Economic Development Programs: Lessons from Florida," Economic Development Quarterly, , vol. 18(3), pages 269-285, August.
    10. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    11. Lijphart, Arend, 1971. "Comparative Politics and the Comparative Method," American Political Science Review, Cambridge University Press, vol. 65(3), pages 682-693, September.
    12. Peter Bearse, 1998. "A Question of Evaluation: NBIA's Impact Assessment of Business Incubators," Economic Development Quarterly, , vol. 12(4), pages 322-333, November.
    13. Rhonda Phillips, 2002. "Note: Evaluating Community Economic Development Planning Programs with a Small Number of Participants: A Non‐Parametric Approach," Growth and Change, Wiley Blackwell, vol. 33(4), pages 497-512, September.
    14. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    15. Aruna Chandra & Wei He & Tim Fealey, 2007. "Business Incubators in China: A Financial Services Perspective," Asia Pacific Business Review, Taylor & Francis Journals, vol. 13(1), pages 79-94, January.
    16. Reed, W. Robert & Rogers, Cynthia L., 2003. "A study of quasi-experimental control group methods for estimating policy impacts," Regional Science and Urban Economics, Elsevier, vol. 33(1), pages 3-25, January.
    17. Rephann, Terance & Isserman, Andrew, 1994. "New highways as economic development tools: An evaluation using quasi-experimental matching methods," Regional Science and Urban Economics, Elsevier, vol. 24(6), pages 723-751, December.
    18. Rudy Aernoudt, 2004. "Incubators: Tool for Entrepreneurship?," Small Business Economics, Springer, vol. 23(2), pages 127-135, September.
    19. Dylan Sutherland, 2005. "China's Science Parks: Production Bases or a Tool for Institutional Reform?," Asia Pacific Business Review, Taylor & Francis Journals, vol. 11(1), pages 83-104, March.
    20. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    21. Georghiou, Luke & Roessner, David, 2000. "Evaluating technology programs: tools and methods," Research Policy, Elsevier, vol. 29(4-5), pages 657-678, April.
    22. Storey, D. J. & Tether, B. S., 1998. "Public policy measures to support new technology-based firms in the European Union," Research Policy, Elsevier, vol. 26(9), pages 1037-1057, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:rri:wpaper:201004 is not listed on IDEAS
    2. repec:rri:wpaper:201006 is not listed on IDEAS
    3. Junbo Yu & Mark Middleton & Randall Jackson, 2010. "Toward the Geography of Business Incubator Formation in the United States," Working Papers Working Paper 2010-06, Regional Research Institute, West Virginia University.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    6. repec:rri:wpaper:201010 is not listed on IDEAS
    7. Junbo Yu & Mark Middleton & Randall Jackson, 2010. "Geography of Business Incubator Formation in the United States," Working Papers Working Paper 2010-10, Regional Research Institute, West Virginia University.
    8. Junbo, Y. & Stough, R.R. & Nijkamp, P., 2008. "Governing Technological Entrepreneurship in China and the West," Serie Research Memoranda 0019, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    9. Denis Conniffe & Vanessa Gash & Philip J. O'Connell, 2000. "Evaluating State Programmes - “Natural Experiments” and Propensity Scores," The Economic and Social Review, Economic and Social Studies, vol. 31(4), pages 283-308.
    10. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    11. Michael Lechner, 2004. "Sequential Matching Estimation of Dynamic Causal Models," University of St. Gallen Department of Economics working paper series 2004 2004-06, Department of Economics, University of St. Gallen.
    12. Jian Zhou & Daniel P. McMillen & John F. McDonald, 2008. "Land Values and the 1957 Comprehensive Amendment to the Chicago Zoning Ordinance," Urban Studies, Urban Studies Journal Limited, vol. 45(8), pages 1647-1661, July.
    13. Jose C. Galdo & Jeffrey Smith & Dan Black, 2008. "Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data," Annals of Economics and Statistics, GENES, issue 91-92, pages 189-216.
    14. Alm, Bastian & Bade, Franz-Josef, 2009. "The impact of firm subsidies: Evaluating German regional policy," EconStor Preprints 103402, ZBW - Leibniz Information Centre for Economics.
    15. Bernhard Dachs & Bernd Ebersberger, 2009. "Does foreign ownership matter for the innovative activities of enterprises?," International Economics and Economic Policy, Springer, vol. 6(1), pages 41-57, June.
    16. Peter Z. Schochet & Ronald D'Amico & Jillian Berk & Nathan Wozny, "undated". "Methodological Notes Regarding the Impact Analysis," Mathematica Policy Research Reports 0b22093bbd87457c9ae4125d0, Mathematica Policy Research.
    17. Denis Conniffe & Vanessa Gash & Philip J., 2000. "Evaluating Programmes: Experiments, Non-Experiments and Propensity Scores," Papers WP126, Economic and Social Research Institute (ESRI).
    18. repec:mpr:mprres:7734 is not listed on IDEAS
    19. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    20. Schwartz, Michael & Göthner, Maximilian, 2009. "A Novel Approach to Incubator Evaluations: The PROMETHEE Outranking Procedures," IWH Discussion Papers 1/2009, Halle Institute for Economic Research (IWH).
    21. Spitz, Alexandra, 2004. "Using Methods of Treatment Evaluation to Estimate the Wage Effect of IT Usage," ZEW Discussion Papers 04-67, ZEW - Leibniz Centre for European Economic Research.
    22. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    23. Torsten Persson & Guido Tabellini & Francesco Trebbi, 2003. "Electoral Rules and Corruption," Journal of the European Economic Association, MIT Press, vol. 1(4), pages 958-989, June.
    24. Jean-Pierre Florens & James Heckman & Costas Meghir & Edward Vytlacil, 2002. "Instrumental variables, local instrumental variables and control functions," CeMMAP working papers CWP15/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Keywords

    entrepreneurship; business incubation; regional development;
    All these keywords.

    JEL classification:

    • R5 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Regional Government Analysis
    • R11 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Regional Economic Activity: Growth, Development, Environmental Issues, and Changes
    • R58 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Regional Government Analysis - - - Regional Development Planning and Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rri:wpaper:2010wp04. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Randall Jackson (email available below). General contact details of provider: https://edirc.repec.org/data/rrwvuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.