IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/5632.html
   My bibliography  Save this paper

How can we learn whether firm policies are working in africa ? challenges (and solutions?) for experiments and structural models

Author

Listed:
  • McKenzie, David

Abstract

Firm productivity is low in African countries, prompting governments to try a number of active policies to improve it. Yet despite the millions of dollars spent on these policies, we are far from a situation where we know whether many of them are yielding the desired payoffs. This paper establishes some basic facts about the number and heterogeneity of firms in different sub-Saharan African countries and discusses their implications for experimental and structural approaches towards trying to estimate firm policy impacts. It shows that the typical firm program such as a matching grant scheme or business training program involves only 100 to 300 firms, which are often very heterogeneous in terms of employment and sales levels. As a result, standard experimental designs will lack any power to detect reasonable sized treatment impacts, while structural models which assume common production technologies and few missing markets will be ill-suited to capture the key constraints firms face. Nevertheless, the author suggests a way forward which involves focusing on a more homogeneous sub-sample of firms and collecting a lot more data on them than is typically collected.

Suggested Citation

  • McKenzie, David, 2011. "How can we learn whether firm policies are working in africa ? challenges (and solutions?) for experiments and structural models," Policy Research Working Paper Series 5632, The World Bank.
  • Handle: RePEc:wbk:wbrwps:5632
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2011/04/12/000158349_20110412081305/Rendered/PDF/WPS5632.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. David McKenzie, 2010. "Impact Assessments in Finance and Private Sector Development: What Have We Learned and What Should We Learn?," The World Bank Research Observer, World Bank, vol. 25(2), pages 209-233, August.
    3. Karlan, Dean S. & Zinman, Jonathan, 2009. "Expanding Microenterprise Credit Access: Using Randomized Supply Decisions to Estimate the Impacts in Manila," Center Discussion Papers 52600, Yale University, Economic Growth Center.
    4. Dean Karlan & Jonathan Zinman, 2010. "Expanding Credit Access: Using Randomized Supply Decisions to Estimate the Impacts," The Review of Financial Studies, Society for Financial Studies, vol. 23(1), pages 433-464, January.
    5. Fafchamps, Marcel & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2012. "Using PDA consistency checks to increase the precision of profits and sales measurement in panels," Journal of Development Economics, Elsevier, vol. 98(1), pages 51-57.
    6. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    7. Harrison, Ann E. & Lin, Justin Yifu & Xu, Lixin Colin, 2014. "Explaining Africa’s (Dis)advantage," World Development, Elsevier, vol. 63(C), pages 59-77.
    8. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    9. T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5.
    10. Petra E. Todd & Kenneth I. Wolpin, 2010. "Structural Estimation and Policy Evaluation in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 21-50, September.
    11. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 423-423.
    12. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    13. Lars Ivar Oppedal Berge & Kjetil Bjorvatn & Bertil Tungodden, 2015. "Human and Financial Capital for Microenterprise Development: Evidence from a Field and Lab Experiment," Management Science, INFORMS, vol. 61(4), pages 707-722, April.
    14. Marcel Fafchamps & David McKenzie & Simon Quinn & Christopher Woodruff, 2011. "When is capital enough to get female microenterprises growing? Evidence from a randomized experiment in Ghana," CSAE Working Paper Series 2011-11, Centre for the Study of African Economies, University of Oxford.
    15. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    16. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    17. James Levinsohn & Amil Petrin, 2003. "Estimating Production Functions Using Inputs to Control for Unobservables," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(2), pages 317-341.
    18. Michiel VAN Dijk, 2003. "South African Manufacturing Performance In International Perspective 1970–1999," South African Journal of Economics, Economic Society of South Africa, vol. 71(1), pages 119-142, March.
    19. Ravallion Martin, 2009. "Should the Randomistas Rule?," The Economists' Voice, De Gruyter, vol. 6(2), pages 1-5, February.
    20. David McKenzie & Michaela Weber, 2009. "The Results of a Pilot Financial Literacy and Business Planning Training Program for Women in Uganda," World Bank Publications - Reports 10230, The World Bank Group.
    21. Joseph P. Kaboski & Robert M. Townsend, 2011. "A Structural Evaluation of a Large‐Scale Quasi‐Experimental Microfinance Initiative," Econometrica, Econometric Society, vol. 79(5), pages 1357-1406, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Miriam Bruhn & David McKenzie, 2014. "Entry Regulation and the Formalization of Microenterprises in Developing Countries," The World Bank Research Observer, World Bank, vol. 29(2), pages 186-201.
    2. Ondřej Dvouletý & Stjepan Srhoj & Smaranda Pantea, 2021. "Public SME grants and firm performance in European Union: A systematic review of empirical evidence," Small Business Economics, Springer, vol. 57(1), pages 243-263, June.
    3. McKenzie, David, 2016. "Can Business Owners Form Accurate Counterfactuals? Eliciting Treatment and Control Beliefs about Their Outcomes in the Alternat," CEPR Discussion Papers 11280, C.E.P.R. Discussion Papers.
    4. Wim Naudé, 2011. "Foreign Aid for Innovation: The Missing Ingredient in Private Sector Development?," Working Papers 2011/35, Maastricht School of Management.
    5. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    6. Axel Demenet, 2016. "Does Managerial Capital also Matter Among Micro and Small Firms in Developing Countries?," Working Papers DT/2016/12, DIAL (Développement, Institutions et Mondialisation).
    7. Túlio A. Cravo & Caio Piza, 2019. "The impact of business-support services on firm performance: a meta-analysis," Small Business Economics, Springer, vol. 53(3), pages 753-770, October.
    8. Campos, Francisco & Coville, Aidan & Fernandes, Ana M. & Goldstein, Markus & McKenzie, David, 2014. "Learning from the experiments that never happened: Lessons from trying to conduct randomized evaluations of matching grant programs in Africa," Journal of the Japanese and International Economies, Elsevier, vol. 33(C), pages 4-24.
    9. Long Thanh Giang & Cuong Viet Nguyen & Tuyen Quang Tran, 2016. "Firm agglomeration and local poverty reduction: evidence from an economy in transition," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 30(1), pages 80-98, May.
    10. Long Thanh Giang & Cuong Viet Nguyen & Tuyen Quang Tran, 2015. "A Linkage between Firm Agglomeration and Poverty Reduction First evidence in Vietnam," Working Papers 2015-617, Department of Research, Ipag Business School.
    11. Szirmai A. & Gebreeyesus M. & Guadagno F. & Verspagen B., 2013. "Promoting productive employment in Sub‐Saharan Africa : a review of the literature," MERIT Working Papers 2013-062, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    12. Kersten, Renate & Harms, Job & Liket, Kellie & Maas, Karen, 2017. "Small Firms, large Impact? A systematic review of the SME Finance Literature," World Development, Elsevier, vol. 97(C), pages 330-348.
    13. Lauro Gonzalez & Caio Piza & Tulio Cravo & Samer Abdelnour & Linnet Taylor, 2014. "Protocol for a Systematic Review: The Impacts of Business Support Services for Small and Medium Enterprises on Firm Performance in Low‐and Middle‐Income Countries: A Systematic Review," Campbell Systematic Reviews, John Wiley & Sons, vol. 10(1), pages 1-46.
    14. Evans Mwasiaji, 2020. "Quality Imperative Value Addition and the Performance of Medium Scale Manufacturing Enterprises in Kenya," Journal of Accounting, Business and Finance Research, Scientific Publishing Institute, vol. 8(1), pages 39-46.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    2. Marcel Fafchamps & David McKenzie & Simon Quinn & Christopher Woodruff, 2011. "When is capital enough to get female microenterprises growing? Evidence from a randomized experiment in Ghana," CSAE Working Paper Series 2011-11, Centre for the Study of African Economies, University of Oxford.
    3. Fafchamps, Marcel & McKenzie, David & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2011. "When is capital enough to get female enterprises growing ? evidence from a randomized experiment in Ghana," Policy Research Working Paper Series 5706, The World Bank.
    4. Karlan, Dean S. & Knight, Ryan & Udry, Christopher R., 2012. "Hoping to Win, Expected to Lose: Theory and Lessons on Micro Enterprise Development," Center Discussion Papers 133405, Yale University, Economic Growth Center.
    5. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    6. Marshall Burke & Lauren Falcao Bergquist & Edward Miguel, 2019. "Sell Low and Buy High: Arbitrage and Local Price Effects in Kenyan Markets," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 785-842.
    7. Brune, Lasse & Gine, Xavier & Goldberg, Jessica & Yang, Dean, 2011. "Commitments to save : a field experiment in rural Malawi," Policy Research Working Paper Series 5748, The World Bank.
    8. Campos, Francisco & Coville, Aidan & Fernandes, Ana M. & Goldstein, Markus & McKenzie, David, 2014. "Learning from the experiments that never happened: Lessons from trying to conduct randomized evaluations of matching grant programs in Africa," Journal of the Japanese and International Economies, Elsevier, vol. 33(C), pages 4-24.
    9. Michael Kremer & Jonathan Robinson & Olga Rostapshova, 2014. "Success in Entrepreneurship: Doing the Math," NBER Chapters, in: African Successes, Volume II: Human Capital, pages 281-303, National Bureau of Economic Research, Inc.
    10. Gabriela Calderon & Jesse M. Cunha & Giacomo De Giorgi, 2020. "Business Literacy and Development: Evidence from a Randomized Controlled Trial in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 68(2), pages 507-540.
    11. de Mel, Suresh & McKenzie, David & Woodruff, Christopher, 2014. "Business training and female enterprise start-up, growth, and dynamics: Experimental evidence from Sri Lanka," Journal of Development Economics, Elsevier, vol. 106(C), pages 199-210.
    12. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    13. Claudia Custodio & Diogo Mendes & Daniel Metzger, 2021. "The impact of financial education of executives on financial practices of medium and large enterprises," NOVAFRICA Working Paper Series wp2105, Universidade Nova de Lisboa, Nova School of Business and Economics, NOVAFRICA.
    14. Antonia Grohmann & Lukas Menkhoff & Helke Seitz, 2022. "The Effect of Personalized Feedback on Small Enterprises’ Finances in Uganda," Economic Development and Cultural Change, University of Chicago Press, vol. 70(3), pages 1197-1227.
    15. David McKenzie & Dean Yang, 2012. "Experimental Approaches in Migration Studies," Chapters, in: Carlos Vargas-Silva (ed.), Handbook of Research Methods in Migration, chapter 12, Edward Elgar Publishing.
    16. Beaman, Lori & Magruder, Jeremy & Robinson, Jonathan, 2014. "Minding small change among small firms in Kenya," Journal of Development Economics, Elsevier, vol. 108(C), pages 69-86.
    17. Thorsten Beck & Haki Pamuk & Burak R. Uras, 2017. "Entrepreneurial Saving Practices and Reinvestment: Theory and Evidence," Review of Development Economics, Wiley Blackwell, vol. 21(4), pages 1205-1228, November.
    18. Xu, Lisa & Zia, Bilal, 2012. "Financial literacy around the world : an overview of the evidence with practical suggestions for the way forward," Policy Research Working Paper Series 6107, The World Bank.
    19. Prof dr Erik Stam & Felix Meier zu Selhausen, MSc MA, 2014. "Husbands and Wives. The powers and perils of participation in a microfinance cooperative for female entrepreneurs," Working Papers 2014/20, Maastricht School of Management.
    20. Axel Demenet, 2016. "Does Managerial Capital also Matter Among Micro and Small Firms in Developing Countries?," Working Papers DT/2016/12, DIAL (Développement, Institutions et Mondialisation).

    More about this item

    Keywords

    Microfinance; Small Scale Enterprise; E-Business; ICT Policy and Strategies; Banks&Banking Reform;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:5632. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.