IDEAS home Printed from https://ideas.repec.org/a/eee/jcecon/v49y2021i1p1-21.html
   My bibliography  Save this article

The politics of experimentation: Political competition and randomized controlled trials

Author

Listed:
  • Corduneanu-Huci, Cristina
  • Dorsch, Michael T.
  • Maarek, Paul

Abstract

This paper provides an analysis of how political factors affect the incidence of the evaluation of public policies, with a focus on Randomized Control Trial (RCT) experiments in international development. We argue that political environments where incumbents face greater electoral competition and smaller ruling margins are more likely to host RCT experiments. Using various data sources for the incidence of RCTs both at the cross-country level and at the sub-national level in India, we find that RCTs are more likely to occur in politically competitive jurisdictions. We employ fixed effects regressions using various estimators and an instrumental variable strategy that exploits an electoral reform in India which limited the entry of independent candidates and exogenously affected the degree of electoral competition in state-level politics. The effect seems concentrated on RCTs that have the government as a partner, suggesting that political competition has an important demand-side effect on the incidence of RCTs.

Suggested Citation

  • Corduneanu-Huci, Cristina & Dorsch, Michael T. & Maarek, Paul, 2021. "The politics of experimentation: Political competition and randomized controlled trials," Journal of Comparative Economics, Elsevier, vol. 49(1), pages 1-21.
  • Handle: RePEc:eee:jcecon:v:49:y:2021:i:1:p:1-21
    DOI: 10.1016/j.jce.2020.09.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0147596720300652
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jce.2020.09.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    2. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    3. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    4. Bouguen, Adrien & Huang, Yue & Kremer, Michael & Miguel, Edward, 2018. "Using Rcts to Estimate Long-Run Impacts in Development Economics," Department of Economics, Working Paper Series qt4sk6c4f7, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    5. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
    6. Leonard Wantchekon, 2003. "Clientelism and voting behavior: Evidence from a field experiment in benin," Natural Field Experiments 00339, The Field Experiments Website.
    7. Abhijit V. Banerjee & Esther Duflo, 2014. "Do Firms Want to Borrow More? Testing Credit Constraints Using a Directed Lending Program," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 572-607.
    8. Bruno, Giovanni S.F., 2005. "Approximating the bias of the LSDV estimator for dynamic unbalanced panel data models," Economics Letters, Elsevier, vol. 87(3), pages 361-366, June.
    9. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2016. "Building State Capacity: Evidence from Biometric Smartcards in India," American Economic Review, American Economic Association, vol. 106(10), pages 2895-2929, October.
    10. Eva Vivalt, 0. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
    11. Blundell, Richard & Bond, Stephen, 1998. "Initial conditions and moment restrictions in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 87(1), pages 115-143, August.
    12. Sylvain Chassang & Gerard Padro I Miquel & Erik Snowberg, 2012. "Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments," American Economic Review, American Economic Association, vol. 102(4), pages 1279-1309, June.
    13. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    14. James H. Stock & Motohiro Yogo, 2002. "Testing for Weak Instruments in Linear IV Regression," NBER Technical Working Papers 0284, National Bureau of Economic Research, Inc.
    15. Leonard Wantchekon & Jenny Guardado R., 2011. "Methodology Update: Randomised Controlled Trials, Structural Models and the Study of Politics-super- †," Journal of African Economies, Centre for the Study of African Economies, vol. 20(4), pages 653-672, August.
    16. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    17. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    18. Eva Vivalt, 2020. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
    19. Siwan Anderson & Patrick Francois & Ashok Kotwal, 2015. "Clientelism in Indian Villages," American Economic Review, American Economic Association, vol. 105(6), pages 1780-1816, June.
    20. Kapoor, Sacha & Magesan, Arvind, 2018. "Independent Candidates and Political Representation in India," American Political Science Review, Cambridge University Press, vol. 112(3), pages 678-697, August.
    21. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    22. Adrien Bouguen & Yue Huang & Michael Kremer & Edward Miguel, 2019. "Using Randomized Controlled Trials to Estimate Long-Run Impacts in Development Economics," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 523-561, August.
    23. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    24. Das, Sabyasachi, 2020. "(Don’t) leave politics out of it: Reflections on public policies, experiments, and interventions," World Development, Elsevier, vol. 127(C).
    25. Lant Pritchett, Justin Sandefur, 2013. "Context Matters for Size: Why External Validity Claims and Development Practice Don't Mix-Working Paper 336," Working Papers 336, Center for Global Development.
    26. Lant Pritchett, 2002. "It pays to be ignorant: A simple political economy of rigorous program evaluation," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 5(4), pages 251-269.
    27. De La O,Ana Lorena, 2015. "Crafting Policies to End Poverty in Latin America," Cambridge Books, Cambridge University Press, number 9781107089488, September.
    28. Drew B. Cameron & Anjini Mishra & Annette N. Brown, 2016. "The growth of impact evaluation for international development: how much have we learned?," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(1), pages 1-21, March.
    29. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    30. Judson, Ruth A. & Owen, Ann L., 1999. "Estimating dynamic panel data models: a guide for macroeconomists," Economics Letters, Elsevier, vol. 65(1), pages 9-15, October.
    31. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    2. Dur, Robert & Non, Arjan & Prottung, Paul & Ricci, Benedetta, 2023. "Who's Afraid of Policy Experiments?," OSF Preprints yshkt, Center for Open Science.
    3. Centofanti, Tiziana & Murugesan, Anand, 2022. "Leader and citizens participation for the environment: Experimental evidence from Eastern Europe," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    4. Obie Porteous, 2022. "Research Deserts and Oases: Evidence from 27 Thousand Economics Journal Articles on Africa," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1235-1258, December.
    5. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    6. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-03623394, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cristina Corduneanu-Huci & Michael T. Dorsch & Paul Maarek, 2017. "Learning to constrain: Political competition and randomized controlled trials in development," THEMA Working Papers 2017-24, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    2. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    3. Eicher, Theo S. & Schreiber, Till, 2010. "Structural policies and growth: Time series evidence from a natural experiment," Journal of Development Economics, Elsevier, vol. 91(1), pages 169-179, January.
    4. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    5. Dorothée Charlier & Mouez Fodha & Djamel Kirat, 2023. "Residential CO2 Emissions in Europe and Carbon Taxation: A Country-Level Assessment," The Energy Journal, , vol. 44(5), pages 187-206, September.
    6. Mahir Binici & Yin-Wong Cheung & Kon S. Lai, 2011. "Trade Openness, Market Competition, and Inflation: Some Sectoral Evidence from OECD Countries," CESifo Working Paper Series 3690, CESifo.
    7. Garita, Gus, 2009. "How Does Financial Openness Affect Economic Growth and its Components?," MPRA Paper 20099, University Library of Munich, Germany.
    8. Matteo Lanzafame, 2014. "The balance of payments-constrained growth rate and the natural rate of growth: new empirical evidence," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 38(4), pages 817-838.
    9. Gehringer, Agnieszka & Prettner, Klaus, 2019. "Longevity And Technological Change," Macroeconomic Dynamics, Cambridge University Press, vol. 23(4), pages 1471-1503, June.
    10. Ibrahim, Mansor H. & Salim, Kinan & Abojeib, Moutaz & Yeap, Lau Wee, 2019. "Structural changes, competition and bank stability in Malaysia’s dual banking system," Economic Systems, Elsevier, vol. 43(1), pages 111-129.
    11. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    12. Özlem Onaran & Valerie Boesch, 2014. "The Effect of Globalization on the Distribution of Taxes and Social Expenditures in Europe: Do Welfare State Regimes Matter?," Environment and Planning A, , vol. 46(2), pages 373-397, February.
    13. Kufenko, Vadim & Prettner, Klaus, 2016. "You can't always get what you want? Estimator choice and the speed of convergence," Hohenheim Discussion Papers in Business, Economics and Social Sciences 20-2016, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    14. Alberini, Anna & Filippini, Massimo, 2011. "Response of residential electricity demand to price: The effect of measurement error," Energy Economics, Elsevier, vol. 33(5), pages 889-895, September.
    15. Kufenko, Vadmin & Prettner, Klaus, 2017. "You can't always get what you want? A Monte Carlo analysis of the bias and the efficiency of dynamic panel data estimators," ECON WPS - Working Papers in Economic Theory and Policy 07/2017, TU Wien, Institute of Statistics and Mathematical Methods in Economics, Economics Research Unit.
    16. Kilman, Josefin, 2020. "Monetary Policy and Income Inequality in the United States: The Role of Labor Unions," Working Papers 2020:10, Lund University, Department of Economics, revised 20 Sep 2022.
    17. Chang, Chun Ping & Berdiev, Aziz N., 2011. "The political economy of energy regulation in OECD countries," Energy Economics, Elsevier, vol. 33(5), pages 816-825, September.
    18. Vadim Kufenko & Klaus Prettner, 2021. "Do you know your biases? A Monte Carlo analysis of dynamic panel data estimators," Department of Economics Working Papers wuwp316, Vienna University of Economics and Business, Department of Economics.
    19. Capelle-Blancard, Gunther & Crifo, Patricia & Diaye, Marc-Arthur & Oueghlissi, Rim & Scholtens, Bert, 2019. "Sovereign bond yield spreads and sustainability: An empirical analysis of OECD countries," Journal of Banking & Finance, Elsevier, vol. 98(C), pages 156-169.
    20. Merike Kukk & Karsten Staehr, 2017. "Macroeconomic Factors in the Dynamics of Corporate and Household Saving: Evidence from Central and Eastern Europe," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 53(11), pages 2585-2608, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jcecon:v:49:y:2021:i:1:p:1-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622864 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.