IDEAS home Printed from https://ideas.repec.org/p/col/000089/018366.html

To Kill a Black Swan: The Credibility Revolution at CEDE, 2000-2018

Author

Listed:
  • Juan Pablo Castilla

Abstract

The growing displacement of theory and other forms of wide-ranging knowledge of social phenomena by empirical research methods in economics is widely noted by economists and historians of economic knowledge. Less attention has been devoted, however, to understand the materialization of such changes in the scientific practices in a specific research center. This article studies the recent transformations in the epistemological practices at CEDE, a research center that is both, highly influential in the production of economic knowledge in Colombia, and does not belong to the core economics research centers that lead the debates regarding the recent changes in the discipline. I use a machine learning technique called Topic Modeling, interviews to CEDE researchers, and exegesis of papers to identify a shift in the production of knowledge in microeconometrics at CEDE during the years 2000 and 2018. I explain this shift by characterizing two sets of epistemological practices. The first one, usually present during the years 2000 and 2006, establishes a complementary relationship between wide-ranging knowledge (theory included) and data estimation techniques in order to achieve a broad comprehension of the phenomenon under study. The second one, usually present during the years 2009 and 2018, prioritizes data estimation techniques over theoretical models and contextual knowledge in order to achieve a causal comprehension of one variable in the phenomenon under study. Because epistemological practices make truth claims, each one establishes its own criteria about what constitutes a valid research through a distinct way of replicating a scientific experiment. The shift I identify implies a recent tendency to disdain research works that cannot make a strong causal inference.

Suggested Citation

  • Juan Pablo Castilla, 2020. "To Kill a Black Swan: The Credibility Revolution at CEDE, 2000-2018," Documentos CEDE 18366, Universidad de los Andes, Facultad de Economía, CEDE.
  • Handle: RePEc:col:000089:018366
    as

    Download full text from publisher

    File URL: https://repositorio.uniandes.edu.co/bitstream/handle/1992/45870/dcede2020-35.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Baez, Javier E. & Camacho, Adriana, 2011. "Assessing the Long-term Effects of Conditional Cash Transfers on Human Capital: Evidence from Colombia," IZA Discussion Papers 5751, IZA Network @ LISER.
    2. Mirko Draca & Stephen Machin & Robert Witt, 2011. "Panic on the Streets of London: Police, Crime, and the July 2005 Terror Attacks," American Economic Review, American Economic Association, vol. 101(5), pages 2157-2181, August.
    3. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 69-85, Fall.
    4. Daron Acemoglu & Leopoldo Fergusson & Simon Johnson, 2017. "Population and Civil War," NBER Working Papers 23322, National Bureau of Economic Research, Inc.
    5. Judith Favereau, 2016. "On the Analogy between Field Experiments in Economics and Clinical Trials in Medicine," Post-Print hal-02092631, HAL.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    7. Joel Isaac, 2010. "Tool Shock: Technique and Epistemology in the Postwar Social Sciences," History of Political Economy, Duke University Press, vol. 42(5), pages 133-164, Supplemen.
    8. Hahn, Frank, 1986. "Conversations with Economists: New Classical Economists and Opponents Speak Out on the Current Controversy in Macroeconomics, Arjo Klamer, Totowa, N.J.: Rowman and Allanheld, 1983, 278 pages," Economics and Philosophy, Cambridge University Press, vol. 2(2), pages 275-282, October.
    9. Guillermo Perry, 2013. "Regional Public Goods in Finance, Trade and Infrastructure," Documentos CEDE 11888, Universidad de los Andes, Facultad de Economía, CEDE.
    10. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    11. Bernal Raquel, 2003. "Monetary Policy Rules in Colombia," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE.
    12. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    13. Ana María Ibánez L. & Christian Jaramillo H., 2006. "Oportunidades de desarrollo económico en el posconflicto: propuesta de política," Coyuntura Económica, Fedesarrollo.
    14. Judith Favereau, 2016. "On the Analogy between Field Experiments in Economics and Clinical Trials in Medicine," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-02092631, HAL.
    15. Verena Halsmayer, 2014. "From Exploratory Modeling to Technical Expertise: Solow’s Growth Model as a Multipurpose Design," History of Political Economy, Duke University Press, vol. 46(5), pages 229-251, Supplemen.
    16. repec:ack:journl:y::id:144 is not listed on IDEAS
    17. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    18. Sent,Esther-Mirjam, 2006. "The Evolving Rationality of Rational Expectations," Cambridge Books, Cambridge University Press, number 9780521027717.
    19. Bjerkholt, Olav, 2015. "Trygve Haavelmo At The Cowles Commission," Econometric Theory, Cambridge University Press, vol. 31(1), pages 1-84, February.
    20. Angela Ambrosino & Mario Cedrini & John B. Davis & Stefano Fiori & Marco Guerzoni & Massimiliano Nuccio, 2018. "What topic modeling could reveal about the evolution of economics," Journal of Economic Methodology, Taylor & Francis Journals, vol. 25(4), pages 329-348, October.
    21. Leopoldo Fergusson & Carlos Molina & James A. Robinson & Juan F. Vargas, 2017. "The Long Shadow of the Past: Political Economy of Regional Inequality in Colombia," Documentos CEDE 15445, Universidad de los Andes, Facultad de Economía, CEDE.
    22. Adriana Camacho, 2008. "Stress and Birth Weight: Evidence from Terrorist Attacks," American Economic Review, American Economic Association, vol. 98(2), pages 511-515, May.
    23. Di Tella, Rafael & Edwards, Sebastian & Schargrodsky, Ernesto (ed.), 2010. "The Economics of Crime," National Bureau of Economic Research Books, University of Chicago Press, number 9780226153742, August.
    24. McAleer, Michael & Veall, Michael R, 1989. "How Fragile Are Fragile Inferences? A Re-evaluation of the Deterrent Effect of Capital Punishment," The Review of Economics and Statistics, MIT Press, vol. 71(1), pages 99-106, February.
    25. Adriana Camacho, 2007. "Stress and birth outcomes: evidence from terrorist attacks in Colombia," Documentos CEDE 4014, Universidad de los Andes, Facultad de Economía, CEDE.
    26. repec:ack:journl:y::id:220 is not listed on IDEAS
    27. Daron Acemoglu & Leopoldo Fergusson & James Robinson & Dario Romero & Juan F. Vargas, 2020. "The Perils of High-Powered Incentives: Evidence from Colombia's False Positives," American Economic Journal: Economic Policy, American Economic Association, vol. 12(3), pages 1-43, August.
    28. repec:ack:journl:y::id:91 is not listed on IDEAS
    29. Felipe Barrera & Ana MarÔøΩa IbÔøΩÔøΩez, 2004. "Does Violence Reduce Investment In Education?: A Theoretical And Empirical Approach," Documentos CEDE 2382, Universidad de los Andes, Facultad de Economía, CEDE.
    30. Editorial Article, 0. "The Information for Authors," Economics of Contemporary Russia, Regional Public Organization for Assistance to the Development of Institutions of the Department of Economics of the Russian Academy of Sciences, issue 1.
    31. Daron Acemoglu & James A. Robinson & Rafael J. Santos, 2013. "The Monopoly Of Violence: Evidence From Colombia," Journal of the European Economic Association, European Economic Association, vol. 11, pages 5-44, January.
    32. Ehrlich, Isaac, 1975. "The Deterrent Effect of Capital Punishment: A Question of Life and Death," American Economic Review, American Economic Association, vol. 65(3), pages 397-417, June.
    33. Ross Emmett, 2007. "Oral History and the Historical Reconstruction of Chicago Economics," History of Political Economy, Duke University Press, vol. 39(5), pages 172-192, Supplemen.
    34. Judith Favereau, 2016. "On the analogy between field experiments in economics and clinical trials in medicine," Journal of Economic Methodology, Taylor & Francis Journals, vol. 23(2), pages 203-222, June.
    35. repec:ack:journl:y::id:108 is not listed on IDEAS
    36. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    37. Alberto Carrasquilla & Arturo Galindo, 2002. "Efectos En Bienestar De La Represi√Ìn Financiera," Documentos CEDE 2429, Universidad de los Andes, Facultad de Economía, CEDE.
    38. McManus, Walter S, 1985. "Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs," Journal of Political Economy, University of Chicago Press, vol. 93(2), pages 417-425, April.
    39. repec:fth:prinin:455 is not listed on IDEAS
    40. Joshua D. Angrist & Jörn-Steffen Pischke, 2015. "The path from cause to effect: mastering 'metrics," CentrePiece - The magazine for economic performance 442, Centre for Economic Performance, LSE.
    41. repec:ack:journl:y::id:50 is not listed on IDEAS
    42. Editorial Article, 0. "The Information for Authors," Economics of Contemporary Russia, Regional Public Organization for Assistance to the Development of Institutions of the Department of Economics of the Russian Academy of Sciences, issue 2.
    43. Morgan,Mary S., 2012. "The World in the Model," Cambridge Books, Cambridge University Press, number 9781107002975.
    44. Joshua Angrist & Alan Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Working Papers 834, Princeton University, Department of Economics, Industrial Relations Section..
    45. Morgan,Mary S., 2012. "The World in the Model," Cambridge Books, Cambridge University Press, number 9780521176194.
    46. Thomas A. Stapleford, 2017. "Historical Epistemology and the History of Economics:Views Through the Lens of Practice," Research in the History of Economic Thought and Methodology, in: Including a Symposium on the Historical Epistemology of Economics, volume 35, pages 113-145, Emerald Group Publishing Limited.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali, Saleem H., 2020. "Environmental urgency versus the allure of RCT empiricism," World Development, Elsevier, vol. 127(C).
    2. Brett Parker, 2021. "Death Penalty Statutes and Murder Rates: Evidence From Synthetic Controls," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 18(3), pages 488-533, September.
    3. Michel De Vroey & Luca Pensieroso, 2016. "The Rise of a Mainstream in Economics," LIDAM Discussion Papers IRES 2016026, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    4. KAMKOUM, Arnaud Cedric, 2023. "The Federal Reserve’s Response to the Global Financial Crisis and its Effects: An Interrupted Time-Series Analysis of the Impact of its Quantitative Easing Programs," Thesis Commons d7pvg, Center for Open Science.
    5. Katherine Sawyer & Kathleen Gallagher Cunningham & William Reed, 2017. "The Role of External Support in Civil War Termination," Journal of Conflict Resolution, Peace Science Society (International), vol. 61(6), pages 1174-1202, July.
    6. Öberg, Stefan, 2018. "Instrumental variables based on twin births are by definition not valid (v.3.0)," SocArXiv zux9s, Center for Open Science.
    7. Rietveld, Cornelius A. & Webbink, Dinand, 2016. "On the genetic bias of the quarter of birth instrument," Economics & Human Biology, Elsevier, vol. 21(C), pages 137-146.
    8. Paolo Pinotti, 0. "The Credibility Revolution in the Empirical Analysis of Crime," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 0, pages 1-14.
    9. Joanna M. Shepherd, 2004. "Murders of Passion, Execution Delays, and the Deterrence of Capital Punishment," The Journal of Legal Studies, University of Chicago Press, vol. 33(2), pages 283-321, June.
    10. Gebhard Kirchgässner, 2011. "Econometric Estimates of Deterrence of the Death Penalty: Facts or Ideology?," Kyklos, Wiley Blackwell, vol. 64(3), pages 448-478, August.
    11. Öberg, Stefan, 2021. "Treatment for natural experiments: How to improve causal estimates using conceptual definitions and substantive interpretations," SocArXiv pkyue, Center for Open Science.
    12. Judy L Klein, 2015. "The Cold War Hot House for Modeling Strategies at the Carnegie Institute of Technology," Working Papers Series 19, Institute for New Economic Thinking.
    13. Martin Schlotter, 2012. "Educational Production in Preschools and Schools - Microeconometric Evidence from Germany," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 41, September.
    14. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    15. Arnaud Cedric Kamkoum, 2023. "The Federal Reserve's Response to the Global Financial Crisis and Its Long-Term Impact: An Interrupted Time-Series Natural Experimental Analysis," Papers 2305.12318, arXiv.org.
    16. María Caamaño-Alegre & José Caamaño-Alegre, 2019. "Economic experiments versus physical science experiments: an ontology-based approach," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 12(2), pages 1-30, May.
    17. Kirchgässner, Gebhard, 2014. "On the Process of Scientific Policy Advice - With Special Reference to Economic Policy," Economics Working Paper Series 1438, University of St. Gallen, School of Economics and Political Science.
    18. Deepak Kumar Nepali & Keshav Lall Maharjan, 2025. "Assessing the Impact of Hermetic Storage Technology on Storage Quantity and Post-Harvest Storage Losses Among Smallholding Maize Farmers in Nepal," Agriculture, MDPI, vol. 15(2), pages 1-22, January.
    19. John Rust, 2014. "The Limits of Inference with Theory: A Review of Wolpin (2013)," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 820-850, September.
    20. Parrotta, Pierpaolo & Pozzoli, Dario & Sala, Davide, 2016. "Ethnic diversity and firms' export behavior," European Economic Review, Elsevier, vol. 89(C), pages 248-263.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • B21 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Microeconomics
    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • B30 - Schools of Economic Thought and Methodology - - History of Economic Thought: Individuals - - - General
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:col:000089:018366. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Universidad De Los Andes-Cede (email available below). General contact details of provider: https://edirc.repec.org/data/ceandco.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.