IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0329.html
   My bibliography  Save this paper

Researcher Incentives and Empirical Methods

Author

Listed:
  • Edward L. Glaeser

Abstract

Economists are quick to assume opportunistic behavior in almost every walk of life other than our own. Our empirical methods are based on assumptions of human behavior that would not pass muster in any of our models. The solution to this problem is not to expect a mass renunciation of data mining, selective data cleaning or opportunistic methodology selection, but rather to follow Leamer's lead in designing and using techniques that anticipate the behavior of optimizing researchers. In this essay, I make ten points about a more economic approach to empirical methods and suggest paths for methodological progress.

Suggested Citation

  • Edward L. Glaeser, 2006. "Researcher Incentives and Empirical Methods," NBER Technical Working Papers 0329, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberte:0329
    Note: TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0329.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Denton, Frank T, 1985. "Data Mining as an Industry," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 124-127, February.
    2. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    3. Lovell, Michael C, 1983. "Data Mining," The Review of Economics and Statistics, MIT Press, vol. 65(1), pages 1-12, February.
    4. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    5. Levine, Ross & Renelt, David, 1992. "A Sensitivity Analysis of Cross-Country Growth Regressions," American Economic Review, American Economic Association, vol. 82(4), pages 942-963, September.
    6. Sala-i-Martin, Xavier, 1997. "I Just Ran Two Million Regressions," American Economic Review, American Economic Association, vol. 87(2), pages 178-183, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alexander Frankel & Maximilian Kasy, 2022. "Which Findings Should Be Published?," American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 1-38, February.
    2. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
    3. Simonetta LONGHI & Peter NIJKAMP & Jacques POOT, 2008. "Meta-Analysis Of Empirical Evidence On The Labour Market Impacts Of Immigration," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 27, pages 161-191.
    4. Maximilian Kasy & Jann Spiess, 2022. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," Papers 2208.09638, arXiv.org, revised Oct 2023.
    5. Stephan B. Bruns, 2016. "The Fragility of Meta-Regression Models in Observational Research," MAGKS Papers on Economics 201603, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    6. Nicola Lacetera & Lorenzo Zirulia, 2011. "The Economics of Scientific Misconduct," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 27(3), pages 568-603.
    7. Haeussler, Carolin, 2011. "Information-sharing in academia and the industry: A comparative study," Research Policy, Elsevier, vol. 40(1), pages 105-122, February.
    8. Tomas Havranek & Anna Sokolova, 2016. "Do Consumers Really Follow a Rule of Thumb? Three Thousand Estimates from 130 Studies Say "Probably Not"," Working Papers 2016/08, Czech National Bank.
    9. Robert L. Obenchain & S. Stanley Young, 2017. "Local Control Strategy: Simple Analyses of Air Pollution Data Can Reveal Heterogeneity in Longevity Outcomes," Risk Analysis, John Wiley & Sons, vol. 37(9), pages 1742-1753, September.
    10. Marcel Fafchamps & Julien Labonne, 2017. "Do Politicians’ Relatives Get Better Jobs? Evidence from Municipal Elections," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 33(2), pages 268-300.
    11. Peace Karl E. & Yin JingJing & Rochani Haresh & Pandeya Sarbesh & Young Stanley, 2018. "A Serious Flaw in Nutrition Epidemiology: A Meta-Analysis Study," The International Journal of Biostatistics, De Gruyter, vol. 14(2), pages 1-10, November.
    12. Stephan B. Bruns & David I. Stern, 2015. "Meta-Granger causality testing," CAMA Working Papers 2015-22, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    13. Furman, Jeffrey L. & Jensen, Kyle & Murray, Fiona, 2012. "Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine," Research Policy, Elsevier, vol. 41(2), pages 276-290.
    14. Necker, Sarah, 2014. "Scientific misbehavior in economics," Research Policy, Elsevier, vol. 43(10), pages 1747-1759.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Afonso, António & Furceri, Davide, 2010. "Government size, composition, volatility and economic growth," European Journal of Political Economy, Elsevier, vol. 26(4), pages 517-532, December.
    2. Akçomak, I. Semih & ter Weel, Bas, 2009. "Social capital, innovation and growth: Evidence from Europe," European Economic Review, Elsevier, vol. 53(5), pages 544-567, July.
    3. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    4. Axel Dreher & Martin Gassebner & Lars-H. R. Siemers, 2007. "Does Terror Threaten Human Rights? Evidence from Panel Data," CESifo Working Paper Series 1935, CESifo.
    5. Yang, Haisheng & He, Jie & Chen, Shaoling, 2015. "The fragility of the Environmental Kuznets Curve: Revisiting the hypothesis with Chinese data via an “Extreme Bound Analysis”," Ecological Economics, Elsevier, vol. 109(C), pages 41-58.
    6. R Burger & S du Plessis, 2011. "Examining the Robustness of Competing Explanations of Slow Growth in African Countries," Studies in Economics and Econometrics, Taylor & Francis Journals, vol. 35(3), pages 21-47, December.
    7. Carmen Fernandez & Eduardo Ley & Mark F. J. Steel, 2001. "Model uncertainty in cross-country growth regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(5), pages 563-576.
    8. Martin Gassebner & Jerg Gutmann & Stefan Voigt, 2016. "When to expect a coup d’état? An extreme bounds analysis of coup determinants," Public Choice, Springer, vol. 169(3), pages 293-313, December.
    9. de Haan, Jakob & Sturm, Jan-Egbert, 2000. "On the relationship between economic freedom and economic growth," European Journal of Political Economy, Elsevier, vol. 16(2), pages 215-241, June.
    10. James Alm & Janet Rogers, 2011. "Do State Fiscal Policies Affect State Economic Growth?," Public Finance Review, , vol. 39(4), pages 483-526, July.
    11. Christian Bjørnskov & Axel Dreher & Justina Fischer, 2008. "Cross-country determinants of life satisfaction: exploring different determinants across groups in society," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 30(1), pages 119-173, January.
    12. Folster, Stefan & Henrekson, Magnus, 2001. "Growth effects of government expenditure and taxation in rich countries," European Economic Review, Elsevier, vol. 45(8), pages 1501-1520, August.
    13. Cho, Seo-Young & Dreher, Axel & Neumayer, Eric, 2013. "Does Legalized Prostitution Increase Human Trafficking?," World Development, Elsevier, vol. 41(C), pages 67-82.
    14. Klump, R. & Prüfer, P., 2006. "Prioritizing Policies for Pro-Poor Growth : Applying Bayesian Model Averaging to Vietnam," Other publications TiSEM dc14add6-f581-4eea-92dd-3, Tilburg University, School of Economics and Management.
    15. Stéphane Straub, 2000. "Factores determinantes empíricos de las buenas instituciones: ¿sabemos algo a ciencia cierta?," Research Department Publications 4216, Inter-American Development Bank, Research Department.
    16. John Inekwe, 2018. "Financial crises and the extreme bounds of predictors," Empirical Economics, Springer, vol. 55(4), pages 2047-2067, December.
    17. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    18. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    19. Bruns, Stephan B. & Ioannidis, John P.A., 2020. "Determinants of economic growth: Different time different answer?," Journal of Macroeconomics, Elsevier, vol. 63(C).
    20. Haan, Jakob de & Kooi, Willem J., 2000. "Does central bank independence really matter?: New evidence for developing countries using a new indicator," Journal of Banking & Finance, Elsevier, vol. 24(4), pages 643-664, April.

    More about this item

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0329. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.