IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/42867.html
   My bibliography  Save this paper

Can statistics do without artefacts?

Author

Listed:
  • Chatelain, Jean-Bernard

Abstract

This companion paper to Chatelain and Ralf (2012), “Spurious regressions with near-multicollinearity” put their results into the contexts of the history of statistics, of the current publication bias in applied sciences and of the substantive versus statistical significance debate. This article presents a particular case of spurious regression, when a dependent variable has a coefficient of simple correlation close to zero with two other variables, which are, on the contrary, highly correlated with each other. In these spurious regressions, the parameters measuring the size of the effect on the dependent variable are very large. They can be “statistically significant”. The tendency of scientific journals to favour the publication of statistically significant results is one reason why spurious regressions are so numerous, especially since it is easy to build them with variables that are lagged, squared or interacting with another variable. Such regressions can enhance the reputation of researchers by stimulating the appearance of strong effects between variables. These often surprising effects are not robust and often depend on a limited number of observations, fuelling scientific controversies. The resulting meta-analyses, based on statistical synthesis of the literature evaluating this effect between two variables, confirm the absence of any effect. This article provides an example of this phenomenon in the empirical literature, with the aim of evaluating the impact of development aid on economic growth.

Suggested Citation

  • Chatelain, Jean-Bernard, 2010. "Can statistics do without artefacts?," MPRA Paper 42867, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:42867
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/42867/1/MPRA_paper_42867.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    2. Chatelain, Jean-Bernard & Ralf, Kirsten, 2014. "Spurious regressions and near-multicollinearity, with an application to aid, policies and growth," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 39(A), pages 85-96.
    3. Denton, Frank T, 1985. "Data Mining as an Industry," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 124-127, February.
    4. Hristos Doucouliagos & Martin Paldam, 2010. "Conditional aid effectiveness: A meta-study," Journal of International Development, John Wiley & Sons, Ltd., vol. 22(4), pages 391-410.
    5. David Dollar & Craig Burnside, 2000. "Aid, Policies, and Growth," American Economic Review, American Economic Association, vol. 90(4), pages 847-868, September.
    6. Hristos Doucouliagos & Martin Paldam, 2009. "The Aid Effectiveness Literature: The Sad Results Of 40 Years Of Research," Journal of Economic Surveys, Wiley Blackwell, vol. 23(3), pages 433-461, July.
    7. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    8. Aldrich, J., 1995. "Correlations genuine and spurious in Pearson and Yule," Discussion Paper Series In Economics And Econometrics 9502, Economics Division, School of Social Sciences, University of Southampton.
    9. Michel Armatte, 2001. "Le statut changeant de la corrélation en économétrie (1910-1944)," Revue Économique, Programme National Persée, vol. 52(3), pages 617-631.
    10. Michel Armatte, 2001. "Le statut changeant de la corrélation en économétrie (1910-1944)," Revue économique, Presses de Sciences-Po, vol. 52(3), pages 617-631.
    11. Hoover,Kevin D., 2001. "Causality in Macroeconomics," Cambridge Books, Cambridge University Press, number 9780521002882.
    12. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    13. Søren Johansen, 2005. "Interpretation of Cointegrating Coefficients in the Cointegrated Vector Autoregressive Model," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(1), pages 93-104, February.
    14. Keuzenkamp,Hugo A., 2000. "Probability, Econometrics and Truth," Cambridge Books, Cambridge University Press, number 9780521553599.
    15. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Karim Azizi & Nicolas Canry & Jean-Bernard Chatelain & Bruno Tinel, 2013. "Government Solvency, Austerity and Fiscal Consolidation in the OECD: A Keynesian Appraisal of Transversality and No Ponzi Game Conditions," Working Papers hal-00818474, HAL.
    2. Chatelain, Jean-Bernard & Ralf, Kirsten, 2014. "Spurious regressions and near-multicollinearity, with an application to aid, policies and growth," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 39(A), pages 85-96.
    3. John Komlos, 2020. "Multicollinearity in the Presence of Errors-in-Variables Can Increase the Probability of Type-I Error," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 63(1), pages 1-17.
    4. Chatelain, Jean-Bernard & Ralf, Kirsten, 2021. "Inference on time-invariant variables using panel data: A pretest estimator," Economic Modelling, Elsevier, vol. 97(C), pages 157-166.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chatelain, Jean-Bernard & Ralf, Kirsten, 2014. "Spurious regressions and near-multicollinearity, with an application to aid, policies and growth," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 39(A), pages 85-96.
    2. Jean-Bernard Chatelain & Kirsten Ralf, 2012. "Les liaisons fallacieuses : quasi-colinéarité et « suppresseur classique », aide au développement et croissance," Revue économique, Presses de Sciences-Po, vol. 63(3), pages 557-567.
    3. Stanley, T.D. & Doucouliagos, Chris & Jarrell, Stephen B., 2008. "Meta-regression analysis as the socio-economics of economics research," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(1), pages 276-292, February.
    4. Jean-Bernard Chatelain & Kirsten Ralf, 2012. "Les liaisons fallacieuses : quasi-colinéarité et « suppresseur classique », aide au développement et croissance," Documents de travail du Centre d'Economie de la Sorbonne 12011, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    5. Clausen, Volker & Schürenberg-Frosch, Hannah, 2012. "Aid, spending strategies and productivity effects: A multi-sectoral CGE analysis for Zambia," Economic Modelling, Elsevier, vol. 29(6), pages 2254-2268.
    6. Hristos Doucouliagos & Martin Paldam, 2013. "The Robust Result in Meta-analysis of Aid Effectiveness: A Response to Mekasha and Tarp," Journal of Development Studies, Taylor & Francis Journals, vol. 49(4), pages 584-587, April.
    7. Anthony Tay & Jacques Olivier, 2008. "Time-Varying Incentives in the Mutual Fund Industry," Working Papers 10-2008, Singapore Management University, School of Economics, revised Jun 2008.
    8. Frederico Belo & Jun Li & Xiaoji Lin & Xiaofei Zhao, 2017. "Labor-Force Heterogeneity and Asset Prices: The Importance of Skilled Labor," Review of Financial Studies, Society for Financial Studies, vol. 30(10), pages 3669-3709.
    9. Christos Argyropoulos & Bertrand Candelon & Jean-Baptiste Hasse & Ekaterini Panopoulou, 2020. "Toward a Macroprudential Regulatory Framework for Mutual Funds," GRU Working Paper Series GRU_2020_008, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    10. León-González, Roberto & Montolio, Daniel, 2015. "Endogeneity and panel data in growth regressions: A Bayesian model averaging approach," Journal of Macroeconomics, Elsevier, vol. 46(C), pages 23-39.
    11. Barth, Mary E. & Konchitchki, Yaniv & Landsman, Wayne R., 2013. "Cost of capital and earnings transparency," Journal of Accounting and Economics, Elsevier, vol. 55(2), pages 206-224.
    12. Nowak-Lehmann D., Felicitas & Martínez-Zarzoso, Inmaculada & Cardozo, Adriana & Herzer, Dierk & Klasen, Stephan, 2011. "Does Aid translate into Bilateral Trade? Findings for Recipient Countries," Proceedings of the German Development Economics Conference, Berlin 2011 61, Verein für Socialpolitik, Research Committee Development Economics.
    13. Jacques Peeperkorn, 2014. "A Proposed Model to Behaviourally Pricing Risk," Journal of Economics and Behavioral Studies, AMH International, vol. 6(6), pages 477-487.
    14. Kevin Aretz & Marc Aretz, 2016. "Which stocks drive the size, value, and momentum anomalies and for how long? Evidence from a statistical leverage analysis," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 30(1), pages 19-61, February.
    15. Chichernea, Doina C. & Holder, Anthony D. & Petkevich, Alex, 2015. "Does return dispersion explain the accrual and investment anomalies?," Journal of Accounting and Economics, Elsevier, vol. 60(1), pages 133-148.
    16. Mandon, Pierre & Woldemichael, Martha Tesfaye, 2023. "Has Chinese aid benefited recipient countries? Evidence from a meta-regression analysis," World Development, Elsevier, vol. 166(C).
    17. Asgar Ali & K. N. Badhani, 2021. "Beta-Anomaly: Evidence from the Indian Equity Market," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 28(1), pages 55-78, March.
    18. Jeffrey L. Callen & Matthew R. Lyle, 2020. "The term structure of implied costs of equity capital," Review of Accounting Studies, Springer, vol. 25(1), pages 342-404, March.
    19. Core, John E. & Guay, Wayne R. & Verdi, Rodrigo, 2008. "Is accruals quality a priced risk factor?," Journal of Accounting and Economics, Elsevier, vol. 46(1), pages 2-22, September.
    20. De Giorgi, Enrico G. & Post, Thierry & Yalçın, Atakan, 2019. "A concave security market line," Journal of Banking & Finance, Elsevier, vol. 106(C), pages 65-81.

    More about this item

    Keywords

    Spurious regressions; statistical significance; near-multicollinearity; classical suppressors; growth; development aid;
    All these keywords.

    JEL classification:

    • O47 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - Empirical Studies of Economic Growth; Aggregate Productivity; Cross-Country Output Convergence
    • F35 - International Economics - - International Finance - - - Foreign Aid
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • P45 - Political Economy and Comparative Economic Systems - - Other Economic Systems - - - International Linkages
    • B16 - Schools of Economic Thought and Methodology - - History of Economic Thought through 1925 - - - Quantitative and Mathematical
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:42867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.