IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v82y2019icp100-113.html
   My bibliography  Save this article

Replication and robustness analysis of ‘energy and economic growth in the USA: A multivariate approach’

Author

Listed:
  • Bruns, Stephan B.
  • König, Johannes
  • Stern, David I.

Abstract

We replicate Stern (1993), who argues and empirically demonstrates that it is necessary (i) to use quality-adjusted energy use and (ii) to include capital and labor as control variables in order to find Granger causality from energy use to GDP. Though we could not access the original dataset, we can verify the main original inferences using data that are as close as possible to the original. We analyze the robustness of the original findings to an alternative estimation approach, alternative definitions of variables, and alternative model specifications for both the (almost) original time span (1949–1990) and an extended time span (1949–2015). p-values tend to be substantially smaller if energy use is quality adjusted rather than measured by total joules and if capital is included. Including labor has mixed results. These findings tend to largely support Stern's (1993) two main conclusions and emphasize the importance of accounting for changes in the energy mix in time series modeling of the energy-GDP relationship and controlling for other factors of production. We also discuss how the inclusion of the original author in designing the replication study using a pre-analysis plan can help to counterbalance the incentive of replicating authors to disconfirm major findings of the original article to increase the probability of getting published.

Suggested Citation

  • Bruns, Stephan B. & König, Johannes & Stern, David I., 2019. "Replication and robustness analysis of ‘energy and economic growth in the USA: A multivariate approach’," Energy Economics, Elsevier, vol. 82(C), pages 100-113.
  • Handle: RePEc:eee:eneeco:v:82:y:2019:i:c:p:100-113
    DOI: 10.1016/j.eneco.2018.10.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988318304031
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2018.10.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Perron, Pierre & Wada, Tatsuma, 2009. "Let's take a break: Trends and cycles in US real GDP," Journal of Monetary Economics, Elsevier, vol. 56(6), pages 749-765, September.
    2. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    3. Stephan B Bruns & John P A Ioannidis, 2016. "p-Curve and p-Hacking in Observational Research," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-13, February.
    4. Toda, Hiro Y. & Phillips, Peter C. B., 1993. "The spurious effect of unit roots on vector autoregressions : An analytical study," Journal of Econometrics, Elsevier, vol. 59(3), pages 229-255, October.
    5. Shahiduzzaman, Md & Alam, Khorshed, 2012. "Cointegration and causal relationships between energy consumption and output: Assessing the evidence from Australia," Energy Economics, Elsevier, vol. 34(6), pages 2182-2188.
    6. Toda, Hiro Y. & Yamamoto, Taku, 1995. "Statistical inference in vector autoregressions with possibly integrated processes," Journal of Econometrics, Elsevier, vol. 66(1-2), pages 225-250.
    7. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2015. "Replications in Economics: A Progress Report," Econ Journal Watch, Econ Journal Watch, vol. 12(2), pages 164–191-1, May.
    8. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    9. Stern, David I., 1993. "Energy and economic growth in the USA : A multivariate approach," Energy Economics, Elsevier, vol. 15(2), pages 137-150, April.
    10. Pfaff, Bernhard, 2008. "VAR, SVAR and SVEC Models: Implementation Within R Package vars," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i04).
    11. Stern, David I., 2000. "A multivariate cointegration analysis of the role of energy in the US macroeconomy," Energy Economics, Elsevier, vol. 22(2), pages 267-283, April.
    12. Stephan B. Bruns, Christian Gross and David I. Stern, 2014. "Is There Really Granger Causality Between Energy Use and Output?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4).
    13. Rodríguez-Caballero, Carlos Vladimir & Ventosa-Santaulària, Daniel, 2017. "Energy-growth long-term relationship under structural breaks. Evidence from Canada, 17 Latin American economies and the USA," Energy Economics, Elsevier, vol. 61(C), pages 121-134.
    14. Jerry Hausman, 2001. "Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 57-67, Fall.
    15. Chiou-Wei, Song Zan & Chen, Ching-Fu & Zhu, Zhen, 2008. "Economic growth and energy consumption revisited -- Evidence from linear and nonlinear Granger causality," Energy Economics, Elsevier, vol. 30(6), pages 3063-3076, November.
    16. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    17. Nicholas Oulton, 2018. "Productivity and the Great Recession," Intereconomics: Review of European Economic Policy, Springer;ZBW - Leibniz Information Centre for Economics;Centre for European Policy Studies (CEPS), vol. 53(2), pages 63-68, March.
    18. Kilian,Lutz & Lütkepohl,Helmut, 2018. "Structural Vector Autoregressive Analysis," Cambridge Books, Cambridge University Press, number 9781107196575.
    19. Lutkepohl, Helmut, 1982. "Non-causality due to omitted variables," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 367-378, August.
    20. Leamer, Edward E & Leonard, Herman B, 1983. "Reporting the Fragility of Regression Estimates," The Review of Economics and Statistics, MIT Press, vol. 65(2), pages 306-317, May.
    21. Sebastian Galiani & Paul Gertler & Mauricio Romero, 2017. "Incentives for Replication in Economics," NBER Working Papers 23576, National Bureau of Economic Research, Inc.
    22. Stephan B. Bruns, 2017. "Meta-Regression Models and Observational Research," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(5), pages 637-653, October.
    23. Oh, Wankeun & Lee, Kihoon, 2004. "Causal relationship between energy consumption and GDP revisited: the case of Korea 1970-1999," Energy Economics, Elsevier, vol. 26(1), pages 51-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Annual Review 2018
      by noreply@blogger.com (David Stern) in Stochastic Trend on 2018-12-23 02:35:00
    2. Annual Review 2019
      by noreply@blogger.com (David Stern) in Stochastic Trend on 2019-12-25 00:24:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bruns, Stephan B. & Kalthaus, Martin, 2020. "Flexibility in the selection of patent counts: Implications for p-hacking and evidence-based policymaking," Research Policy, Elsevier, vol. 49(1).
    2. Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    3. Chen, Huangxin & Shi, Yi & Zhao, Xin, 2022. "Investment in renewable energy resources, sustainable financial inclusion and energy efficiency: A case of US economy," Resources Policy, Elsevier, vol. 77(C).
    4. T. Daniel Coggin, 2023. "CO2, SO2 and economic growth: a cross-national panel study," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 47(2), pages 437-457, June.
    5. Hoang, Thi Hong Van & Shahzad, Syed Jawad Hussain & Czudaj, Robert L., 2020. "Renewable energy consumption and industrial production: A disaggregated time-frequency analysis for the U.S," Energy Economics, Elsevier, vol. 85(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stern, David I. & Enflo, Kerstin, 2013. "Causality between energy and output in the long-run," Energy Economics, Elsevier, vol. 39(C), pages 135-146.
    2. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    3. Dagher, Leila & Yacoubian, Talar, 2012. "The causal relationship between energy consumption and economic growth in Lebanon," Energy Policy, Elsevier, vol. 50(C), pages 795-801.
    4. Stephan B. Bruns & David I. Stern, 2019. "Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models," Empirical Economics, Springer, vol. 56(3), pages 797-830, March.
    5. Stephan B. Bruns, Christian Gross and David I. Stern, 2014. "Is There Really Granger Causality Between Energy Use and Output?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4).
    6. Tang, Chor Foon & Tan, Bee Wah & Ozturk, Ilhan, 2016. "Energy consumption and economic growth in Vietnam," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 1506-1514.
    7. Yıldırım, Ertugrul & Sukruoglu, Deniz & Aslan, Alper, 2014. "Energy consumption and economic growth in the next 11 countries: The bootstrapped autoregressive metric causality approach," Energy Economics, Elsevier, vol. 44(C), pages 14-21.
    8. Shahbaz, Muhammad & Zakaria, Muhammad & Shahzad, Syed Jawad Hussain & Mahalik, Mantu Kumar, 2018. "The energy consumption and economic growth nexus in top ten energy-consuming countries: Fresh evidence from using the quantile-on-quantile approach," Energy Economics, Elsevier, vol. 71(C), pages 282-301.
    9. Salamaliki, Paraskevi K. & Venetis, Ioannis A., 2013. "Energy consumption and real GDP in G-7: Multi-horizon causality testing in the presence of capital stock," Energy Economics, Elsevier, vol. 39(C), pages 108-121.
    10. Zachariadis, Theodoros, 2007. "Exploring the relationship between energy use and economic growth with bivariate models: New evidence from G-7 countries," Energy Economics, Elsevier, vol. 29(6), pages 1233-1253, November.
    11. David I. Stern, 2010. "The Role of Energy in Economic Growth," CCEP Working Papers 0310, Centre for Climate & Energy Policy, Crawford School of Public Policy, The Australian National University.
    12. Tsani, Stela Z., 2010. "Energy consumption and economic growth: A causality analysis for Greece," Energy Economics, Elsevier, vol. 32(3), pages 582-590, May.
    13. Shahbaz, Muhammad, 2017. "Current Issues in Time-Series Analysis for the Energy-Growth Nexus; Asymmetries and Nonlinearities Case Study: Pakistan," MPRA Paper 82221, University Library of Munich, Germany, revised 19 Oct 2017.
    14. Smyth, Russell & Narayan, Paresh Kumar, 2015. "Applied econometrics and implications for energy economics research," Energy Economics, Elsevier, vol. 50(C), pages 351-358.
    15. Md. Shahiduzzaman & Khorshed Alam, 2014. "A reassessment of energy and GDP relationship: the case of Australia," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 16(2), pages 323-344, April.
    16. Farzana Sharmin & Mohammed Robayet Khan & Mohammed Robayet Khan, 2016. "A Causal Relationship between Energy Consumption, Energy Prices and Economic Growth in Africa," International Journal of Energy Economics and Policy, Econjournals, vol. 6(3), pages 477-494.
    17. Leiva, Benjamin & Liu, Zhongyuan, 2019. "Energy and economic growth in the USA two decades later: Replication and reanalysis," Energy Economics, Elsevier, vol. 82(C), pages 89-99.
    18. Nour Wehbe & Bassam Assaf & Salem Darwich, 2018. "Étude de causalité entre la consommation d’électricité et la croissance économique au Liban," Post-Print hal-01944291, HAL.
    19. Ghosh, Sajal, 2010. "Examining carbon emissions economic growth nexus for India: A multivariate cointegration approach," Energy Policy, Elsevier, vol. 38(6), pages 3008-3014, June.
    20. Dakpogan, Arnaud & Smit, Eon, 2018. "The effect of electricity losses on GDP in Benin," MPRA Paper 89545, University Library of Munich, Germany.

    More about this item

    Keywords

    Replication; Robustness analysis; Sensitivity analysis; Energy; GDP; Divisia index; Granger causality;
    All these keywords.

    JEL classification:

    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Replication and robustness analysis of ‘energy and economic growth in the USA: A multivariate approach’ (Energy Economics 2019) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:82:y:2019:i:c:p:100-113. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.