IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v239y2024i1s0304407623002634.html
   My bibliography  Save this article

Testing for coefficient distortion due to outliers with an application to the economic impacts of climate change

Author

Listed:
  • Jiao, Xiyu
  • Pretis, Felix
  • Schwarz, Moritz

Abstract

Outlying observations can bias regression estimates, requiring the use of outlier-robust estimators. Comparing robust estimates to those obtained using ordinary least squares (OLS) is a common robustness check, however, such comparisons have been mostly informal due to the lack of available tests. Here we introduce a formal test for coefficient distortion due to outliers in regression models. Our proposed test is based on the difference between OLS and robust estimates obtained using a class of Huber-skip M-type estimators (such as Impulse Indicator Saturation or Robustified Least Squares). We show that our distortion test has an asymptotic chi-squared distribution by establishing the asymptotics of the corresponding Huber-skip M-estimators using an empirical process Central Limit Theorem recently developed in the literature. The test is valid for cross-sectional, as well as panel, and stationary or deterministically-trending time series models. To improve finite sample performance and to alleviate concerns on distributional assumptions, we explore several bootstrap testing schemes. We apply our outlier distortion test to estimates of the macro-economic impacts of climate change allowing for adaptation.

Suggested Citation

  • Jiao, Xiyu & Pretis, Felix & Schwarz, Moritz, 2024. "Testing for coefficient distortion due to outliers with an application to the economic impacts of climate change," Journal of Econometrics, Elsevier, vol. 239(1).
  • Handle: RePEc:eee:econom:v:239:y:2024:i:1:s0304407623002634
    DOI: 10.1016/j.jeconom.2023.105547
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407623002634
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2023.105547?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wu, De-Min, 1973. "Alternative Tests of Independence Between Stochastic Regressors and Disturbances," Econometrica, Econometric Society, vol. 41(4), pages 733-750, July.
    2. Vanessa Berenguer-Rico & Søren Johansen & Bent Nielsen, 2019. "The analysis of marked and weighted empirical processes of estimated residuals," Economics Papers 2019-W03, Economics Group, Nuffield College, University of Oxford.
    3. Kahn, Matthew E. & Mohaddes, Kamiar & Ng, Ryan N.C. & Pesaran, M. Hashem & Raissi, Mehdi & Yang, Jui-Chung, 2021. "Long-term macroeconomic effects of climate change: A cross-country analysis," Energy Economics, Elsevier, vol. 104(C).
    4. Andrew B. Martinez, 2020. "Forecast Accuracy Matters for Hurricane Damage," Econometrics, MDPI, vol. 8(2), pages 1-24, May.
    5. Olivier Deschênes & Michael Greenstone, 2011. "Climate Change, Mortality, and Adaptation: Evidence from Annual Fluctuations in Weather in the US," American Economic Journal: Applied Economics, American Economic Association, vol. 3(4), pages 152-185, October.
    6. Stillwagon, Josh R., 2016. "Non-linear exchange rate relationships: An automated model selection approach with indicator saturation," The North American Journal of Economics and Finance, Elsevier, vol. 37(C), pages 84-109.
    7. J. Bradford De Long & Lawrence H. Summers, 1994. "Equipment Investment and Economic Growth: Reply," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(3), pages 803-807.
    8. Castle, Jennifer L. & Hendry, David F., 2009. "The long-run determinants of UK wages, 1860-2004," Journal of Macroeconomics, Elsevier, vol. 31(1), pages 5-28, March.
    9. Marshall Burke & Solomon M. Hsiang & Edward Miguel, 2015. "Global non-linear effect of temperature on economic production," Nature, Nature, vol. 527(7577), pages 235-239, November.
    10. David Y. Albouy, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Comment," American Economic Review, American Economic Association, vol. 102(6), pages 3059-3076, October.
    11. Daron Acemoglu & Suresh Naidu & Pascual Restrepo & James A. Robinson, 2019. "Democracy Does Cause Growth," Journal of Political Economy, University of Chicago Press, vol. 127(1), pages 47-100.
    12. Søren Johansen & Bent Nielsen, 2016. "Asymptotic Theory of Outlier Detection Algorithms for Linear Time Series Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 321-348, June.
    13. Matías Salibián-Barrera & Stefan Aelst & Gert Willems, 2008. "Fast and robust bootstrap," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 17(1), pages 41-71, February.
    14. Hendry David F & Mizon Grayham E, 2011. "Econometric Modelling of Time Series with Outlying Observations," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-26, February.
    15. J. Bradford De Long & Lawrence H. Summers, 1991. "Equipment Investment and Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 445-502.
    16. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    17. Prosper Dovonon & Sílvia Gonçalves & Ulrich Hounyo & Nour Meddahi, 2019. "Bootstrapping High-Frequency Jump Tests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 793-803, April.
    18. Marshall Burke & Kyle Emerick, 2016. "Adaptation to Climate Change: Evidence from US Agriculture," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 106-140, August.
    19. Robert Kaufmann & Heikki Kauppi & Michael Mann & James Stock, 2013. "Does temperature contain a stochastic trend: linking statistical results to physical mechanisms," Climatic Change, Springer, vol. 118(3), pages 729-743, June.
    20. Newell, Richard G. & Prest, Brian C. & Sexton, Steven E., 2021. "The GDP-Temperature relationship: Implications for climate change damages," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    21. Alan J. Auerbach & Kevin A. Hassett & Stephen D. Oliner, 1994. "Reassessing the Social Returns to Equipment Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 109(3), pages 789-802.
    22. Vanessa Berenguer-Rico & Ines Wilms, 2021. "Heteroscedasticity testing after outlier removal," Econometric Reviews, Taylor & Francis Journals, vol. 40(1), pages 51-85, January.
    23. Johansen, Søren & Nielsen, Bent, 2019. "Boundedness Of M-Estimators For Linear Regression In Time Series," Econometric Theory, Cambridge University Press, vol. 35(3), pages 653-683, June.
    24. Tamma Carleton & Amir Jina & Michael Delgado & Michael Greenstone & Trevor Houser & Solomon Hsiang & Andrew Hultgren & Robert E Kopp & Kelly E McCusker & Ishan Nath & James Rising & Ashwin Rode & Hee , 2023. "Valuing the Global Mortality Consequences of Climate Change Accounting for Adaptation Costs and Benefits," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(4), pages 2037-2105.
    25. Alan Barreca & Karen Clay & Olivier Deschenes & Michael Greenstone & Joseph S. Shapiro, 2016. "Adapting to Climate Change: The Remarkable Decline in the US Temperature-Mortality Relationship over the Twentieth Century," Journal of Political Economy, University of Chicago Press, vol. 124(1), pages 105-159.
    26. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    27. Chen, Shuai & Gong, Binlei, 2021. "Response and adaptation of agriculture to climate change: Evidence from China," Journal of Development Economics, Elsevier, vol. 148(C).
    28. Felix Pretis & Michael Mann & Robert Kaufmann, 2015. "Testing competing models of the temperature hiatus: assessing the effects of conditioning variables and temporal uncertainties through sample-wide break detection," Climatic Change, Springer, vol. 131(4), pages 705-718, August.
    29. Acevedo, Sebastian & Mrkaic, Mico & Novta, Natalija & Pugacheva, Evgenia & Topalova, Petia, 2020. "The Effects of Weather Shocks on Economic Activity: What are the Channels of Impact?," Journal of Macroeconomics, Elsevier, vol. 65(C).
    30. A. Colin Cameron & Pravin K. Trivedi, 2010. "Microeconometrics Using Stata, Revised Edition," Stata Press books, StataCorp LP, number musr, March.
    31. Dreger, Christian & Wolters, Jürgen, 2014. "Money demand and the role of monetary indicators in forecasting euro area inflation," International Journal of Forecasting, Elsevier, vol. 30(2), pages 303-312.
    32. Ragnar Nymoen & Victoria Sparrman, 2015. "Equilibrium Unemployment Dynamics in a Panel of OECD Countries," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(2), pages 164-190, April.
    33. André K. Anundsen, 2015. "Econometric Regime Shifts and the US Subprime Bubble," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 145-169, January.
    34. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    35. Lea Berrang-Ford & A. R. Siders & Alexandra Lesnikowski & Alexandra Paige Fischer & Max W. Callaghan & Neal R. Haddaway & Katharine J. Mach & Malcolm Araos & Mohammad Aminur Rahman Shah & Mia Wannewit, 2021. "A systematic global stocktake of evidence on human adaptation to climate change," Nature Climate Change, Nature, vol. 11(11), pages 989-1000, November.
    36. Catherine Dehon & Marjorie Gassner & Vincenzo Verardi, 2012. "Extending the Hausman Test to Check for the Presence of Outliers," Advances in Econometrics, in: Essays in Honor of Jerry Hausman, pages 435-453, Emerald Group Publishing Limited.
    37. Xiyu Jiao & Felix Pretis, 2022. "Testing the Presence of Outliers in Regression Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1452-1484, December.
    38. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    39. Daron Acemoglu & Simon Johnson & James A. Robinson, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Reply," American Economic Review, American Economic Association, vol. 102(6), pages 3077-3110, October.
    40. J. Eduardo Vera-Valdés, 2021. "Temperature Anomalies, Long Memory, and Aggregation," Econometrics, MDPI, vol. 9(1), pages 1-22, March.
    41. Søren Johansen & Bent Nielsen, 2016. "Rejoinder: Asymptotic Theory of Outlier Detection Algorithms for Linear Time Series Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 374-381, June.
    42. Carlos Santos & David Hendry & Soren Johansen, 2008. "Automatic selection of indicators in a fully saturated regression," Computational Statistics, Springer, vol. 23(2), pages 317-335, April.
    43. Søren Johansen & Bent Nielsen, 2013. "Outlier Detection in Regression Using an Iterated One-Step Approximation to the Huber-Skip Estimator," Econometrics, MDPI, vol. 1(1), pages 1-18, May.
    44. Kalkuhl, Matthias & Wenz, Leonie, 2020. "The impact of climate conditions on economic production. Evidence from a global panel of regions," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    45. Holly, Alberto, 1982. "A Remark on Hausman's Specification Test," Econometrica, Econometric Society, vol. 50(3), pages 749-759, May.
    46. Hausman, Jerry A. & Taylor, William E., 1981. "A generalized specification test," Economics Letters, Elsevier, vol. 8(3), pages 239-245.
    47. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2012. "Temperature Shocks and Economic Growth: Evidence from the Last Half Century," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(3), pages 66-95, July.
    48. Auffhammer, Maximilian, 2022. "Climate Adaptive Response Estimation: Short and long run impacts of climate change on residential electricity and natural gas consumption," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    49. Catherine Dehon & Marjorie Gassner & Vincenzo Verardi, 2011. "Extending the Hausman Test to Check for the presence of Outliers," Working Papers ECARES ECARES 2011-036, ULB -- Universite Libre de Bruxelles.
    50. Francisco Estrada & Pierre Perron & Benjamin Martinez-Lopez, 2013. "Statistically-derived contributions of diverse human influences to 20th century temperature changes," Boston University - Department of Economics - Working Papers Series 2013-017, Boston University - Department of Economics.
    51. Pretis, Felix, 2020. "Econometric modelling of climate systems: The equivalence of energy balance models and cointegrated vector autoregressions," Journal of Econometrics, Elsevier, vol. 214(1), pages 256-273.
    52. Salibian-Barrera, Matias & Van Aelst, Stefan, 2008. "Robust model selection using fast and robust bootstrap," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5121-5135, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Felix Pretis, 2022. "Does a Carbon Tax Reduce CO2 Emissions? Evidence from British Columbia," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 83(1), pages 115-144, September.
    2. Kahn, Matthew E. & Mohaddes, Kamiar & Ng, Ryan N.C. & Pesaran, M. Hashem & Raissi, Mehdi & Yang, Jui-Chung, 2021. "Long-term macroeconomic effects of climate change: A cross-country analysis," Energy Economics, Elsevier, vol. 104(C).
    3. Tol, Richard S.J., 2024. "A meta-analysis of the total economic impact of climate change," Energy Policy, Elsevier, vol. 185(C).
    4. Naveen Kumar & Dibyendu Maiti, 2024. "The Dynamic Causal Impact of Climate Change on Economic Activity - A Disaggregated Panel Analysis of India," Working papers 345, Centre for Development Economics, Delhi School of Economics.
    5. Pretis, Felix, 2020. "Econometric modelling of climate systems: The equivalence of energy balance models and cointegrated vector autoregressions," Journal of Econometrics, Elsevier, vol. 214(1), pages 256-273.
    6. Chang, Jun-Jie & Mi, Zhifu & Wei, Yi-Ming, 2023. "Temperature and GDP: A review of climate econometrics analysis," Structural Change and Economic Dynamics, Elsevier, vol. 66(C), pages 383-392.
    7. Otto Brøns-Petersen & Søren Havn Gjedsted, 2021. "Climate change and institutional change: what is the relative importance for economic performance?," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 23(2), pages 333-360, April.
    8. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    9. Gregory Casey & Stephie Fried & Ethan Goode, 2023. "Projecting the Impact of Rising Temperatures: The Role of Macroeconomic Dynamics," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(3), pages 688-718, September.
    10. Cascarano, Michele & Natoli, Filippo & Petrella, Andrea, 2022. "Entry, exit and market structure in a changing climate," MPRA Paper 112868, University Library of Munich, Germany.
    11. Pretis, Felix, 2021. "Exogeneity in climate econometrics," Energy Economics, Elsevier, vol. 96(C).
    12. Dang, Hai-Anh & Hallegatte, Stephane & Trinh, Trong-Anh, 2023. "Does Global Warming Worsen Poverty and Inequality? An Updated Review," IZA Discussion Papers 16570, Institute of Labor Economics (IZA).
    13. Xiyu Jiao & Felix Pretis, 2022. "Testing the Presence of Outliers in Regression Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1452-1484, December.
    14. Felix Pretis & Lea Schneider & Jason E. Smerdon & David F. Hendry, 2016. "Detecting Volcanic Eruptions In Temperature Reconstructions By Designed Break-Indicator Saturation," Journal of Economic Surveys, Wiley Blackwell, vol. 30(3), pages 403-429, July.
    15. Wang, Di & Zhang, Peng & Chen, Shuai & Zhang, Ning, 2024. "Adaptation to temperature extremes in Chinese agriculture, 1981 to 2010," Journal of Development Economics, Elsevier, vol. 166(C).
    16. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    17. Kalkuhl, Matthias & Wenz, Leonie, 2020. "The impact of climate conditions on economic production. Evidence from a global panel of regions," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    18. Emediegwu, Lotanna E. & Wossink, Ada & Hall, Alastair, 2022. "The impacts of climate change on agriculture in sub-Saharan Africa: A spatial panel data approach," World Development, Elsevier, vol. 158(C).
    19. Ding, Yugang & Xu, Jiangmin, 2023. "Global vulnerability of agricultural commodities to climate risk: Evidence from satellite data," Economic Analysis and Policy, Elsevier, vol. 80(C), pages 669-687.
    20. Picchio, Matteo & van Ours, Jan C., 2024. "The impact of high temperatures on performance in work-related activities," Labour Economics, Elsevier, vol. 87(C).

    More about this item

    Keywords

    Outlier robustness; Robust estimation; Iterated 1-step Huber-skip M-estimator; Indicator saturation; Climate econometrics; Climate change; Adaptation;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • Q54 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Climate; Natural Disasters and their Management; Global Warming

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:239:y:2024:i:1:s0304407623002634. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.