IDEAS home Printed from https://ideas.repec.org/a/bla/obuest/v84y2022i6p1452-1484.html
   My bibliography  Save this article

Testing the Presence of Outliers in Regression Models

Author

Listed:
  • Xiyu Jiao
  • Felix Pretis

Abstract

We propose two sets of tests for the overall presence of outliers in regression models. First, ‘simple’ tests on whether the proportion and the number of detected outliers deviate from their expected values. Second, ‘scaling’ tests on whether the proportion of outliers decreases with the cut‐off used to detect outliers. We apply our tests to a panel difference‐in‐differences model of transport CO2 emissions in response to the introduction of North America's first major carbon tax. Our tests show the presence of significant outliers in the un‐taxed control group, which results in an overestimation of the estimated impacts of the tax.

Suggested Citation

  • Xiyu Jiao & Felix Pretis, 2022. "Testing the Presence of Outliers in Regression Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1452-1484, December.
  • Handle: RePEc:bla:obuest:v:84:y:2022:i:6:p:1452-1484
    DOI: 10.1111/obes.12511
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/obes.12511
    Download Restriction: no

    File URL: https://libkey.io/10.1111/obes.12511?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Vanessa Berenguer-Rico & Søren Johansen & Bent Nielsen, 2019. "The analysis of marked and weighted empirical processes of estimated residuals," Economics Papers 2019-W03, Economics Group, Nuffield College, University of Oxford.
    2. Ryan Rafaty & Geoffroy Dolphin & Felix Pretis, 2020. "Carbon pricing and the elasticity of CO2 emissions," Working Papers EPRG2035, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    3. Daron Acemoglu & Suresh Naidu & Pascual Restrepo & James A. Robinson, 2019. "Democracy Does Cause Growth," Journal of Political Economy, University of Chicago Press, vol. 127(1), pages 47-100.
    4. Søren Johansen & Bent Nielsen, 2016. "Asymptotic Theory of Outlier Detection Algorithms for Linear Time Series Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 321-348, June.
    5. Russell Davidson, 2007. "Bootstrapping Econometric Models," Departmental Working Papers 2007-13, McGill University, Department of Economics.
    6. Søren Johansen & Bent Nielsen, 2016. "Rejoinder: Asymptotic Theory of Outlier Detection Algorithms for Linear Time Series Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 374-381, June.
    7. Carlos Santos & David Hendry & Soren Johansen, 2008. "Automatic selection of indicators in a fully saturated regression," Computational Statistics, Springer, vol. 23(2), pages 317-335, April.
    8. N. Gregory Mankiw & David Romer & David N. Weil, 1992. "A Contribution to the Empirics of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 407-437.
    9. David Hendry & Carlos Santos, 2010. "An Automatic Test of Super Exogeneity," Economics Series Working Papers 476, University of Oxford, Department of Economics.
    10. Dreger, Christian & Wolters, Jürgen, 2014. "Money demand and the role of monetary indicators in forecasting euro area inflation," International Journal of Forecasting, Elsevier, vol. 30(2), pages 303-312.
    11. Vanessa Berenguer Rico & Bent Nielsen, 2017. "Marked and Weighted Empirical Processes of Residuals with Applications to Robust Regressions," Economics Series Working Papers 841, University of Oxford, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    2. David F. Hendry & Grayham E. Mizon, 2016. "Improving the teaching of econometrics," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1170096-117, December.
    3. Andrew B. Martinez, 2020. "Forecast Accuracy Matters for Hurricane Damage," Econometrics, MDPI, vol. 8(2), pages 1-24, May.
    4. Vanessa Berenguer-Rico & Soeren Johansen & Bent Nielsen, 2019. "Uniform Consistency of Marked and Weighted Empirical Distributions of Residuals," Discussion Papers 19-09, University of Copenhagen. Department of Economics.
    5. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2023. "Robust Discovery of Regression Models," Econometrics and Statistics, Elsevier, vol. 26(C), pages 31-51.
    6. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    7. Felix Pretis, 2022. "Does a Carbon Tax Reduce CO2 Emissions? Evidence from British Columbia," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 83(1), pages 115-144, September.
    8. Hendry, David F., 2018. "Deciding between alternative approaches in macroeconomics," International Journal of Forecasting, Elsevier, vol. 34(1), pages 119-135.
    9. Ericsson, Neil R., 2017. "Interpreting estimates of forecast bias," International Journal of Forecasting, Elsevier, vol. 33(2), pages 563-568.
    10. Jennifer L. Castle & David F. Hendry & Andrew B. Martinez, 2017. "Evaluating Forecasts, Narratives and Policy Using a Test of Invariance," Econometrics, MDPI, vol. 5(3), pages 1-27, September.
    11. Vassilios Bazinas & Bent Nielsen, 2022. "Causal Transmission in Reduced-Form Models," Econometrics, MDPI, vol. 10(2), pages 1-25, March.
    12. Jennifer Castle & David Hendry, 2016. "Policy Analysis, Forediction, and Forecast Failure," Economics Series Working Papers 809, University of Oxford, Department of Economics.
    13. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    14. Vanessa Berenguer-Rico & Søren Johansen & Bent Nielsen, 2019. "The analysis of marked and weighted empirical processes of estimated residuals," Economics Papers 2019-W03, Economics Group, Nuffield College, University of Oxford.
    15. Baiardi, Donatella & Morana, Claudio, 2021. "Climate change awareness: Empirical evidence for the European Union," Energy Economics, Elsevier, vol. 96(C).
    16. Felix Pretis & Lea Schneider & Jason E. Smerdon & David F. Hendry, 2016. "Detecting Volcanic Eruptions In Temperature Reconstructions By Designed Break-Indicator Saturation," Journal of Economic Surveys, Wiley Blackwell, vol. 30(3), pages 403-429, July.
    17. Pretis, Felix, 2020. "Econometric modelling of climate systems: The equivalence of energy balance models and cointegrated vector autoregressions," Journal of Econometrics, Elsevier, vol. 214(1), pages 256-273.
    18. Ericsson Neil R., 2016. "Testing for and estimating structural breaks and other nonlinearities in a dynamic monetary sector," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 20(4), pages 377-398, September.
    19. Neil R. Ericsson & Mohammed H. I. Dore & Hassan Butt, 2022. "Detecting and Quantifying Structural Breaks in Climate," Econometrics, MDPI, vol. 10(4), pages 1-27, November.
    20. James Reade & Genaro Sucarrat, 2016. "General-to-Specific (GETS) Modelling And Indicator Saturation With The R Package Gets," Economics Series Working Papers 794, University of Oxford, Department of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:obuest:v:84:y:2022:i:6:p:1452-1484. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/sfeixuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.