IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v1y2013i1p53-70d25659.html
   My bibliography  Save this article

Outlier Detection in Regression Using an Iterated One-Step Approximation to the Huber-Skip Estimator

Author

Listed:
  • Søren Johansen

    (Department of Economics, University of Copenhagen, Øster Farimagsgade 5, 1353 Copenhagen, Denmark
    CREATES, Department of Economics and Business, Aarhus University, Fuglesangs Alle 4,8210 Aarhus, Denmark)

  • Bent Nielsen

    (Department of Economics, University of Oxford & Nuffield College, OX1 1NF, Oxford, UK)

Abstract

In regression we can delete outliers based upon a preliminary estimator and re-estimate the parameters by least squares based upon the retained observations. We study the properties of an iteratively defined sequence of estimators based on this idea. We relate the sequence to the Huber-skip estimator. We provide a stochastic recursion equation for the estimation error in terms of a kernel, the previous estimation error and a uniformly small error term. The main contribution is the analysis of the solution of the stochastic recursion equation as a fixed point, and the results that the normalized estimation errors are tight and are close to a linear function of the kernel, thus providing a stochastic expansion of the estimators, which is the same as for the Huber-skip. This implies that the iterated estimator is a close approximation of the Huber-skip.

Suggested Citation

  • Søren Johansen & Bent Nielsen, 2013. "Outlier Detection in Regression Using an Iterated One-Step Approximation to the Huber-Skip Estimator," Econometrics, MDPI, vol. 1(1), pages 1-18, May.
    • Handle: RePEc:gam:jecnmx:v:1:y:2013:i:1:p:53-70:d:25659
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/1/1/53/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2225-1146/1/1/53/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:bot:quadip:118 is not listed on IDEAS
    2. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages 32-61, March.
    3. Carlos Santos & David Hendry & Soren Johansen, 2008. "Automatic selection of indicators in a fully saturated regression," Computational Statistics, Springer, vol. 23(2), pages 317-335, April.
    4. Cavaliere, Giuseppe & Georgiev, Iliyan, 2013. "Exploiting Infinite Variance Through Dummy Variables In Nonstationary Autoregressions," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1162-1195, December.
    5. Bent Nielsen & Soren Johansen, 2010. "Discussion of The Forward Search: Theory and Data Analysis," Economics Series Working Papers 2010-W02, University of Oxford, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. From My Reading List...........
      by Dave Giles in Econometrics Beat: Dave Giles' Blog on 2013-08-27 02:03:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    2. Ericsson, Neil R., 2017. "Interpreting estimates of forecast bias," International Journal of Forecasting, Elsevier, vol. 33(2), pages 563-568.
    3. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    4. Felix Pretis & Michael Mann & Robert Kaufmann, 2015. "Testing competing models of the temperature hiatus: assessing the effects of conditioning variables and temporal uncertainties through sample-wide break detection," Climatic Change, Springer, vol. 131(4), pages 705-718, August.
    5. Hendry, David F. & Pretis, Felix, 2023. "Analysing differences between scenarios," International Journal of Forecasting, Elsevier, vol. 39(2), pages 754-771.
    6. Neil R. Ericsson & Mohammed H. I. Dore & Hassan Butt, 2022. "Detecting and Quantifying Structural Breaks in Climate," Econometrics, MDPI, vol. 10(4), pages 1-27, November.
    7. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry & Felix Pretis, 2015. "Detecting Location Shifts during Model Selection by Step-Indicator Saturation," Econometrics, MDPI, vol. 3(2), pages 1-25, April.
    8. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    9. Brian Chi-ang Lin & Siqi Zheng & Felix Pretis & Lea Schneider & Jason E. Smerdon & David F. Hendry, 2016. "Detecting Volcanic Eruptions In Temperature Reconstructions By Designed Break-Indicator Saturation," Journal of Economic Surveys, Wiley Blackwell, vol. 30(3), pages 403-429, July.
    10. Jiao, Xiyu & Pretis, Felix & Schwarz, Moritz, 2024. "Testing for coefficient distortion due to outliers with an application to the economic impacts of climate change," Journal of Econometrics, Elsevier, vol. 239(1).
    11. Andrew B. Martinez & Neil R. Ericsson, 2025. "Improving empirical models and forecasts with saturation-based machine learning," Annals of Operations Research, Springer, vol. 346(1), pages 447-487, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Søren Johansen & Lukasz Gatarek, 2014. "Optimal hedging with the cointegrated vector autoregressive model," CREATES Research Papers 2014-40, Department of Economics and Business Economics, Aarhus University.
    2. Søren Johansen & Bent Nielsen, 2014. "Outlier detection algorithms for least squares time series regression," Economics Papers 2014-W04, Economics Group, Nuffield College, University of Oxford.
    3. Søren Johansen & Bent Nielsen, 2011. "Asymptotic theory for iterated one-step Huber-skip estimators," CREATES Research Papers 2011-40, Department of Economics and Business Economics, Aarhus University.
    4. Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011. "Evaluating Automatic Model Selection," Journal of Time Series Econometrics, De Gruyter, vol. 3(1), pages 1-33, February.
    5. Jennifer Castle & David Hendry, 2010. "Automatic Selection for Non-linear Models," Economics Series Working Papers 473, University of Oxford, Department of Economics.
    6. Jennifer Castle & David Hendry, 2020. "Identifying the Causal Role of CO2 during the Ice Ages," Economics Series Working Papers 898, University of Oxford, Department of Economics.
    7. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2023. "Robust Discovery of Regression Models," Econometrics and Statistics, Elsevier, vol. 26(C), pages 31-51.
    8. Bauwens, Luc & Sucarrat, Genaro, 2010. "General-to-specific modelling of exchange rate volatility: A forecast evaluation," International Journal of Forecasting, Elsevier, vol. 26(4), pages 885-907, October.
    9. Stillwagon, Josh R., 2016. "Non-linear exchange rate relationships: An automated model selection approach with indicator saturation," The North American Journal of Economics and Finance, Elsevier, vol. 37(C), pages 84-109.
    10. Castle, Jennifer L. & Doornik, Jurgen A. & Hendry, David F., 2012. "Model selection when there are multiple breaks," Journal of Econometrics, Elsevier, vol. 169(2), pages 239-246.
    11. David Hendry & Grayham E. Mizon, 2012. "Forecasting from Structural Econometric Models," Economics Series Working Papers 597, University of Oxford, Department of Economics.
    12. Rocha, Jordano Vieira & Pereira, Pedro L. Valls, 2015. "Forecast comparison with nonlinear methods for Brazilian industrial production," Textos para discussão 397, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    13. David F. Hendry & Felix Pretis, 2013. "Anthropogenic influences on atmospheric CO2," Chapters, in: Roger Fouquet (ed.), Handbook on Energy and Climate Change, chapter 12, pages 287-326, Edward Elgar Publishing.
    14. Jennifer Castle & David Hendry, 2012. "Forecasting by factors, by variables, or both?," Economics Series Working Papers 600, University of Oxford, Department of Economics.
    15. Cavaliere, Giuseppe & Georgiev, Iliyan, 2013. "Exploiting Infinite Variance Through Dummy Variables In Nonstationary Autoregressions," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1162-1195, December.
    16. Neil R. Ericsson & Steven B. Kamin, 2008. "Constructive data mining: modeling Argentine broad money demand," International Finance Discussion Papers 943, Board of Governors of the Federal Reserve System (U.S.).
    17. Søren Johansen & Bent Nielsen, 2016. "Asymptotic Theory of Outlier Detection Algorithms for Linear Time Series Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(2), pages 321-348, June.
    18. Møller, Niels Framroze & Andersen, Laura Mørch & Hansen, Lars Gårn & Jensen, Carsten Lynge, 2019. "Can pecuniary and environmental incentives via SMS messaging make households adjust their electricity demand to a fluctuating production?," Energy Economics, Elsevier, vol. 80(C), pages 1050-1058.
    19. Hendry, David F. & Johansen, Søren, 2015. "Model Discovery And Trygve Haavelmo’S Legacy," Econometric Theory, Cambridge University Press, vol. 31(1), pages 93-114, February.
    20. David F. Hendry, 2024. "A Brief History of General‐to‐specific Modelling," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(1), pages 1-20, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:1:y:2013:i:1:p:53-70:d:25659. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.