IDEAS home Printed from https://ideas.repec.org/p/bng/wpaper/19014.html

Mitigating misleading implications for policy: Treatment of outliers in a difference-indifferences framework

Author

Listed:
  • AAlessio Reghezza

    (Bangor University)

  • Jonathan Williams

    (Bangor University)

  • Philip Molyneux

    (University of Sharjah)

Abstract

Applications of the difference-in-differences estimator in economics, banking and finance, and management commonly treat outliers using the winsorize method. However, failure to winsorize outliers in both the treatment and controls groups introduces volatility in estimated coefficients, significance levels, and standard errors. A faulty process can lead to an exogenous event realising a significant effect that proper process would fail to detect. In demonstration, we randomly generate placebo interventions in bank-level data and discuss how to detect and limit the problem.

Suggested Citation

  • AAlessio Reghezza & Jonathan Williams & Philip Molyneux, 2019. "Mitigating misleading implications for policy: Treatment of outliers in a difference-indifferences framework," Working Papers 19014, Bangor Business School, Prifysgol Bangor University (Cymru / Wales).
    • Handle: RePEc:bng:wpaper:19014
    as

    Download full text from publisher

    File URL: https://www.bangor.ac.uk/business/research/documents/BBSWP-19-14.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Timothy Gubler & Ian Larkin & Lamar Pierce, 2016. "Motivational Spillovers from Awards: Crowding Out in a Multitasking Environment," Organization Science, INFORMS, vol. 27(2), pages 286-303, April.
    3. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    2. Jonathon Adams‐Kane & Julián A. Caballero & Jamus Jerome Lim, 2017. "Foreign Bank Behavior during Financial Crises," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(2-3), pages 351-392, March.
    3. Nicolas R. Ziebarth & Martin Karlsson, 2014. "The Effects Of Expanding The Generosity Of The Statutory Sickness Insurance System," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 208-230, March.
    4. Cammeraat, Emile & Jongen, Egbert L. W. & Koning, Pierre, 2017. "Preventing NEETs during the Great Recession: The Effects of a Mandatory Activation Program for Young Welfare Recipients," IZA Discussion Papers 11090, Institute of Labor Economics (IZA).
    5. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    6. Molyneux, Philip & Reghezza, Alessio & Xie, Ru, 2019. "Bank margins and profits in a world of negative rates," Journal of Banking & Finance, Elsevier, vol. 107(C), pages 1-1.
    7. Avignone, Giuseppe & Altunbas, Yener & Polizzi, Salvatore & Reghezza, Alessio, 2021. "Centralised or decentralised banking supervision? Evidence from European banks," Journal of International Money and Finance, Elsevier, vol. 110(C).
    8. Fan, Elliott & Lien, Hsienming & Ma, Ching-to Albert, 2019. "Uterus at a price: Disability insurance and hysterectomy," Journal of Health Economics, Elsevier, vol. 66(C), pages 1-17.
    9. Altunbas, Yener & Avignone, Giuseppe & Kok, Christoffer & Pancaro, Cosimo, 2023. "Euro area banks’ market power, lending channel and stability: the effects of negative policy rates," Working Paper Series 2790, European Central Bank.
    10. M. Serkan Akturk & Michael Ketzenberg, 2022. "Impact of Competitor Store Closures on a Major Retailer," Production and Operations Management, Production and Operations Management Society, vol. 31(2), pages 715-730, February.
    11. Fernández-López, Reinier & Mardones, Cristian, 2025. "Impact evaluation of the carbon tax in Chile using the difference-in-differences method," Energy, Elsevier, vol. 318(C).
    12. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    13. Emile Cammeraat & Egbert Jongen & Pierre Koning, 2022. "Preventing NEETs during the Great Recession: the effects of mandatory activation programs for young welfare recipients," Empirical Economics, Springer, vol. 62(2), pages 749-777, February.
    14. Kojevnikov, Denis & Song, Kyungchul, 2023. "Some impossibility results for inference with cluster dependence with large clusters," Other publications TiSEM 80b8e4ed-54bc-4a34-883f-f, Tilburg University, School of Economics and Management.
    15. Cawley, John & Frisvold, David & Hill, Anna & Jones, David, 2019. "The impact of the Philadelphia beverage tax on purchases and consumption by adults and children," Journal of Health Economics, Elsevier, vol. 67(C).
    16. Foureaux Koppensteiner, Martin, 2014. "Automatic grade promotion and student performance: Evidence from Brazil," Journal of Development Economics, Elsevier, vol. 107(C), pages 277-290.
    17. Campos, Nauro F. & Jarko, Fidrmuc & Iikka, Korhonen, 2017. "Business cycle synchronisation in a currency union: Taking stock of the evidence," Bank of Finland Research Discussion Papers 28/2017, Bank of Finland.
    18. Yuheng Wang & Sihan Chen & Zhicheng Zhou & Shen Zhong, 2025. "Has the Construction of National Intellectual Property Model Cities Reduced PM 2.5 Concentration and Standard Deviation? New Evidence from Counties in China," Sustainability, MDPI, vol. 17(18), pages 1-29, September.
    19. Erlend E. Bø & Joel Slemrod & Thor O. Thoresen, 2015. "Taxes on the Internet: Deterrence Effects of Public Disclosure," American Economic Journal: Economic Policy, American Economic Association, vol. 7(1), pages 36-62, February.
    20. Dostie, Benoit & Jayaraman, Rajshri, 2009. "The Effect of Adversity on Process Innovations and Managerial Incentives," IZA Discussion Papers 4261, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C19 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Other
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bng:wpaper:19014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alan Thomas The email address of this maintainer does not seem to be valid anymore. Please ask Alan Thomas to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/sabanuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.