IDEAS home Printed from https://ideas.repec.org/p/ris/wfuewp/022594.html

Scanning for Significance: False Discovery Control for Impulse Responses

Author

Listed:
  • Giorgi Nikolaishvili

    (Wake Forest University)

  • Noah D. Gade

    (Wake Forest University)

Abstract

Impulse response analysis builds economic narratives by scanning a large set of coefficients for significant effects. Pointwise inference ignores this multiplicity, so the false rejection rate grows unbounded with the response family. Simultaneous inference bounds the probability of even a single false rejection, which yields increasingly uninformative results as the family expands. Researchers are left to choose between overstating their evidence and understating it. We propose false discovery and false coverage control as a more appropriate target: bounding the expected share of false rejections among responses declared significant, with calibrated post-selection confidence intervals. Neither guarantee deteriorates as the response family grows, so researchers are not penalized for investigating thoroughly. The procedure integrates into standard VAR and local projection bootstrap workflows. Applications show that this inference strategy recovers effects lost under simultaneous bands while discarding fragile pointwise findings, in some cases materially altering the economic narrative.

Suggested Citation

  • Giorgi Nikolaishvili & Noah D. Gade, 2026. "Scanning for Significance: False Discovery Control for Impulse Responses," Working Papers 134, Wake Forest University, Economics Department.
  • Handle: RePEc:ris:wfuewp:022594
    as

    Download full text from publisher

    File URL: https://giorginikolaishvili.com/cv/irf-fdr_nikolaishvili-gade.pdf
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • E00 - Macroeconomics and Monetary Economics - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:wfuewp:022594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Don Shegog (email available below). General contact details of provider: https://edirc.repec.org/data/dewfuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.