IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/234.html
   My bibliography  Save this paper

The Robustness Dashboard

Author

Listed:
  • Bensch, Gunther
  • Rose, Julian
  • Brodeur, Abel
  • Ankel-Peters, Jörg

Abstract

Transparent communication of robustness is essential in empirical research, yet existing tools can be difficult to interpret. This paper introduces the robustness dashboard, a graphical tool that visualizes the results of robustness reproductions into a single, intuitive graph. The robustness dashboard draws on a multiverse of analytical paths to illustrate their effect on statistical significance. It complements existing visualisations, such as specification curves, by offering a more compact and accessible summary of robustness patterns. The dashboard can be easily implemented using our Stata command repframe and scaled according to the number of outcomes, ranging from stand-alone reproductions to meta-reproductions.

Suggested Citation

  • Bensch, Gunther & Rose, Julian & Brodeur, Abel & Ankel-Peters, Jörg, 2025. "The Robustness Dashboard," I4R Discussion Paper Series 234, The Institute for Replication (I4R).
    • Handle: RePEc:zbw:i4rdps:234
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/319180/1/I4R-DP234.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anna Dreber & Magnus Johannesson, 2025. "A framework for evaluating reproducibility and replicability in economics," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
    2. Vilhuber, Lars, 2023. "Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor," Journal of Econometrics, Elsevier, vol. 235(2), pages 2285-2294.
    3. Young, Alwyn, 2022. "Consistency without Inference: Instrumental Variables in Practical Application," European Economic Review, Elsevier, vol. 147(C).
    4. Sridevi K. Prasad & Fiona Kastel & Suvarna Pande & Chenxiao Zhang & Douglas M. Glandon, 2024. "A checklist to guide sensitivity analyses and replications of impact evaluations," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 16(3), pages 332-348, July.
    5. Conley, Timothy G. & Kelly, Morgan, 2025. "The standard errors of persistence," Journal of International Economics, Elsevier, vol. 153(C).
    6. Joel Ferguson & Rebecca Littman & Garret Christensen & Elizabeth Levy Paluck & Nicholas Swanson & Zenan Wang & Edward Miguel & David Birke & John-Henry Pezzuto, 2023. "Survey of open science practices and attitudes in the social sciences," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    7. Ankel-Peters, Jörg & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Neubauer, Florian & Rose, Julian, 2024. "A Protocol for Structured Robustness Reproductions and Replicability Assessments," I4R Discussion Paper Series 143, The Institute for Replication (I4R).
    8. Campbell, Douglas & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "The Robustness Reproducibility of the American Economic Review," I4R Discussion Paper Series 124, The Institute for Replication (I4R).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    2. repec:osf:osfxxx:sw6kd_v1 is not listed on IDEAS
    3. Douglas Kiarelly Godoy de Araujo, 2025. "Open-sourced central bank macroeconomic models," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Data science in central banking: enhancing the access to and sharing of data, volume 64, Bank for International Settlements.
    4. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    5. Jens Klooster & Mikhail Zhelonkin, 2024. "Outlier robust inference in the instrumental variable model with applications to causal effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 86-106, January.
    6. Keane, Michael & Neal, Timothy, 2023. "Instrument strength in IV estimation and inference: A guide to theory and practice," Journal of Econometrics, Elsevier, vol. 235(2), pages 1625-1653.
    7. Campbell, Douglas & Brodeur, Abel & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "Robustness Report: "Going to a Better School: Effects and Behavioral Responses", by Cristian Pop-Eleches and Miguel Urquiola (2013)," I4R Discussion Paper Series 133, The Institute for Replication (I4R).
    8. Imai, Taisuke & Toussaert, Séverine & Baillon, Aurélien & Dreber, Anna & Ertaç, Seda & Johannesson, Magnus & Neyse, Levent & Villeval, Marie Claire, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," I4R Discussion Paper Series 220, The Institute for Replication (I4R).
    9. Clerc, Melchior & Gosselin-Pali, Adrien & Wendling, Eliot, 2024. "A Replication of Macchi (2023): "Worth Your Weight: Experimental Evidence on the Benefits of Obesity in Low-Income Countries"," I4R Discussion Paper Series 145, The Institute for Replication (I4R).
    10. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    11. Wang, Wenjie & Zhang, Yichong, 2024. "Wild bootstrap inference for instrumental variables regressions with weak and few clusters," Journal of Econometrics, Elsevier, vol. 241(1).
    12. Nguyen, Cuong Viet & Tran, Tuyen Quang & Van Vu, Huong, 2024. "The long-term effects of war on foreign direct investment and economic development: evidence from Vietnam," Journal of Urban Economics, Elsevier, vol. 143(C).
    13. Jordan Adamson & Lucas Rentschler, 2023. "Criminal justice from a public choice perspective: an introduction to the special issue," Public Choice, Springer, vol. 196(3), pages 223-227, September.
    14. Angrist, Joshua & Kolesár, Michal, 2024. "One instrument to rule them all: The bias and coverage of just-ID IV," Journal of Econometrics, Elsevier, vol. 240(2).
    15. Doko Tchatoka, Firmin & Wang, Wenjie, 2024. "Weak-Identification-Robust Bootstrap Tests after Pretesting for Exogeneity," MPRA Paper 123060, University Library of Munich, Germany.
    16. Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024. "Reproducibility in Management Science," Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
    17. Zhao, Qiyi C., 2023. "Rethinking “Distance From”: Lessons from Wittenberg and Mainz," MPRA Paper 118414, University Library of Munich, Germany.
    18. Romagnoli, Matteo, 2024. "Clean sweep: Electricity liberalization and the direction of technological change in the electricity sector," Research Policy, Elsevier, vol. 53(8).
    19. Linden, Mikael & Väänänen, Niko, 2024. "Tulot, eläke ja eläkeikä: empiirisiä tuloksia vuoden 1947 ikäkohortin kohdalta [Incomes, pension and retirement age: empirical results with the birth year 1947 cohort]," MPRA Paper 123064, University Library of Munich, Germany.
    20. Doko Tchatoka, Firmin & Wang, Wenjie, 2025. "Identification-Robust Two-Stage Bootstrap Tests with Pretesting for Exogeneity," MPRA Paper 125017, University Library of Munich, Germany.
    21. Hollenbach, Florian M & Egerod, Benjamin, 2024. "How many is enough? Sample Size in Staggered Difference-in-Differences Designs," OSF Preprints ac5ru, Center for Open Science.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.