IDEAS home Printed from https://ideas.repec.org/p/zbw/i4rdps/234.html
   My bibliography  Save this paper

The Robustness Dashboard

Author

Listed:
  • Bensch, Gunther
  • Rose, Julian
  • Brodeur, Abel
  • Ankel-Peters, Jörg

Abstract

Transparent communication of robustness is essential in empirical research, yet existing tools can be difficult to interpret. This paper introduces the robustness dashboard, a graphical tool that visualizes the results of robustness reproductions into a single, intuitive graph. The robustness dashboard draws on a multiverse of analytical paths to illustrate their effect on statistical significance. It complements existing visualisations, such as specification curves, by offering a more compact and accessible summary of robustness patterns. The dashboard can be easily implemented using our Stata command repframe and scaled according to the number of outcomes, ranging from stand-alone reproductions to meta-reproductions.

Suggested Citation

  • Bensch, Gunther & Rose, Julian & Brodeur, Abel & Ankel-Peters, Jörg, 2025. "The Robustness Dashboard," I4R Discussion Paper Series 234, The Institute for Replication (I4R).
    • Handle: RePEc:zbw:i4rdps:234
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/319180/1/I4R-DP234.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Anna Dreber & Magnus Johannesson, 2025. "A framework for evaluating reproducibility and replicability in economics," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
    2. Vilhuber, Lars, 2023. "Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor," Journal of Econometrics, Elsevier, vol. 235(2), pages 2285-2294.
    3. Sridevi K. Prasad & Fiona Kastel & Suvarna Pande & Chenxiao Zhang & Douglas M. Glandon, 2024. "A checklist to guide sensitivity analyses and replications of impact evaluations," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 16(3), pages 332-348, July.
    4. Conley, Timothy G. & Kelly, Morgan, 2025. "The standard errors of persistence," Journal of International Economics, Elsevier, vol. 153(C).
    5. Joel Ferguson & Rebecca Littman & Garret Christensen & Elizabeth Levy Paluck & Nicholas Swanson & Zenan Wang & Edward Miguel & David Birke & John-Henry Pezzuto, 2023. "Survey of open science practices and attitudes in the social sciences," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    6. Ankel-Peters, Jörg & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Neubauer, Florian & Rose, Julian, 2024. "A Protocol for Structured Robustness Reproductions and Replicability Assessments," I4R Discussion Paper Series 143, The Institute for Replication (I4R).
    7. Campbell, Douglas & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "The Robustness Reproducibility of the American Economic Review," I4R Discussion Paper Series 124, The Institute for Replication (I4R).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    2. Douglas Kiarelly Godoy de Araujo, 2025. "Open-sourced central bank macroeconomic models," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Data science in central banking: enhancing the access to and sharing of data, volume 64, Bank for International Settlements.
    3. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    4. Campbell, Douglas & Brodeur, Abel & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "Robustness Report: "Going to a Better School: Effects and Behavioral Responses", by Cristian Pop-Eleches and Miguel Urquiola (2013)," I4R Discussion Paper Series 133, The Institute for Replication (I4R).
    5. Imai, Taisuke & Toussaert, Séverine & Baillon, Aurélien & Dreber, Anna & Ertaç, Seda & Johannesson, Magnus & Neyse, Levent & Villeval, Marie Claire, 2025. "Pre-Registration and Pre-Analysis Plans in Experimental Economics," I4R Discussion Paper Series 220, The Institute for Replication (I4R).
    6. Clerc, Melchior & Gosselin-Pali, Adrien & Wendling, Eliot, 2024. "A Replication of Macchi (2023): "Worth Your Weight: Experimental Evidence on the Benefits of Obesity in Low-Income Countries"," I4R Discussion Paper Series 145, The Institute for Replication (I4R).
    7. Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024. "Reproducibility in Management Science," Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
    8. Hollenbach, Florian M & Egerod, Benjamin, 2024. "How many is enough? Sample Size in Staggered Difference-in-Differences Designs," OSF Preprints ac5ru, Center for Open Science.
    9. Fenske, James & Gupta, Bishnupriya & Mukhopadhyay, Anwesh, 2025. "Colonial Persistence," The Warwick Economics Research Paper Series (TWERPS) 1557, University of Warwick, Department of Economics.
    10. Felix Holzmeister & Magnus Johannesson & Robert Böhm & Anna Dreber & Jürgen Huber & Michael Kirchler, 2023. "Heterogeneity in effect size estimates: Empirical evidence and practical implications," Working Papers 2023-17, Faculty of Economics and Statistics, Universität Innsbruck.
    11. repec:osf:socarx:rkyf7_v1 is not listed on IDEAS
    12. Campbell, Douglas & Brodeur, Abel & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "Robustness Report on "Coercive Contract Enforcement: Law and the Labor Market in Nineteenth Century Industrial Britain", by Suresh Naidu and Noam Yuchtman (2013)," I4R Discussion Paper Series 130, The Institute for Replication (I4R).
    13. Ankel-Peters, Jörg & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Neubauer, Florian & Rose, Julian, 2024. "A protocol for structured robustness reproductions and replicability assessments," Ruhr Economic Papers 1106, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    14. Stefano DellaVigna & Guido Imbens & Woojin Kim & David M. Ritzwoller, 2025. "Using Multiple Outcomes to Adjust Standard Errors for Spatial Correlation," Papers 2504.13295, arXiv.org.
    15. Rabah Arezki & Frederick van der Ploeg & Rick van der Ploeg, 2025. "The Critical Minerals Curse," CESifo Working Paper Series 11966, CESifo.
    16. Campbell, Douglas & Brodeur, Abel & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "Robustness Report on "Innovation and Institutional Ownership", by Aghion, Philippe, John van Reenen, and Luigi Zingales (2013)," I4R Discussion Paper Series 134, The Institute for Replication (I4R).
    17. Philipp Knöpfle & Tim Schatto-Eckrodt, 2024. "The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020)," Media and Communication, Cogitatio Press, vol. 12.
    18. McWay, Ryan, 2025. "Unintended Consequences of Lockdowns, COVID-19 and the Shadow Pandemic in India. A Reproduction Study of Ravindran and Shah," I4R Discussion Paper Series 230, The Institute for Replication (I4R).
    19. Ahmed, Fatma, 2025. "Ice roads and income in remote indigenous communities of Canada," World Development Perspectives, Elsevier, vol. 37(C).
    20. repec:osf:osfxxx:mydzv_v1 is not listed on IDEAS
    21. Baldwin, Grant & Becker, Clayton & Ortiz, Emily & Goetz, Josh, 2024. "A comment on "The people think what I think" by Furnas and LaPira (2024)," I4R Discussion Paper Series 171, The Institute for Replication (I4R), revised 2024.
    22. repec:osf:osfxxx:ac5ru_v1 is not listed on IDEAS
    23. Campbell, Douglas & Brodeur, Abel & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "Robustness Report on "Commercial Imperialism? Political Influence and Trade during the Cold War", by Daniel Berger, William Easterly, Nathan Nunn and Shanker Satyanath (2013)," I4R Discussion Paper Series 131, The Institute for Replication (I4R).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:i4rdps:234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://www.i4replication.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.