An LLM Workflow That Reproduces, Improves, and Extends Published Economics Research
Author
Abstract
Suggested Citation
Note: TWP
Download full text from publisher
As the access to this document is restricted, you may want to
for a different version of it.References listed on IDEAS
- Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024.
"Reproducibility in Management Science,"
Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
- Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
- Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I Ozkes & The Management Science Reproducibility Collaboration, 2024. "Reproducibility in Management Science," Post-Print hal-04370984, HAL.
- Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Collaboration, Management Science Reproducibility, 2023. "Reproducibility in Management Science," OSF Preprints mydzv, Center for Open Science.
- Leo Kaas & Etienne Lalé & Nawid Siassi, 2026.
"Job Ladder and Wealth Dynamics in General Equilibrium,"
Econometrica, Econometric Society, vol. 94(4), pages 1449-1485, July.
- Leo Kaas & Etienne Lalé & Nawid Siassi, 2023. "Job Ladder and Wealth Dynamics in General Equilibrium," CESifo Working Paper Series 10847, CESifo.
- Kaas, Leo & Lalé, Etienne & Siassi, Nawid, 2023. "Job Ladder and Wealth Dynamics in General Equilibrium," IZA Discussion Papers 16664, IZA Network @ LISER.
- Kaas, Leo & Lalé, Étienne & Siassi, Nawid, 2023. "Job Ladder and Wealth Dynamics in General Equilibrium," CEPR Discussion Papers 18706, Centre for Economic Policy Research.
- Kaas, Leo & Lalé, Etienne & Siassi, Nawid, 2023. "Job Ladder and Wealth Dynamics in General Equilibrium," ECON WPS - Working Papers in Economic Theory and Policy 03/2023, TU Wien, Institute of Statistics and Mathematical Methods in Economics, Economics Research Unit.
- Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Albert J Menkveld & Michael Razen & Utz Weitzel, 2024.
"Computational Reproducibility in Finance: Evidence from 1,000 Tests,"
The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3558-3593.
- Pérignon, Christophe & Akmansoy, Olivier & Hurlin, Christophe & Dreber, Anna & Holzmeister, Felix & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Menkveld, Albert J. & Razen, Michael & We, 2022. "Computational Reproducibility in Finance: Evidence from 1,000 Tests," HEC Research Papers Series 1467, HEC Paris.
- Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Albert J Menkveld & Michael Razen & Utz Weitzel, 2024. "Computational Reproducibility in Finance: Evidence from 1,000 Tests," Post-Print hal-04797779, HAL.
- Daniil A. Boiko & Robert MacKnight & Ben Kline & Gabe Gomes, 2023. "Autonomous chemical research with large language models," Nature, Nature, vol. 624(7992), pages 570-578, December.
- Trieu H. Trinh & Yuhuai Wu & Quoc V. Le & He He & Thang Luong, 2024. "Author Correction: Solving olympiad geometry without human demonstrations," Nature, Nature, vol. 627(8004), pages 8-8, March.
- Mariana Carrera & Heather Royer & Mark Stehr & Justin Sydnor & Dmitry Taubinsky, 2022.
"Who Chooses Commitment? Evidence and Welfare Implications,"
The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(3), pages 1205-1244.
- Mariana Carrera & Heather Royer & Mark Stehr & Justin Sydnor & Dmitry Taubinsky, 2019. "Who Chooses Commitment? Evidence and Welfare Implications," NBER Working Papers 26161, National Bureau of Economic Research, Inc.
- Trieu H. Trinh & Yuhuai Wu & Quoc V. Le & He He & Thang Luong, 2024. "Solving olympiad geometry without human demonstrations," Nature, Nature, vol. 625(7995), pages 476-482, January.
- B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008.
"Do economics journal archives promote replicable research?,"
Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
- B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics, Canadian Economics Association, vol. 41(4), pages 1406-1420, November.
- Richard Anderson & William Greene & B. D. McCullough & H. D. Vinod, 2008. "The role of data/code archives in the future of economic research," Journal of Economic Methodology, Taylor & Francis Journals, vol. 15(1), pages 99-119.
- Ufuk Akcigit & Jeremy Pearce & Marta Prato, 2025.
"Tapping into Talent: Coupling Education and Innovation Policies for Economic Growth,"
The Review of Economic Studies, Review of Economic Studies Ltd, vol. 92(2), pages 696-736.
- Ufuk Akcigit & Jeremy Pearce & Marta Prato, 2020. "Tapping into Talent: Coupling Education and Innovation Policies for Economic Growth," Working Papers 2020-137, Becker Friedman Institute for Research In Economics.
- Ufuk Akcigit & Jeremy G. Pearce & Marta Prato, 2020. "Tapping into Talent: Coupling Education and Innovation Policies for Economic Growth," NBER Working Papers 27862, National Bureau of Economic Research, Inc.
- Akcigit, Ufuk & Pearce, Jeremy & Prato, Marta, 2020. "Tapping into Talent: Coupling Education and Innovation Policies for Economic Growth," CEPR Discussion Papers 15318, Centre for Economic Policy Research.
- Andrew C. Chang & Phillip Li, 2022. "Is Economics Research Replicable? Sixty Published Papers From Thirteen Journals Say “Often Notâ€," Critical Finance Review, now publishers, vol. 11(1), pages 185-206, February.
- Abel Brodeur & Derek Mikola & Nikolai Cook & Lenka Fiala & Thomas Brailey & Ryan Briggs & Alexandra de Gendre & Yannick Dupraz & Jacopo Gabani & Romain Gauriot & Joanne Haddad & Goncalo Lima & Jörg An, 2026.
"Publisher Correction: Reproducibility and robustness of economics and political science research,"
Nature, Nature, vol. 653(8114), pages 7-7, May.
- Abel Brodeur & Derek Mikola & Nikolai Cook & Lenka Fiala & Thomas Brailey & Ryan Briggs & Alexandra de Gendre & Yannick Dupraz & Jacopo Gabani & Romain Gauriot & Joanne Haddad & Goncalo Lima & Jörg An, 2026. "Reproducibility and robustness of economics and political science research," Nature, Nature, vol. 652(8108), pages 151-156, April.
- Abel Brodeur & Derek Mikola & Nikolai Cook & Lenka Fiala & Thomas Brailey & Ryan Briggs & Alexandra de Gendre & Yannick Dupraz & Jacopo Gabani & Romain Gauriot & Joanne Haddad & Goncalo Lima & Jörg An, 2026. "Reproducibility and robustness of economics and political science research," Post-Print hal-05642219, HAL.
- Brodeur, Abel & Mikola, Derek & Cook, Nikolai & Fiala, Lenka & Brailey, Thomas & Briggs, Ryan & de Gendre, Alexandra & Dupraz, Yannick & Gabani, Jacopo & Gauriot, Romain & Haddad, Joanne & Lima, Gonca, 2026. "Reproducibility and robustness of economics and political science research," LSE Research Online Documents on Economics 137919, London School of Economics and Political Science, LSE Library.
- Abel Brodeur & Derek Mikola & Nikolai Cook & Lenka Fiala & Thomas Brailey & Ryan Briggs & Alexandra de Gendre & Yannick Dupraz & Jacopo Gabani & Romain Gauriot & Joanne Haddad & Goncalo Lima & Jörg An, 2026. "Reproducibility and robustness of economics and political science research," PSE-Ecole d'économie de Paris (Postprint) hal-05642219, HAL.
- Garret Christensen & Edward Miguel, 2018.
"Transparency, Reproducibility, and the Credibility of Economics Research,"
Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Christensen, Garret & Miguel, Edward, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," Department of Economics, Working Paper Series qt52h6x1cq, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Christensen, Garret & Miguel, Edward & Sturdy, Jennifer, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," MetaArXiv 9a3rw, Center for Open Science.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Hai Lu & Yichen Luo & Luping Yu, 2026. "How Well Do LLMs Perform in Peer Review? Evidence from Finance and Accounting," Papers 2610.18435, arXiv.org.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Ferman, Bruno & Finamor, Lucas, 2025.
"There must be an error here! Experimental evidence on coding errors' biases,"
I4R Discussion Paper Series
266, The Institute for Replication (I4R).
- Bruno Ferman & Lucas Finamor, 2025. "There must be an error here! Experimental evidence on coding errors' biases," Papers 2508.20069, arXiv.org, revised Sep 2025.
- Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
- Christophe Hurlin & Jean-Edouard Colliard & Christophe Pérignon, 2024.
"The Economics of Computational Reproducibility,"
Working Papers
hal-04759240, HAL.
- Hurlin, Christophe & Colliard, Jean-Edouard & Pérignon, Christophe, 2024. "The Economics of Computational Reproducibility," HEC Research Papers Series 1521, HEC Paris.
- Tom L. Dudda & Lars Hornuf, 2025. "The Perks and Perils of Machine Learning in Business and Economic Research," CESifo Working Paper Series 11721, CESifo.
- Anna Dreber & Magnus Johannesson, 2025.
"A framework for evaluating reproducibility and replicability in economics,"
Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
- Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
- Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Guillaume Coqueret & Joan Llull & Florian Oswald & Christophe Pérignon & Christoph Scheuch & Lars Vilhuber, 2026.
"Randomness In Large Language Models: What Researchers Need to Know (And Report),"
Working Papers
hal-05730402, HAL.
- Guillaume Coqueret & Joan Llull & Florian Oswald & Christophe P'erignon & Christoph Scheuch & Lars Vilhuber, 2026. "Randomness in large language models: What researchers need to know (and report)," Papers 2607.24372, arXiv.org.
- Coqueret, Guillaume & Llull, Joan & Oswald, Florian & Pérignon, Christophe & Scheuch, Christoph & Vilhuber, Lars, 2026. "Randomness In Large Language Models: What Researchers Need to Know (And Report)," HEC Research Papers Series 1648, HEC Paris.
- Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018.
"Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure,"
Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
- Frank Mueller-Langer & Patrick Andreoli-Versbach, 2014. "Open Access to Research Data: Strategic Delay and the Ambiguous Welfare Effects of Mandatory Data Disclosure," RatSWD Working Papers 239, German Data Forum (RatSWD).
- Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2014. "Open Access to Research Data: Strategic Delay and the Ambiguous Welfare Effects of Mandatory Data Disclosure," Discussion Papers in Economics 21037, University of Munich, Department of Economics.
- Müller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Munich Reprints in Economics 62831, University of Munich, Department of Economics.
- Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018.
"How to run an experimental auction: A review of recent advances,"
Working Papers
2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
- Canavari, Maurizio & Drichoutis, Andreas C. & Lusk, Jayson L. & Nayga, Rodolfo, 2018. "How to run an experimental auction: A review of recent advances," MPRA Paper 89715, University Library of Munich, Germany.
- Wenhao Zhou & Faqiang Liu & Hao Zheng & Rong Zhao, 2025. "Mitigating data bias and ensuring reliable evaluation of AI models with shortcut hull learning," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
- Jörg Ankel‐Peters & Nathan Fiala & Florian Neubauer, 2025. "Is economics self‐correcting? Replications in the American Economic Review," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 463-485, April.
- Le Zhang & Andreas Ortmann, 2012. "A reproduction and replication of Engel’s meta-study of dictator game experiments," Discussion Papers 2012-44, School of Economics, The University of New South Wales.
- Lukas Fink & Jan Marcus, 2025. "Replication code availability over time and across fields: Evidence from the German Socio‐Economic Panel," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 357-386, April.
- repec:bla:germec:v:11:y:2010:i::p:404-417 is not listed on IDEAS
- Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024.
"Reproducibility in Management Science,"
Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
- Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
- Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I Ozkes & The Management Science Reproducibility Collaboration, 2024. "Reproducibility in Management Science," Post-Print hal-04370984, HAL.
- Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Collaboration, Management Science Reproducibility, 2023. "Reproducibility in Management Science," OSF Preprints mydzv, Center for Open Science.
- Cristina Blanco-Perez & Abel Brodeur, 2020.
"Publication Bias and Editorial Statement on Negative Findings,"
The Economic Journal, Royal Economic Society, vol. 130(629), pages 1226-1247.
- Brodeur, Abel & Blanco-Perez, Cristina, 2017. "Publication Bias and Editorial Statement on Negative Findings," MetaArXiv xq9nt, Center for Open Science.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 190001, Canadian Centre for Health Economics.
- Cristina Blanco-Perez & Abel Brodeur, 2019. "Publication Bias and Editorial Statement on Negative Findings," Working Papers 1907E, University of Ottawa, Department of Economics.
- Blanco-Perez, Cristina & Brodeur, Abel, 2019. "Publication Bias and Editorial Statement on Negative Findings," IZA Discussion Papers 12493, IZA Network @ LISER.
- Zhou, Qiang & Yang, Yefei & Ma, Fangfang & Cheng, T.C. Edwin, 2026. "Multi-agent deep reinforcement learning for ordering and inventory allocation in a decentralized two-echelon dual-channel supply chain," International Journal of Production Economics, Elsevier, vol. 299(C).
- Michael Klesel & H. Felix Wittmann, 2025. "Retrieval-Augmented Generation (RAG)," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 67(4), pages 551-561, August.
- Michael A. Clemens, 2017.
"The Meaning Of Failed Replications: A Review And Proposal,"
Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
- Michael Clemens, 2015. "The Meaning of Failed Replications: A Review and Proposal," Working Papers 399, Center for Global Development.
- Clemens, Michael A., 2015. "The Meaning of Failed Replications: A Review and Proposal," IZA Discussion Papers 9000, IZA Network @ LISER.
- Vlaeminck, Sven, 2013. "Data Management in Scholarly Journals and Possible Roles for Libraries - Some Insights from EDaWaX," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 23(1), pages 49-79.
- Hasso, Tim & Brosnan, Mark & Ali, Searat & Chai, Daniel, 2026. "Perceived problems, causes, and solutions of finance research reproducibility and replicability: A pre-registered study," Pacific-Basin Finance Journal, Elsevier, vol. 98(C).
- Brodeur, Abel & Baki, Ghina Abdul & Fazio, Luna, 2026. "Mass Reproducibility in Psychological Science," I4R Discussion Paper Series 326, The Institute for Replication (I4R).
More about this item
JEL classification:
- C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
NEP fields
This paper has been announced in the following NEP Reports:- NEP-MIN-2026-10-12 (Mining)
- NEP-SOG-2026-10-12 (Sociology of Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:35782. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.
Printed from https://ideas.repec.org/p/nbr/nberwo/35782.html