IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/7enxu_v1.html

Reproducibility: an open-source tool for computational hypothesis testing in natural language

Author

Listed:
  • Jimez, Bruno Oliveira Costa

Abstract

We present Reproducibility, an open-source software system for quantitative evaluation of scientific hypotheses formulated in natural language. The system converts scientific statements written in Portuguese or English into executable mathematical functions, assesses their internal consistency through Monte Carlo simulation, and measures their predictive power against real empirical data from open sources (World Bank, NASA POWER, IBGE) or user-supplied CSV files. We propose a composite reproducibility score — combining simulated consistency and empirical fit — and validate it against five cases with expected behaviour established by the literature.

Suggested Citation

  • Jimez, Bruno Oliveira Costa, 2026. "Reproducibility: an open-source tool for computational hypothesis testing in natural language," MetaArXiv 7enxu_v1, Center for Open Science.
    • Handle: RePEc:osf:metaar:7enxu_v1
    DOI: 10.31219/osf.io/7enxu_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/69c9d64aa3a18851ae73f715/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/7enxu_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jacob A. Mincer, 1974. "Introduction to "Schooling, Experience, and Earnings"," NBER Chapters, in: Schooling, Experience, and Earnings, pages 1-4, National Bureau of Economic Research, Inc.
    2. Jacob A. Mincer, 1974. "Schooling, Experience, and Earnings," NBER Books, National Bureau of Economic Research, Inc, number minc74-1, January.
    3. Gene M. Grossman & Alan B. Krueger, 1991. "Environmental Impacts of a North American Free Trade Agreement," NBER Working Papers 3914, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Germani, Anna Rita & Morone, Piergiuseppe & Testa, Giuseppina, 2011. "Enforcement and air pollution: an environmental justice case study," MPRA Paper 38656, University Library of Munich, Germany.
    2. Paul Glewwe & Hasan Gul & Aysit Tansel & Suzanne Wisniewski, 2026. "The Impact of Vision Problems on Households' Incomes: Evidence From the 2019 and 2022 Rounds of the Turkey Health Survey," Journal of International Development, John Wiley & Sons, Ltd., vol. 38(3), pages 505-522, April.
    3. Ivana Fellini & Raffaele Guetto & Emilio Reyneri, 2018. "Poor Returns to Origin-Country Education for Non-Western Immigrants in Italy: An Analysis of Occupational Status on Arrival and Mobility," Social Inclusion, Cogitatio Press, vol. 6(3), pages 34-47.
    4. Katarzyna Growiec & Jakub Growiec, 2016. "Bridging Social Capital and Individual Earnings: Evidence for an Inverted U," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 127(2), pages 601-631, June.
    5. Kaspar W thrich, 2013. "Set Identification of Generalized Linear Predictors in the Presence of Non-Classical Measurement Errors," Diskussionsschriften dp1304, Universitaet Bern, Departement Volkswirtschaft.
    6. Jin Jiang & Hon-Kwong Lui, 2025. "Lifetime Earnings Premium of Higher Education: Evidence from the 40-Year Career of the 1951–1955 Birth Cohort in Hong Kong," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(3), pages 1-20, May.
    7. Nicholas Sim, 2015. "Astronomics In Action: The Graduate Earnings Premium And The Dragon Effect In Singapore," Economic Inquiry, Western Economic Association International, vol. 53(2), pages 922-939, April.
    8. Emanuela di Gropello, 2006. "Meeting the Challenges of Secondary Education in Latin America and East Asia : Improving Efficiency and Resource Mobilization," World Bank Publications - Books, The World Bank Group, number 7173, April.
    9. Aidis, Ruta & van Praag, Mirjam, 2007. "Illegal entrepreneurship experience: Does it make a difference for business performance and motivation?," Journal of Business Venturing, Elsevier, vol. 22(2), pages 283-310, March.
    10. Benoit Dostie & Pierre Thomas Léger, 2014. "Firm-Sponsored Classroom Training: Is It Worth It for Older Workers?," Canadian Public Policy, University of Toronto Press, vol. 40(4), pages 377-390, December.
    11. Zeng, Jinli & Zhang, Jie, 2022. "Education policies and development with threshold human capital externalities," Economic Modelling, Elsevier, vol. 108(C).
    12. Yi Fan, 2017. "Does Adversity Affect Long-Term Consumption and Financial Behaviour? Evidence from China's Rustication Programme," ERES eres2017_148, European Real Estate Society (ERES).
    13. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    14. Sandra Nieto & Raúl Ramos, 2013. "Non-Formal Education, Overeducation And Wages," Revista de Economia Aplicada, Universidad de Zaragoza, Departamento de Estructura Economica y Economia Publica, vol. 21(1), pages 5-28, Spring.
    15. Latukha, Marina & Dikova, Desislava & Panibratov, Andrei & Kuleshov, Nikita, 2026. "The double bind: Human resource management under sanctions and skilled labor exodus," International Business Review, Elsevier, vol. 35(1).
    16. Cawley, John & Morrisey, Michael A., 2007. "The earnings of U.S. health economists," Journal of Health Economics, Elsevier, vol. 26(2), pages 358-372, March.
    17. Steffen Hillmert, 2002. "Labour Market Integration and Institutions: An Anglo-german Comparison," Work, Employment & Society, British Sociological Association, vol. 16(4), pages 675-701, December.
    18. Contreras, Dulce/D & Sánchez, Rosario/R & Soria, Delfina/D, 2012. "Mobility, wages and gender across Europe," MPRA Paper 42589, University Library of Munich, Germany, revised Nov 2012.
    19. James J. Heckman, 2019. "The Race Between Demand and Supply: Tinbergen’s Pioneering Studies of Earnings Inequality," De Economist, Springer, vol. 167(3), pages 243-258, September.
    20. Peydró, José-Luis & Jasova, Martina & Mendicino, Caterina & Panetti, Ettore & Supera, Dominik, 2021. "Monetary Policy, Labor Income Redistribution and the Credit Channel: Evidence from Matched Employer-Employee and Credit Registe," CEPR Discussion Papers 16549, Centre for Economic Policy Research.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:7enxu_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.