IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0229345.html
   My bibliography  Save this article

A solution to minimum sample size for regressions

Author

Listed:
  • David G Jenkins
  • Pedro F Quintana-Ascencio

Abstract

Regressions and meta-regressions are widely used to estimate patterns and effect sizes in various disciplines. However, many biological and medical analyses use relatively low sample size (N), contributing to concerns on reproducibility. What is the minimum N to identify the most plausible data pattern using regressions? Statistical power analysis is often used to answer that question, but it has its own problems and logically should follow model selection to first identify the most plausible model. Here we make null, simple linear and quadratic data with different variances and effect sizes. We then sample and use information theoretic model selection to evaluate minimum N for regression models. We also evaluate the use of coefficient of determination (R2) for this purpose; it is widely used but not recommended. With very low variance, both false positives and false negatives occurred at N

Suggested Citation

  • David G Jenkins & Pedro F Quintana-Ascencio, 2020. "A solution to minimum sample size for regressions," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-15, February.
  • Handle: RePEc:plo:pone00:0229345
    DOI: 10.1371/journal.pone.0229345
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0229345
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0229345&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0229345?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    2. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    3. Tom Kolokotrones & Van Savage & Eric J. Deeds & Walter Fontana, 2010. "Curvature in metabolic scaling," Nature, Nature, vol. 464(7289), pages 753-756, April.
    4. Brian H. MacGillivray, 2019. "Null Hypothesis Testing ≠ Scientific Inference: A Critique of the Shaky Premise at the Heart of the Science and Values Debate, and a Defense of Value‐Neutral Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 39(7), pages 1520-1532, July.
    5. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    6. Valen E. Johnson & David Rossell, 2010. "On the use of non‐local prior densities in Bayesian hypothesis tests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(2), pages 143-170, March.
    7. Jessica Gurevitch & Julia Koricheva & Shinichi Nakagawa & Gavin Stewart, 2018. "Meta-analysis and the science of research synthesis," Nature, Nature, vol. 555(7695), pages 175-182, March.
    8. Megan L Head & Luke Holman & Rob Lanfear & Andrew T Kahn & Michael D Jennions, 2015. "The Extent and Consequences of P-Hacking in Science," PLOS Biology, Public Library of Science, vol. 13(3), pages 1-15, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas Dufhues & Judith Möllers & Antje Jantsch & Gertrud Buchenrieder & Laura Camfield, 2023. "Don’t Look Up! Individual Income Comparisons and Subjective Well-Being of Students in Thailand," Journal of Happiness Studies, Springer, vol. 24(2), pages 477-503, February.
    2. Takamitsu Iwata & Takufumi Yanagisawa & Yuji Ikegaya & Jonathan Smallwood & Ryohei Fukuma & Satoru Oshino & Naoki Tani & Hui Ming Khoo & Haruhiko Kishima, 2024. "Hippocampal sharp-wave ripples correlate with periods of naturally occurring self-generated thoughts in humans," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    3. Peter Mako & Andrej Dávid & Patrik Böhm & Sorin Savu, 2021. "Sustainable Transport in the Danube Region," Sustainability, MDPI, vol. 13(12), pages 1-21, June.
    4. Charatsari, Chrysanthi & Michailidis, Anastasios & Lioutas, Evagelos D., 2024. "Do farm advisory organizations promote sustainability? A study in Greece," Agricultural Systems, Elsevier, vol. 218(C).
    5. Li, Zekun & Chen, Zhenhua, 2023. "Predicting the future development scale of high-speed rail through the urban scaling law," Transportation Research Part A: Policy and Practice, Elsevier, vol. 174(C).
    6. Cody J. Strom & Samantha M. McDonald & Mary-Margaret Remchak & Kimberly A. Kew & Blake R. Rushing & Joseph A. Houmard & David A. Tulis & Roman Pawlak & George A. Kelley & Lisa Chasan-Taber & Edward Ne, 2022. "Maternal Aerobic Exercise, but Not Blood Docosahexaenoic Acid and Eicosapentaenoic Acid Concentrations, during Pregnancy Influence Infant Body Composition," IJERPH, MDPI, vol. 19(14), pages 1-15, July.
    7. Prahlad Lamichhane & Michalis Hadjikakou & Kelly K. Miller & Brett A. Bryan, 2022. "Climate change adaptation in smallholder agriculture: adoption, barriers, determinants, and policy implications," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 27(6), pages 1-24, August.
    8. Tobias Keller & Martin Glaum & Andreas Bausch & Thorsten Bunz, 2023. "The “CEO in context” technique revisited: A replication and extension of Hambrick and Quigley (2014)," Strategic Management Journal, Wiley Blackwell, vol. 44(4), pages 1111-1138, April.
    9. Saha, Papri & Sarkar, Debasish, 2022. "Allometric scaling of von Neumann entropy in animal connectomes and its evolutionary aspect," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 600(C).
    10. Giorgos Gouzoulis, 2022. "Financialisation, globalisation, and the industrial labour share: A comparison between Iran and Thailand," Industrial Relations Journal, Wiley Blackwell, vol. 53(1), pages 35-52, January.
    11. Erica Neri & Federica Genova & Marcello Stella & Alessandra Provera & Augusto Biasini & Francesca Agostini, 2022. "Parental Distress and Affective Perception of Hospital Environment after a Pictorial Intervention in a Neonatal Intensive Care Unit," IJERPH, MDPI, vol. 19(15), pages 1-13, July.
    12. Aghdam, Ali Nassiri & Behdarvand, Shahin & Sheshdeh, Mohammad Ghasemi, 2023. "The effect of credit composition on entrepreneurship," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 4(4).
    13. Stephen P. Groff, 2022. "A contemporary social contract: An exploration of enabling factors influencing climate policy intractability in developed nations," Global Policy, London School of Economics and Political Science, vol. 13(5), pages 721-735, November.
    14. Zhang, Yanquan & Chang, Ruidong & Zuo, Jian & Shabunko, Veronika & Zheng, Xian, 2023. "Regional disparity of residential solar panel diffusion in Australia: The roles of socio-economic factors," Renewable Energy, Elsevier, vol. 206(C), pages 808-819.
    15. Tharitsaya Kongkaew & Supa Tongkong & Sungworn Ngudgratoke, 2021. "Moderating Effects of Founders’ Role on the Influence of Internationalization on IPO Performance of Listed Companies in Thailand," IJFS, MDPI, vol. 9(3), pages 1-16, July.
    16. Fatma Abouelenien & Toyokazu Miura & Yutaka Nakashimada & Nooran S. Elleboudy & Mohammad S. Al-Harbi & Esmat F. Ali & Mustafa Shukry, 2021. "Optimization of Biomethane Production via Fermentation of Chicken Manure Using Marine Sediment: A Modeling Approach Using Response Surface Methodology," IJERPH, MDPI, vol. 18(22), pages 1-21, November.
    17. Robert Jeyakumar Nathan & Budi Setiawan & Mac Nhu Quynh, 2022. "Fintech and Financial Health in Vietnam during the COVID-19 Pandemic: In-Depth Descriptive Analysis," JRFM, MDPI, vol. 15(3), pages 1-19, March.
    18. Prahlad Lamichhane & Michalis Hadjikakou & Kelly K. Miller & Brett A. Bryan, 2022. "Climate change adaptation in smallholder agriculture: adoption, barriers, determinants, and policy implications," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 27(5), pages 1-24, June.
    19. Lyhour Hin & Chan Makara Mean & Meng Chhay Kim & Chhengven Chhoem & Borarin Bunthong & Lytour Lor & Taingaun Sourn & P. V. Vara Prasad, 2024. "Development and Performance Assessment of Sensor-Mounted Solar Dryer for Micro-Climatic Modeling and Optimization of Dried Fish Quality in Cambodia," Clean Technol., MDPI, vol. 6(3), pages 1-19, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    2. Martin Paldam, 2013. "Regression Costs Fall, Mining Ratios Rise, Publication Bias Looms, and Techniques Get Fancier: Reflections on Some Trends in Empirical Macroeconomics," Econ Journal Watch, Econ Journal Watch, vol. 10(2), pages 136-156, May.
    3. Klomp, Jeroen, 2023. "Political budget cycles in military expenditures: A meta-analysis," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 1083-1102.
    4. Phu Nguyen-Van & Anne Stenger & Tuyen Tiet, 2021. "Social incentive factors in interventions promoting sustainable behaviors: A meta-analysis," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-27, December.
    5. Nicolas Fleury & Fabrice Gilles, 2015. "A meta-regression analysis on intergenerational transmission of education: publication bias and genuine empirical effect," TEPP Working Paper 2015-02, TEPP.
    6. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna & Guidi, Francesco, 2016. "R&D and productivity in OECD firms and industries: A hierarchical meta-regression analysis," Research Policy, Elsevier, vol. 45(10), pages 2069-2086.
    7. Nazila Alinaghi & W. Robert Reed, 2021. "Taxes and Economic Growth in OECD Countries: A Meta-analysis," Public Finance Review, , vol. 49(1), pages 3-40, January.
    8. Stephan B Bruns & John P A Ioannidis, 2016. "p-Curve and p-Hacking in Observational Research," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-13, February.
    9. Hajko, Vladimír, 2017. "The failure of Energy-Economy Nexus: A meta-analysis of 104 studies," Energy, Elsevier, vol. 125(C), pages 771-787.
    10. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2015. "Replications in Economics: A Progress Report," Econ Journal Watch, Econ Journal Watch, vol. 12(2), pages 164–191-1, May.
    11. Beltrán, Allan & Alatorre, José Eduardo & Ferrer, Jimy & Galindo, Luis Miguel, 2017. "Efectos potenciales de un impuesto al carbono sobre el producto interno bruto en los países de América Latina: estimaciones preliminares e hipotéticas a partir de un metaanálisis y una función de tran," Documentos de Proyectos 41867, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    12. Petr Polák, 2019. "The Euro'S Trade Effect: A Meta‐Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 33(1), pages 101-124, February.
    13. Lan Nguyen, Thi Mai & Papyrakis, Elissaios & van Bergeijk, Peter A.G., 2021. "Publication bias in the price effects of monetary policy: A meta-regression analysis for emerging and developing economies," International Review of Economics & Finance, Elsevier, vol. 71(C), pages 567-583.
    14. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    15. Branger, Frédéric & Quirion, Philippe, 2014. "Would border carbon adjustments prevent carbon leakage and heavy industry competitiveness losses? Insights from a meta-analysis of recent economic studies," Ecological Economics, Elsevier, vol. 99(C), pages 29-39.
    16. Markus Hang & Jerome Geyer‐Klingeberg & Andreas Rathgeber & Stefan Stöckl, 2018. "Economic Development Matters: A Meta‐Regression Analysis on the Relation between Environmental Management and Financial Performance," Journal of Industrial Ecology, Yale University, vol. 22(4), pages 720-744, August.
    17. Liang-Cheng Zhang & Andrew C. Worthington, 2018. "Explaining Estimated Economies of Scale and Scope in Higher Education: A Meta-Regression Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(2), pages 156-173, March.
    18. Germà Bel & Mildred E. Warner, 2016. "Factors explaining inter-municipal cooperation in service delivery: a meta-regression analysis," Journal of Economic Policy Reform, Taylor and Francis Journals, vol. 19(2), pages 91-115, April.
    19. de Freitas, Carlos Eduardo & Paes, Nelson Leitão, 2019. "The collapse of Brazilian Social Security: Macroeconomic impacts of the increase of the minimum age of PEC nº 287/2016 reform," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 39(1), July.
    20. Martin E Héroux & Janet L Taylor & Simon C Gandevia, 2015. "The Use and Abuse of Transcranial Magnetic Stimulation to Modulate Corticospinal Excitability in Humans," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0229345. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.