IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0229345.html

A solution to minimum sample size for regressions

Author

Listed:
  • David G Jenkins
  • Pedro F Quintana-Ascencio

Abstract

Regressions and meta-regressions are widely used to estimate patterns and effect sizes in various disciplines. However, many biological and medical analyses use relatively low sample size (N), contributing to concerns on reproducibility. What is the minimum N to identify the most plausible data pattern using regressions? Statistical power analysis is often used to answer that question, but it has its own problems and logically should follow model selection to first identify the most plausible model. Here we make null, simple linear and quadratic data with different variances and effect sizes. We then sample and use information theoretic model selection to evaluate minimum N for regression models. We also evaluate the use of coefficient of determination (R2) for this purpose; it is widely used but not recommended. With very low variance, both false positives and false negatives occurred at N

Suggested Citation

  • David G Jenkins & Pedro F Quintana-Ascencio, 2020. "A solution to minimum sample size for regressions," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-15, February.
  • Handle: RePEc:plo:pone00:0229345
    DOI: 10.1371/journal.pone.0229345
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0229345
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0229345&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0229345?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    2. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    3. Tom Kolokotrones & Van Savage & Eric J. Deeds & Walter Fontana, 2010. "Curvature in metabolic scaling," Nature, Nature, vol. 464(7289), pages 753-756, April.
    4. Brian H. MacGillivray, 2019. "Null Hypothesis Testing ≠ Scientific Inference: A Critique of the Shaky Premise at the Heart of the Science and Values Debate, and a Defense of Value‐Neutral Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 39(7), pages 1520-1532, July.
    5. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    6. Valen E. Johnson & David Rossell, 2010. "On the use of non‐local prior densities in Bayesian hypothesis tests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(2), pages 143-170, March.
    7. Jessica Gurevitch & Julia Koricheva & Shinichi Nakagawa & Gavin Stewart, 2018. "Meta-analysis and the science of research synthesis," Nature, Nature, vol. 555(7695), pages 175-182, March.
    8. Megan L Head & Luke Holman & Rob Lanfear & Andrew T Kahn & Michael D Jennions, 2015. "The Extent and Consequences of P-Hacking in Science," PLOS Biology, Public Library of Science, vol. 13(3), pages 1-15, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, IZA Network @ LISER.
    2. repec:ejw:journl:v:10:y:2013:i:2:p:136-156 is not listed on IDEAS
    3. Klomp, Jeroen, 2023. "Political budget cycles in military expenditures: A meta-analysis," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 1083-1102.
    4. Nicolas Fleury & Fabrice Gilles, 2015. "A meta-regression analysis on intergenerational transmission of education: publication bias and genuine empirical effect," TEPP Working Paper 2015-02, TEPP.
    5. Sapana Bastola & Jerrod Penn & Juyoung Yoo, 2026. "Wetland proximity: a meta-analysis of hedonic property values," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 28(2), pages 543-563, April.
    6. Stephan B Bruns & John P A Ioannidis, 2016. "p-Curve and p-Hacking in Observational Research," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-13, February.
    7. Hajko, Vladimír, 2017. "The failure of Energy-Economy Nexus: A meta-analysis of 104 studies," Energy, Elsevier, vol. 125(C), pages 771-787.
    8. Beltrán, Allan & Alatorre, José Eduardo & Ferrer, Jimy & Galindo, Luis Miguel, 2017. "Efectos potenciales de un impuesto al carbono sobre el producto interno bruto en los países de América Latina: estimaciones preliminares e hipotéticas a partir de un metaanálisis y una función de transferencia de beneficios," Documentos de Proyectos 41867, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    9. Lan Nguyen, Thi Mai & Papyrakis, Elissaios & van Bergeijk, Peter A.G., 2021. "Publication bias in the price effects of monetary policy: A meta-regression analysis for emerging and developing economies," International Review of Economics & Finance, Elsevier, vol. 71(C), pages 567-583.
    10. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    11. Branger, Frédéric & Quirion, Philippe, 2014. "Would border carbon adjustments prevent carbon leakage and heavy industry competitiveness losses? Insights from a meta-analysis of recent economic studies," Ecological Economics, Elsevier, vol. 99(C), pages 29-39.
    12. Nazila Alinaghi & W. Robert Reed, 2021. "Taxes and Economic Growth in OECD Countries: A Meta-analysis," Public Finance Review, , vol. 49(1), pages 3-40, January.
    13. Markus Hang & Jerome Geyer‐Klingeberg & Andreas Rathgeber & Stefan Stöckl, 2018. "Economic Development Matters: A Meta‐Regression Analysis on the Relation between Environmental Management and Financial Performance," Journal of Industrial Ecology, Yale University, vol. 22(4), pages 720-744, August.
    14. de Freitas, Carlos Eduardo & Paes, Nelson Leitão, 2019. "The collapse of Brazilian Social Security: Macroeconomic impacts of the increase of the minimum age of PEC nº 287/2016 reform," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 39(1), July.
    15. Martin E Héroux & Janet L Taylor & Simon C Gandevia, 2015. "The Use and Abuse of Transcranial Magnetic Stimulation to Modulate Corticospinal Excitability in Humans," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-10, December.
    16. Pierre J C Chuard & Milan Vrtílek & Megan L Head & Michael D Jennions, 2019. "Evidence that nonsignificant results are sometimes preferred: Reverse P-hacking or selective reporting?," PLOS Biology, Public Library of Science, vol. 17(1), pages 1-7, January.
    17. Stephan B. Bruns & David I. Stern, 2019. "Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models," Empirical Economics, Springer, vol. 56(3), pages 797-830, March.
    18. Cerdá, Emilio & López-Otero, Xiral & Quiroga, Sonia & Soliño, Mario, 2024. "Willingness to pay for renewables: Insights from a meta-analysis of choice experiments," Energy Economics, Elsevier, vol. 130(C).
    19. Subroy, Vandana & Gunawardena, Asha & Polyakov, Maksym & Pandit, Ram & Pannell, David J., 2019. "The worth of wildlife: A meta-analysis of global non-market values of threatened species," Ecological Economics, Elsevier, vol. 164(C), pages 1-1.
    20. Asatryan, Zareh & Havlik, Annika & Heinemann, Friedrich & Nover, Justus, 2020. "Biases in fiscal multiplier estimates," European Journal of Political Economy, Elsevier, vol. 63(C).
    21. Wimmer, Thomas & Geyer-Klingeberg, Jerome & Hütter, Marie & Schmid, Florian & Rathgeber, Andreas, 2021. "The impact of speculation on commodity prices: A Meta-Granger analysis," Journal of Commodity Markets, Elsevier, vol. 22(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0229345. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.