IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v10y1990i1p131-136.html

The Effects of Publication Selection on Test Probabilities and Estimator Distributions

Author

Listed:
  • Frank T. Denton

Abstract

Editorial decisions, based in part on reported hypothesis test results, affect the probabilities associated with those results: the probabilities of Type I and Type II errors thus become different for readers than for authors. The distributions of published parameter estimates are similarly affected. A framework for studying the consequences of test‐based information filtering is developed and illustrative examples are provided. The examples indicate that filtering can markedly distort the power functions of hypothesis tests and can induce large estimator biases and increases in mean square error. It is argued that test‐based filtering is relevant not only to journal publication but to other forms of information dissemination as well.

Suggested Citation

  • Frank T. Denton, 1990. "The Effects of Publication Selection on Test Probabilities and Estimator Distributions," Risk Analysis, John Wiley & Sons, vol. 10(1), pages 131-136, March.
    • Handle: RePEc:wly:riskan:v:10:y:1990:i:1:p:131-136
    DOI: 10.1111/j.1539-6924.1990.tb01027.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.1990.tb01027.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1539-6924.1990.tb01027.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Denton, Frank T, 1985. "Data Mining as an Industry," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 124-127, February.
    2. Denton, Frank T., 1987. "The power function of a published hypothesis test," Economics Letters, Elsevier, vol. 25(2), pages 101-104.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    2. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    3. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    4. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    5. Cefis, Elena & Coad, Alex & Lucini-Paioni, Alessandro, 2023. "Landmarks as lighthouses: firms' innovation and modes of exit during the business cycle," Research Policy, Elsevier, vol. 52(8).
    6. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    7. Alex Coad & Stjepan Srhoj, 2020. "Catching Gazelles with a Lasso: Big data techniques for the prediction of high-growth firms," Small Business Economics, Springer, vol. 55(3), pages 541-565, October.
    8. repec:bla:jfinan:v:58:y:2003:i:5:p:1969-1996 is not listed on IDEAS
    9. David Roodman, 2009. "A Note on the Theme of Too Many Instruments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(1), pages 135-158, February.
    10. Kilpatrick, Henry E., Jr., 1998. "Some useful methods for measuring the benefits of social science research," Impact Assessment Discussion Papers 48290, CGIAR, International Food Policy Research Institute (IFPRI).
    11. Susan Feigenbaum & David M. Levy, 1996. "The Technological Obsolescence Of Scientific Fraud," Rationality and Society, , vol. 8(3), pages 261-276, August.
    12. Julia Campos & Neil R. Ericsson, 1999. "Contructive data mining: modeling consumers' expenditure in Venezuela," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 226-240.
    13. J. Annaert & W. Van Hyfte, 2006. "Long-Horizon Mean Reversion for the Brussels Stock Exchange: Evidence for the 19th Century," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 06/376, Ghent University, Faculty of Economics and Business Administration.
    14. David F. Hendry, 2024. "A Brief History of General‐to‐specific Modelling," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(1), pages 1-20, February.
    15. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
    16. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    17. Jean-Bernard Chatelain, 2010. "Can Statistics Do without Artefacts?," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00750495, HAL.
    18. Meisel, Stephan & Mattfeld, Dirk, 2010. "Synergies of Operations Research and Data Mining," European Journal of Operational Research, Elsevier, vol. 206(1), pages 1-10, October.
    19. Cheol‐Ho Park & Scott H. Irwin, 2007. "What Do We Know About The Profitability Of Technical Analysis?," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 786-826, September.
    20. Ashish Arora & Michelle Gittelman & Sarah Kaplan & John Lynch & Will Mitchell & Nicolaj Siggelkow & Brent Goldfarb & Andrew A. King, 2016. "Scientific apophenia in strategic management research: Significance tests & mistaken inference," Strategic Management Journal, Wiley Blackwell, vol. 37(1), pages 167-176, January.
    21. Lutz Kilian & Clara Vega, 2011. "Do Energy Prices Respond to U.S. Macroeconomic News? A Test of the Hypothesis of Predetermined Energy Prices," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 660-671, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:10:y:1990:i:1:p:131-136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.