IDEAS home Printed from https://ideas.repec.org/p/mit/sloanp/2249.html
   My bibliography  Save this paper

Data-snooping biases in tests of financial asset pricing models

Author

Listed:
  • Lo, Andrew W. (Andrew Wen-Chuan)
  • MacKinlay, Archie Craig, 1955-

Abstract

We investigate the extent to which tests of financial asset pricing models may be biased by using properties of the data to construct the test statistics. Specifically, we focus on tests using returns to portfolios of common stock where portfolios are constructed by sorting on some empirically motivated characteristic of the securities such as market value of equity. We present both analytical calculations and Monte Carlo simulations that show the effects of this type of data-snooping to be substantial. Even when the sorting characteristic is only marginally correlated with individual security statistics, 5 percent tests based on sorted portfolio returns may reject with probability one under the null hypothesis. This bias is shown to worsen as the number of securities increases given a fixed number of portfolios, and as the number of portfolios decreases given a fixed number of securities. We provide an empirical example that illustrates the practical relevance of these biases.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Lo, Andrew W. (Andrew Wen-Chuan) & MacKinlay, Archie Craig, 1955-, 1989. "Data-snooping biases in tests of financial asset pricing models," Working papers 3020-89., Massachusetts Institute of Technology (MIT), Sloan School of Management.
  • Handle: RePEc:mit:sloanp:2249
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/1721.1/2249
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chan, K C & Chen, Nai-Fu, 1988. " An Unconditional Asset-Pricing Test and the Role of Firm Size as an Instrumental Variable for Risk," Journal of Finance, American Finance Association, vol. 43(2), pages 309-325, June.
    2. Josef Lakonishok, Seymour Smidt, 1988. "Are Seasonal Anomalies Real? A Ninety-Year Perspective," Review of Financial Studies, Society for Financial Studies, vol. 1(4), pages 403-425.
    3. Huberman, Gur & Kandel, Shmuel & Stambaugh, Robert F, 1987. "Mimicking Portfolios and Exact Arbitrage Pricing," Journal of Finance, American Finance Association, vol. 42(1), pages 1-9, March.
    4. Huberman, Gur & Kandel, Shmuel, 1987. "Mean-Variance Spanning," Journal of Finance, American Finance Association, vol. 42(4), pages 873-888, September.
    5. Gibbons, Michael R & Ross, Stephen A & Shanken, Jay, 1989. "A Test of the Efficiency of a Given Portfolio," Econometrica, Econometric Society, vol. 57(5), pages 1121-1152, September.
    6. Gibbons, Michael R., 1982. "Multivariate tests of financial models : A new approach," Journal of Financial Economics, Elsevier, vol. 10(1), pages 3-27, March.
    7. Blume, Marshall E, 1970. "Portfolio Theory: A Step Toward Its Practical Application," The Journal of Business, University of Chicago Press, vol. 43(2), pages 152-173, April.
    8. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    9. Chamberlain, Gary, 1983. "Funds, Factors, and Diversification in Arbitrage Pricing Models," Econometrica, Econometric Society, vol. 51(5), pages 1305-1323, September.
    10. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    11. Shanken, Jay, 1985. "Multivariate tests of the zero-beta CAPM," Journal of Financial Economics, Elsevier, vol. 14(3), pages 327-348, September.
    12. Kandel, Shmuel & Stambaugh, Robert F., 1987. "On correlations and inferences about mean-variance efficiency," Journal of Financial Economics, Elsevier, vol. 18(1), pages 61-90, March.
    13. Lehmann, Bruce N. & Modest, David M., 1988. "The empirical foundations of the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 21(2), pages 213-254, September.
    14. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    15. Arne Sandström, 1987. "Asymptotic normality of linear functions of concomitants of order statistics," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 34(1), pages 129-142, December.
    16. Merton, Robert C., 1985. "On the current state of the stock market rationality hypothesis," Working papers 1717-85., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    17. Chen, Nai-Fu & Roll, Richard & Ross, Stephen A, 1986. "Economic Forces and the Stock Market," The Journal of Business, University of Chicago Press, vol. 59(3), pages 383-403, July.
    18. Brown, Philip & Kleidon, Allan W. & Marsh, Terry A., 1983. "New evidence on the nature of size-related anomalies in stock prices," Journal of Financial Economics, Elsevier, vol. 12(1), pages 33-56, June.
    19. Banz, Rolf W., 1981. "The relationship between return and market value of common stocks," Journal of Financial Economics, Elsevier, vol. 9(1), pages 3-18, March.
    20. MacKinlay, A. Craig, 1987. "On multivariate tests of the CAPM," Journal of Financial Economics, Elsevier, vol. 18(2), pages 341-371, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. MacKinlay, A. Craig, 1995. "Multifactor models do not explain deviations from the CAPM," Journal of Financial Economics, Elsevier, vol. 38(1), pages 3-28, May.
    2. Shanken, Jay & Weinstein, Mark I., 2006. "Economic forces and the stock market revisited," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 129-144, March.
    3. A. Craig MacKinlay, 1994. "Multifactor Models Do Not Explain Deviations from the CAPM," NBER Working Papers 4756, National Bureau of Economic Research, Inc.
    4. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    5. Amit Goyal, 2012. "Empirical cross-sectional asset pricing: a survey," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 26(1), pages 3-38, March.
    6. Attiya Y. Javed, 2000. "Alternative Capital Asset Pricing Models: A Review of Theory and Evidence," PIDE-Working Papers 2000:179, Pakistan Institute of Development Economics.
    7. Fernando Rubio, 2005. "Eficiencia De Mercado, Administracion De Carteras De Fondos Y Behavioural Finance," Finance 0503028, University Library of Munich, Germany, revised 23 Jul 2005.
    8. Ericsson, Johan & Karlsson, Sune, 2003. "Choosing Factors in a Multifactor Asset Pricing Model: A Bayesian Approach," SSE/EFI Working Paper Series in Economics and Finance 524, Stockholm School of Economics, revised 12 Feb 2004.
    9. Zura Kakushadze, 2014. "4-Factor Model for Overnight Returns," Papers 1410.5513, arXiv.org, revised Jun 2015.
    10. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, August.
    11. Choi, Yoon K., 1995. "The sensitivity in tests of the efficiency of a portfolio and portfolio performance measurement," The Quarterly Review of Economics and Finance, Elsevier, vol. 35(2), pages 187-206.
    12. Grauer, Robert R. & Janmaat, Johannus A., 2009. "On the power of cross-sectional and multivariate tests of the CAPM," Journal of Banking & Finance, Elsevier, vol. 33(5), pages 775-787, May.
    13. Harvey, Campbell R, 1995. "Predictable Risk and Returns in Emerging Markets," Review of Financial Studies, Society for Financial Studies, vol. 8(3), pages 773-816.
    14. Zura Kakushadze, 2014. "Russian-Doll Risk Models," Papers 1412.4342, arXiv.org, revised Nov 2017.
    15. Lo, Andrew W. & Mackinlay, A. Craig, 1997. "Maximizing Predictability In The Stock And Bond Markets," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 102-134, January.
    16. Zura Kakushadze & Willie Yu, 2016. "Multifactor Risk Models and Heterotic CAPM," Papers 1602.04902, arXiv.org, revised Mar 2016.
    17. Kim, Soohun & Skoulakis, Georgios, 2018. "Ex-post risk premia estimation and asset pricing tests using large cross sections: The regression-calibration approach," Journal of Econometrics, Elsevier, vol. 204(2), pages 159-188.
    18. Zura Kakushadze, 2015. "Heterotic Risk Models," Papers 1508.04883, arXiv.org, revised Jan 2016.
    19. Kevin P. Evans & Alan E. H. Speight, 2006. "Real‐Time Risk Pricing Over the Business Cycle: Some Evidence for the UK," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 33(1‐2), pages 263-283, January.
    20. Enrique Sentana, 2009. "The econometrics of mean-variance efficiency tests: a survey," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 65-101, November.

    More about this item

    Keywords

    HD28 .M414 no.3020-; 89; 1989c;
    All these keywords.

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mit:sloanp:2249. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christian Zimmermann). General contact details of provider: https://edirc.repec.org/data/ssmitus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.