IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this article or follow this journal

Is Time-Series-Based Predictability Evident in Real Time?

  • Michael Cooper

    (Purdue University)

  • Huseyin Gulen

    (Virginia Tech)

Registered author(s):

    We show that out-of-sample tests used in the time-series predictability literature may suffer from test size problems related to the common practice of exogenous specification of critical parameters, such as the choice of predictive variables, traded assets, and in-sample estimation periods. We perform specification searches across these parameters and find that rejections of the null hypothesis of no predictability are very sensitive to minor variations in parameter specification. We perform simulations to determine if the observed predictability in the data is real. The simulations suggest that much of the literature's out-of-sample evidence of time-series-based predictability is consistent with data snooping.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://www.journals.uchicago.edu/cgi-bin/resolve?JB790309
    File Function: main text
    Download Restriction: Access to the online full text or PDF requires a subscription.

    As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

    Article provided by University of Chicago Press in its journal Journal of Business.

    Volume (Year): 79 (2006)
    Issue (Month): 3 (May)
    Pages: 1263-1292

    as
    in new window

    Handle: RePEc:ucp:jnlbus:v:79:y:2006:i:3:p:1263-1292
    Contact details of provider: Web page: http://www.journals.uchicago.edu/JB/

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Roll, Richard & Ross, Stephen A, 1980. " An Empirical Investigation of the Arbitrage Pricing Theory," Journal of Finance, American Finance Association, vol. 35(5), pages 1073-1103, December.
    2. Stephen J. Brown & William N. Goetzmann & Alok Kumar, 1998. "The Dow Theory: William Peter Hamilton's Track Record Re-Considered," New York University, Leonard N. Stern School Finance Department Working Paper Seires 98-013, New York University, Leonard N. Stern School of Business-.
    3. Desai, Hemang & Jain, Prem C, 1995. " An Analysis of the Recommendations of the "Superstar" Money Managers at Barron's Annual Roundtable," Journal of Finance, American Finance Association, vol. 50(4), pages 1257-73, September.
    4. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, 08.
    5. Ferson, Wayne E & Harvey, Campbell R, 1993. "The Risk and Predictability of International Equity Returns," Review of Financial Studies, Society for Financial Studies, vol. 6(3), pages 527-66.
    6. Campbell, John Y & Shiller, Robert J, 1988. " Stock Prices, Earnings, and Expected Dividends," Journal of Finance, American Finance Association, vol. 43(3), pages 661-76, July.
    7. Cochrane, John H, 1991. " Production-Based Asset Pricing and the Link between Stock Returns and Economic Fluctuations," Journal of Finance, American Finance Association, vol. 46(1), pages 209-37, March.
    8. Robert J. Shiller, 1984. "Stock Prices and Social Dynamics," Cowles Foundation Discussion Papers 719R, Cowles Foundation for Research in Economics, Yale University.
    9. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    10. Kandel, Shmuel & Stambaugh, Robert F, 1996. " On the Predictability of Stock Returns: An Asset-Allocation Perspective," Journal of Finance, American Finance Association, vol. 51(2), pages 385-424, June.
    11. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-33, October.
    12. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    13. Andrew W. Lo & A. Craig MacKinlay, 1995. "Maximizing Predictability in the Stock and Bond Markets," NBER Working Papers 5027, National Bureau of Economic Research, Inc.
    14. Ait-Sahalia, Y. & Brandt, M.W., 2001. "Variable Selection for Portfolio Choice," Papers 34, Manitoba - Department of Economics.
    15. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    16. Philippe Jorion & William N. Goetzmann, 1999. "Global Stock Markets in the Twentieth Century," Journal of Finance, American Finance Association, vol. 54(3), pages 953-980, 06.
    17. Lubo Pástor, . "Portfolio Selection and Asset Pricing Models," CRSP working papers 356, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
    18. Jon A. Christopherson & Wayne E. Ferson & Debra A. Glassman, 1996. "Conditioning Manager Alphas on Economic Information: Another Look at the Persistence of Performance," NBER Working Papers 5830, National Bureau of Economic Research, Inc.
    19. Breen, William & Glosten, Lawrence R & Jagannathan, Ravi, 1989. " Economic Significance of Predictable Variations in Stock Index Returns," Journal of Finance, American Finance Association, vol. 44(5), pages 1177-89, December.
    20. Fama, Eugene F, 1991. " Efficient Capital Markets: II," Journal of Finance, American Finance Association, vol. 46(5), pages 1575-617, December.
    21. Ryan Sullivan & Allan Timmermann & Halbert White, 1999. "Data-Snooping, Technical Trading Rule Performance, and the Bootstrap," Journal of Finance, American Finance Association, vol. 54(5), pages 1647-1691, October.
    22. Brad Barber, 2001. "Can Investors Profit from the Prophets? Security Analyst Recommendations and Stock Returns," Journal of Finance, American Finance Association, vol. 56(2), pages 531-563, 04.
    23. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    24. Robert J. Shiller & John Y. Campbell, 1986. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," Cowles Foundation Discussion Papers 812, Cowles Foundation for Research in Economics, Yale University.
    25. Owen Lamont, 1998. "Earnings and Expected Returns," Journal of Finance, American Finance Association, vol. 53(5), pages 1563-1587, October.
    26. Donald B. Keim & Robert F. Stambaugh, . "Predicting Returns in the Stock and Bond Markets," Rodney L. White Center for Financial Research Working Papers 15-85, Wharton School Rodney L. White Center for Financial Research.
    27. Brad M. Barber & Terrance Odean, 2000. "Trading Is Hazardous to Your Wealth: The Common Stock Investment Performance of Individual Investors," Journal of Finance, American Finance Association, vol. 55(2), pages 773-806, 04.
    28. Andrew Metrick, 1998. "Performance Evaluation with Transactions Data: The Stock Selection of Investment Newsletters," NBER Working Papers 6648, National Bureau of Economic Research, Inc.
    29. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1414, 08.
    30. Norman R. Swanson & Halbert White, 1995. "A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks," Macroeconomics 9503004, EconWPA.
    31. Foster, F Douglas & Smith, Tom & Whaley, Robert E, 1997. " Assessing Goodness-of-Fit of Asset Pricing Models: The Distribution of the Maximal R-Squared," Journal of Finance, American Finance Association, vol. 52(2), pages 591-607, June.
    32. Pesaran, M Hashem & Timmermann, Allan, 1995. " Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-28, September.
    33. Michael Cooper & Roberto C. Gutierrez, Jr. & Bill Marcum, 2005. "On the Predictability of Stock Returns in Real Time," The Journal of Business, University of Chicago Press, vol. 78(2), pages 469-500, March.
    34. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-86.
    35. Ferson, Wayne E & Harvey, Campbell R, 1991. "The Variation of Economic Risk Premiums," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 385-415, April.
    36. Denton, Frank T, 1985. "Data Mining as an Industry," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 124-27, February.
    37. Martin Lettau, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, 06.
    38. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    39. Dhrymes, Phoebus J & Friend, Irwin & Gultekin, N Bulent, 1984. " A Critical Reexamination of the Empirical Evidence on the Arbitrage Pricing Theory," Journal of Finance, American Finance Association, vol. 39(2), pages 323-46, June.
    40. Bossaerts, Peter & Hillion, Pierre, 1999. "Implementing Statistical Criteria to Select Return Forecasting Models: What Do We Learn?," Review of Financial Studies, Society for Financial Studies, vol. 12(2), pages 405-28.
    41. Robert J. Shiller, 1984. "Stock Prices and Social Dynamics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 15(2), pages 457-510.
    42. Lo, Andrew W. (Andrew Wen-Chuan) & MacKinlay, Archie Craig, 1955-, 1989. "Data-snooping biases in tests of financial asset pricing models," Working papers 3020-89., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    43. Amit Goyal & Ivo Welch, 1999. "Predicting the Equity Premium with Dividend Ratios," Yale School of Management Working Papers amz2437, Yale School of Management, revised 01 Nov 2002.
    44. Pontiff, Jeffrey & Schall, Lawrence D., 1998. "Book-to-market ratios as predictors of market returns," Journal of Financial Economics, Elsevier, vol. 49(2), pages 141-160, August.
    45. Nicholas Barberis, 2000. "Investing for the Long Run when Returns Are Predictable," Journal of Finance, American Finance Association, vol. 55(1), pages 225-264, 02.
    46. Carhart, Mark M, 1997. " On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    47. Russ Wermers, 2000. "Mutual Fund Performance: An Empirical Decomposition into Stock-Picking Talent, Style, Transactions Costs, and Expenses," Journal of Finance, American Finance Association, vol. 55(4), pages 1655-1703, 08.
    48. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    49. Joshua D. Coval, 2001. "Is Sound Just Noise?," Journal of Finance, American Finance Association, vol. 56(5), pages 1887-1910, October.
    50. Harald Hau, 2001. "Location Matters: An Examination of Trading Profits," Journal of Finance, American Finance Association, vol. 56(5), pages 1959-1983, October.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:ucp:jnlbus:v:79:y:2006:i:3:p:1263-1292. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Journals Division)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.