Predictability of large future changes in major financial indices
We present a systematic algorithm testing for the existence of collective self-organization in the behavior of agents in social systems, with a concrete empirical implementation on the Dow Jones Industrial Average index (DJIA) over the 20th century and on Hong Kong Hang Seng composite index (HSI) since 1969. The algorithm combines ideas from critical phenomena, the impact of agents' expectation, multi-scale analysis and the mathematical method of pattern recognition of sparse data. Trained on the three major crashes in DJIA of the century, our algorithm exhibits a remarkable ability for generalization and detects in advance 8 other significant drops or changes of regimes. An application to HSI gives promising results as well. The results are robust with respect to the variations of the recognition algorithm. We quantify the prediction procedure with error diagrams.
|Date of creation:||Apr 2003|
|Date of revision:||Aug 2004|
|Publication status:||Published in International Journal of Forecasting 22 (2006) 153-168|
|Contact details of provider:|| Web page: http://arxiv.org/|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Fama, Eugene F., 1998.
"Market efficiency, long-term returns, and behavioral finance,"
Journal of Financial Economics,
Elsevier, vol. 49(3), pages 283-306, September.
- Eugene F Fama, . "Market Efficiency, Long-Term Returns, and Behavioral Finance," CRSP working papers 448, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
- Eugene F. Fama, . "Market Efficiency, Long-term Returns, and Behavioral Finance," CRSP working papers 340, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
- Frederic S. Mishkin & Eugene N. White, 2002.
"U.S. Stock Market Crashes and Their Aftermath: Implications for Monetary Policy,"
NBER Working Papers
8992, National Bureau of Economic Research, Inc.
- Eugene White & Frederic Mishkin, 2002. "U.S.Stock Market Crashes and Their Aftermath: Implications for Monetary Policy," Departmental Working Papers 200208, Rutgers University, Department of Economics.
- William A. Brock & Cars H. Hommes, 1997.
"A Rational Route to Randomness,"
Econometric Society, vol. 65(5), pages 1059-1096, September.
- Ide, Kayo & Sornette, Didier, 2002. "Oscillatory finite-time singularities in finance, population and rupture," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 307(1), pages 63-106.
- Graf v. Bothmer, Hans-Christian & Meister, Christian, 2003. "Predicting critical crashes? A new restriction for the free variables," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 320(C), pages 539-547.
- D. Sornette, 2003. "Critical Market Crashes," Papers cond-mat/0301543, arXiv.org.
- W. -X. Zhou & D. Sornette, 2002. "Evidence of a Worldwide Stock Market Log-Periodic Anti-Bubble Since Mid-2000," Papers cond-mat/0212010, arXiv.org, revised Aug 2003.
- Didier Sornette & Wei-Xing Zhou, 2002. "The US 2000-2002 market descent: How much longer and deeper?," Quantitative Finance, Taylor & Francis Journals, vol. 2(6), pages 468-481.
- John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, 02.
- Cecen, A. Aydin & Erkal, Cahit, 1996. "Distinguishing between stochastic and deterministic behavior in high frequency foreign exchange rate returns: Can non-linear dynamics help forecasting?," International Journal of Forecasting, Elsevier, vol. 12(4), pages 465-473, December.
- Hsieh, David A, 1989. "Testing for Nonlinear Dependence in Daily Foreign Exchange Rates," The Journal of Business, University of Chicago Press, vol. 62(3), pages 339-68, July.
- Blanchard, Olivier Jean, 1979. "Speculative bubbles, crashes and rational expectations," Economics Letters, Elsevier, vol. 3(4), pages 387-389.
- Brock, William A., 2000. "Whither nonlinear?," Journal of Economic Dynamics and Control, Elsevier, vol. 24(5-7), pages 663-678, June.
- Scharfstein, David S & Stein, Jeremy C, 1990.
"Herd Behavior and Investment,"
American Economic Review,
American Economic Association, vol. 80(3), pages 465-79, June.
- D. Sornette & H. Takayasu & W. -X. Zhou, 2003. "Finite-Time Singularity Signature of Hyperinflation," Papers physics/0301007, arXiv.org.
- Brock, W.A. & Hommes, C.H., 1996.
"Hetergeneous Beliefs and Routes to Chaos in a Simple Asset Pricing Model,"
9621, Wisconsin Madison - Social Systems.
- Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
- Orlean, Andre, 1995. "Bayesian interactions and collective dynamics of opinion: Herd behavior and mimetic contagion," Journal of Economic Behavior & Organization, Elsevier, vol. 28(2), pages 257-274, October.
- William A. Brock, 1993.
"Pathways to randomness in the economy: Emergent nonlinearity and chaos in economics and finance,"
El Colegio de México, Centro de Estudios Económicos, vol. 8(1), pages 3-55.
- W. A. Brock, 1993. "Pathways to Randomness in the Economy: Emergent Nonlinearity and Chaos in Economics and Finance," Working Papers 93-02-006, Santa Fe Institute.
- D. Sornette & W. -X. Zhou, 2002. "The US 2000-2002 Market Descent: How Much Longer and Deeper?," Papers cond-mat/0209065, arXiv.org.
- A. Johansen & D. Sornette, 1998. "Stock market crashes are outliers," The European Physical Journal B - Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 1(2), pages 141-143, January.
- Johansen, Anders, 2003. "Characterization of large price variations in financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 157-166.
- Sornette, D & Takayasu, H & Zhou, W.-X, 2003. "Finite-time singularity signature of hyperinflation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 325(3), pages 492-506.
- Zhou, Wei-Xing & Sornette, Didier, 2003. "Evidence of a worldwide stock market log-periodic anti-bubble since mid-2000," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 330(3), pages 543-583.
- Mansilla, R., 2001. "Algorithmic complexity of real financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 301(1), pages 483-492.
- Lux, Thomas, 1995. "Herd Behaviour, Bubbles and Crashes," Economic Journal, Royal Economic Society, vol. 105(431), pages 881-96, July.
When requesting a correction, please mention this item's handle: RePEc:arx:papers:cond-mat/0304601. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators)
If references are entirely missing, you can add them using this form.