Predictability of large future changes in major financial indices
We present a systematic algorithm testing for the existence of collective self-organization in the behavior of agents in social systems, with a concrete empirical implementation on the Dow Jones Industrial Average index (DJIA) over the 20th century and on Hong Kong Hang Seng composite index (HSI) since 1969. The algorithm combines ideas from critical phenomena, the impact of agents' expectation, multi-scale analysis and the mathematical method of pattern recognition of sparse data. Trained on the three major crashes in DJIA of the century, our algorithm exhibits a remarkable ability for generalization and detects in advance 8 other significant drops or changes of regimes. An application to HSI gives promising results as well. The results are robust with respect to the variations of the recognition algorithm. We quantify the prediction procedure with error diagrams.
|Date of creation:||Apr 2003|
|Date of revision:||Aug 2004|
|Publication status:||Published in International Journal of Forecasting 22 (2006) 153-168|
|Contact details of provider:|| Web page: http://arxiv.org/|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Mansilla, R., 2001. "Algorithmic complexity of real financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 301(1), pages 483-492.
- Eugene White & Frederic Mishkin, 2002.
"U.S.Stock Market Crashes and Their Aftermath: Implications for Monetary Policy,"
Departmental Working Papers
200208, Rutgers University, Department of Economics.
- Frederic S. Mishkin & Eugene N. White, 2002. "U.S. Stock Market Crashes and Their Aftermath: Implications for Monetary Policy," NBER Working Papers 8992, National Bureau of Economic Research, Inc.
- Scharfstein, David. & Stein, Jeremy C., 1988.
"Herd behavior and investment,"
WP 2062-88., Massachusetts Institute of Technology (MIT), Sloan School of Management.
- Brock, William A. & Hommes, Cars H., 1998.
"Heterogeneous beliefs and routes to chaos in a simple asset pricing model,"
Journal of Economic Dynamics and Control,
Elsevier, vol. 22(8-9), pages 1235-1274, August.
- repec:att:wimass:9530 is not listed on IDEAS
- Fama, Eugene F., 1998.
"Market efficiency, long-term returns, and behavioral finance,"
Journal of Financial Economics,
Elsevier, vol. 49(3), pages 283-306, September.
- Eugene F. Fama, . "Market Efficiency, Long-term Returns, and Behavioral Finance," CRSP working papers 340, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
- Eugene F Fama, . "Market Efficiency, Long-Term Returns, and Behavioral Finance," CRSP working papers 448, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
- Ide, Kayo & Sornette, Didier, 2002. "Oscillatory finite-time singularities in finance, population and rupture," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 307(1), pages 63-106.
- D. Sornette, 2003. "Critical Market Crashes," Papers cond-mat/0301543, arXiv.org.
- D. Sornette & W. -X. Zhou, 2002. "The US 2000-2002 Market Descent: How Much Longer and Deeper?," Papers cond-mat/0209065, arXiv.org.
- Lux, Thomas, 1995. "Herd Behaviour, Bubbles and Crashes," Economic Journal, Royal Economic Society, vol. 105(431), pages 881-96, July.
- Orlean, Andre, 1995. "Bayesian interactions and collective dynamics of opinion: Herd behavior and mimetic contagion," Journal of Economic Behavior & Organization, Elsevier, vol. 28(2), pages 257-274, October.
- D. Sornette & H. Takayasu & W. -X. Zhou, 2003. "Finite-Time Singularity Signature of Hyperinflation," Papers physics/0301007, arXiv.org.
- Blanchard, Olivier Jean, 1979. "Speculative bubbles, crashes and rational expectations," Economics Letters, Elsevier, vol. 3(4), pages 387-389.
- Brock, W.A. & Hommes, C.H., 1996.
"A Rational Route to Randomness,"
9530r, Wisconsin Madison - Social Systems.
- Didier Sornette & Wei-Xing Zhou, 2002. "The US 2000-2002 market descent: How much longer and deeper?," Quantitative Finance, Taylor & Francis Journals, vol. 2(6), pages 468-481.
- Hsieh, David A, 1989. "Testing for Nonlinear Dependence in Daily Foreign Exchange Rates," The Journal of Business, University of Chicago Press, vol. 62(3), pages 339-68, July.
- John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, 02.
- William A. Brock, 1993.
"Pathways to randomness in the economy: Emergent nonlinearity and chaos in economics and finance,"
El Colegio de México, Centro de Estudios Económicos, vol. 8(1), pages 3-55.
- W. A. Brock, 1993. "Pathways to Randomness in the Economy: Emergent Nonlinearity and Chaos in Economics and Finance," Working Papers 93-02-006, Santa Fe Institute.
- A. Johansen & D. Sornette, 1998. "Stock market crashes are outliers," The European Physical Journal B - Condensed Matter and Complex Systems, Springer, vol. 1(2), pages 141-143, January.
- Johansen, Anders, 2003. "Characterization of large price variations in financial markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 324(1), pages 157-166.
- Graf v. Bothmer, Hans-Christian & Meister, Christian, 2003. "Predicting critical crashes? A new restriction for the free variables," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 320(C), pages 539-547.
- Brock, William A., 2000. "Whither nonlinear?," Journal of Economic Dynamics and Control, Elsevier, vol. 24(5-7), pages 663-678, June.
- Sornette, D & Takayasu, H & Zhou, W.-X, 2003. "Finite-time singularity signature of hyperinflation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 325(3), pages 492-506.
- W. -X. Zhou & D. Sornette, 2002. "Evidence of a Worldwide Stock Market Log-Periodic Anti-Bubble Since Mid-2000," Papers cond-mat/0212010, arXiv.org, revised Aug 2003.
- Zhou, Wei-Xing & Sornette, Didier, 2003. "Evidence of a worldwide stock market log-periodic anti-bubble since mid-2000," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 330(3), pages 543-583.
- Cecen, A. Aydin & Erkal, Cahit, 1996. "Distinguishing between stochastic and deterministic behavior in high frequency foreign exchange rate returns: Can non-linear dynamics help forecasting?," International Journal of Forecasting, Elsevier, vol. 12(4), pages 465-473, December.
When requesting a correction, please mention this item's handle: RePEc:arx:papers:cond-mat/0304601. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators)
If references are entirely missing, you can add them using this form.