IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/14433.html
   My bibliography  Save this paper

Who Drives the Market? Estimating a Heterogeneous Agent-based Financial Market Model Using a Neural Network Approach

Author

Listed:
  • Klein, A.
  • Urbig, D.
  • Kirn, S.

Abstract

Introduction. The objects of investigation of this work are micro-level behaviors in stock markets. We aim at better understanding which strategies of market participants drive stock markets. The problem is that micro-level data from real stock markets are largely unobservable. We take an estimation perspective to obtain daily time series of fractions of chartists and fundamentalists among market participants. We estimate the heterogeneous agent-based financial market model introduced by Lux and Marchesi [1] to the S&P 500. This model has more realistic time series properties compared to less complex econometric and other agent-based models. Such kinds of models have a rather complex dependency between micro and macro parameters that have to be mapped to empirical data by the estimation method. This poses heavy computational burdens. Our contribution to this field is a new method for indirectly estimating time-varying micro-parameters of highly complex agent-based models at high frequency. Related work. Due to the high complexity, few authors have published on this topic to date (e.g., [2], [3], and [4]). Recent approaches in directly estimating agent-based models are restricted to simpler models, make simplifying assumptions on the estimation procedure, estimate only non-time varying parameters, or estimate only low frequency time series. Approach and computational methods. The indirect estimation method we propose is based on estimating the inverse model of a rich agent-based model that derives realistic macro market behavior from heterogeneous market participants’ behaviors. Applying the inverse model, which maps macro parameters back to micro parameters, to widely available macro-level financial market data, allows for estimating time series of aggregated real world micro-level strategy data at daily frequency. To estimate the inverse model in the first place, a neural network approach is used, as it allows for a large degree of freedom concerning the structure of the mapping to be represented by the neural network. As basis for learning the mapping, micro and macro time series of the market model are generated artificially using a multi-agent simulation based on RePast [5]. After applying several pre-processing and smoothing methods to these time series, a feed-forward multilayer perceptron is trained using a variant of the Levenberg-Marquardt algorithm combined with Bayesian regularization [6]. Finally, the trained network is applied to the S&P 500 to estimate daily time series of fractions of strategies used by market participants. Results. The main contribution of this work is a model-free indirect estimation approach. It allows estimating micro-parameter time series of the underlying agent-based model of high complexity at high frequency. No simplifying assumptions concerning the model or the estimation process have to be applied. Our results also contribute to the understanding of theoretical models. By investigating fundamental depen¬den¬cies in the Lux and Marchesi model by means of sensitivity analysis of the resulting neural network inverse model, price volatility is found to be a major driver. This provides additional support to findings in [1]. Some face validity for concrete estimation results obtained from the S&P 500 is shown by comparing to results of Boswijk et al. [3]. This is the work which comes closest to our approach, albeit their model is simpler and estimation frequency is yearly. We find support for Boswijk et al.’s key finding of a large fraction of chartists during the end of 1990s price bubble in technology stocks. Eventually, our work contributes to understanding what kind of micro-level behaviors drive stock markets. Analyzing correlations of our estimation results to historic market events, we find the fraction of chartists being large at times of crises, crashes, and bubbles. See also www.whodrivesthemarket.com for some continuously updated results.

Suggested Citation

  • Klein, A. & Urbig, D. & Kirn, S., 2008. "Who Drives the Market? Estimating a Heterogeneous Agent-based Financial Market Model Using a Neural Network Approach," MPRA Paper 14433, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:14433
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/14433/1/MPRA_paper_14433.pdf
    File Function: original version
    Download Restriction: no

    File URL: https://mpra.ub.uni-muenchen.de/14575/1/MPRA_paper_14575.pdf
    File Function: revised version
    Download Restriction: no

    File URL: https://mpra.ub.uni-muenchen.de/14580/1/MPRA_paper_14580.pdf
    File Function: revised version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robert J. Shiller, 1984. "Stock Prices and Social Dynamics," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 15(2), pages 457-510.
    2. Paul De Grauwe & Marianna Grimaldi, 2014. "Exchange Rate Puzzles: A Tale of Switching Attractors," World Scientific Book Chapters, in: Exchange Rates and Global Financial Policies, chapter 3, pages 71-117, World Scientific Publishing Co. Pte. Ltd..
    3. Shleifer, Andrei & Summers, Lawrence H, 1990. "The Noise Trader Approach to Finance," Journal of Economic Perspectives, American Economic Association, vol. 4(2), pages 19-33, Spring.
    4. Keim, Donald B. & Madhavan, Ananth, 1995. "Anatomy of the trading process Empirical evidence on the behavior of institutional traders," Journal of Financial Economics, Elsevier, vol. 37(3), pages 371-398, March.
    5. Westerhoff Frank H. & Reitz Stefan, 2003. "Nonlinearities and Cyclical Behavior: The Role of Chartists and Fundamentalists," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 7(4), pages 1-15, December.
    6. Vigfusson, Robert, 1997. "Switching between Chartists and Fundamentalists: A Markov Regime-Switching Approach," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 2(4), pages 291-305, October.
    7. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    8. LeBaron, Blake, 2006. "Agent-based Computational Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 24, pages 1187-1233, Elsevier.
    9. Aoki, Masanao, 2002. "Open models of share markets with two dominant types of participants," Journal of Economic Behavior & Organization, Elsevier, vol. 49(2), pages 199-216, October.
    10. Thomas Lux & Michele Marchesi, 1999. "Scaling and criticality in a stochastic multi-agent model of a financial market," Nature, Nature, vol. 397(6719), pages 498-500, February.
    11. Giorgio Fagiolo & Paul Windrum & Alessio Moneta, 2006. "Empirical Validation of Agent Based Models: A Critical Survey," LEM Papers Series 2006/14, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    12. Farmer, J. Doyne & Joshi, Shareen, 2002. "The price dynamics of common trading strategies," Journal of Economic Behavior & Organization, Elsevier, vol. 49(2), pages 149-171, October.
    13. Schwert, G William, 1990. "Stock Volatility and the Crash of '87," The Review of Financial Studies, Society for Financial Studies, vol. 3(1), pages 77-102.
    14. Pagan, Adrian, 1996. "The econometrics of financial markets," Journal of Empirical Finance, Elsevier, vol. 3(1), pages 15-102, May.
    15. Boswijk, H. Peter & Hommes, Cars H. & Manzan, Sebastiano, 2007. "Behavioral heterogeneity in stock prices," Journal of Economic Dynamics and Control, Elsevier, vol. 31(6), pages 1938-1970, June.
    16. Alan Kirman, 1993. "Ants, Rationality, and Recruitment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 137-156.
    17. De Long, J Bradford, et al, 1990. "Positive Feedback Investment Strategies and Destabilizing Rational Speculation," Journal of Finance, American Finance Association, vol. 45(2), pages 379-395, June.
    18. Alfarano, Simone & Lux, Thomas & Wagner, Friedrich, 2006. "Estimation of a simple agent-based model of financial markets: An application to Australian stock and foreign exchange data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 370(1), pages 38-42.
    19. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    20. Rui Carvalho, 2001. "The Dynamics of the Linear Random Farmer Model," Papers cond-mat/0107150, arXiv.org.
    21. Steven Radelet & Jeffrey D. Sachs, 1998. "The East Asian Financial Crisis: Diagnosis, Remedies, Prospects," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 29(1), pages 1-90.
    22. Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
    23. P. Gopikrishnan & M. Meyer & L.A.N. Amaral & H.E. Stanley, 1998. "Inverse cubic law for the distribution of stock price variations," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 3(2), pages 139-140, July.
    24. Hommes, Cars H., 2006. "Heterogeneous Agent Models in Economics and Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 23, pages 1109-1186, Elsevier.
    25. Thomas Lux & Michele Marchesi, 2000. "Volatility Clustering In Financial Markets: A Microsimulation Of Interacting Agents," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 3(04), pages 675-702.
    26. Menkhoff, L., 1998. "The noise trading approach -- questionnaire evidence from foreign exchange," Journal of International Money and Finance, Elsevier, vol. 17(3), pages 547-564, June.
    27. Homi Kharas & Brian Pinto & Sergei Ulatov, 2001. "An Analysis of Russia's 1998 Meltdown: Fundamentals and Market Signals," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 32(1), pages 1-68.
    28. Simone Alfarano & Thomas Lux & Friedrich Wagner, 2005. "Estimation of Agent-Based Models: The Case of an Asymmetric Herding Model," Computational Economics, Springer;Society for Computational Economics, vol. 26(1), pages 19-49, August.
    29. Gilli, M. & Winker, P., 2003. "A global optimization heuristic for estimating agent based models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 299-312, March.
    30. Alan P. Kirman, 1992. "Whom or What Does the Representative Individual Represent?," Journal of Economic Perspectives, American Economic Association, vol. 6(2), pages 117-136, Spring.
    31. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    32. Parameswaran Gopikrishnan & Martin Meyer & Luis A Nunes Amaral & H Eugene Stanley, 1998. "Inverse Cubic Law for the Probability Distribution of Stock Price Variations," Papers cond-mat/9803374, arXiv.org, revised May 1998.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Todd Feldman & Shuming Liu, 2018. "A New Predictive Measure Using Agent-Based Behavioral Finance," Computational Economics, Springer;Society for Computational Economics, vol. 51(4), pages 941-959, April.
    2. Lux, Thomas, 2012. "Estimation of an agent-based model of investor sentiment formation in financial markets," Journal of Economic Dynamics and Control, Elsevier, vol. 36(8), pages 1284-1302.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cars Hommes & Florian Wagener, 2008. "Complex Evolutionary Systems in Behavioral Finance," Tinbergen Institute Discussion Papers 08-054/1, Tinbergen Institute.
    2. Amilon, Henrik, 2008. "Estimation of an adaptive stock market model with heterogeneous agents," Journal of Empirical Finance, Elsevier, vol. 15(2), pages 342-362, March.
    3. Xue-Zhong He & Youwei Li, 2017. "The adaptiveness in stock markets: testing the stylized facts in the DAX 30," Journal of Evolutionary Economics, Springer, vol. 27(5), pages 1071-1094, November.
    4. Hommes, Cars H., 2006. "Heterogeneous Agent Models in Economics and Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 23, pages 1109-1186, Elsevier.
    5. Kukacka, Jiri & Barunik, Jozef, 2017. "Estimation of financial agent-based models with simulated maximum likelihood," Journal of Economic Dynamics and Control, Elsevier, vol. 85(C), pages 21-45.
    6. Hommes, C.H., 2005. "Heterogeneous Agent Models in Economics and Finance, In: Handbook of Computational Economics II: Agent-Based Computational Economics, edited by Leigh Tesfatsion and Ken Judd , Elsevier, Amsterdam 2006," CeNDEF Working Papers 05-03, Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance.
    7. Demary, Markus, 2010. "Transaction taxes and traders with heterogeneous investment horizons in an agent-based financial market model," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 4, pages 1-44.
    8. He, Xue-Zhong & Li, Youwei, 2015. "Testing of a market fraction model and power-law behaviour in the DAX 30," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 1-17.
    9. Troy Tassier, 2013. "Handbook of Research on Complexity, by J. Barkley Rosser, Jr. and Edward Elgar," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 39(1), pages 132-133.
    10. Antonio Doria, Francisco, 2011. "J.B. Rosser Jr. , Handbook of Research on Complexity, Edward Elgar, Cheltenham, UK--Northampton, MA, USA (2009) 436 + viii pp., index, ISBN 978 1 84542 089 5 (cased)," Journal of Economic Behavior & Organization, Elsevier, vol. 78(1-2), pages 196-204, April.
    11. Torsten Trimborn & Philipp Otte & Simon Cramer & Maximilian Beikirch & Emma Pabich & Martin Frank, 2020. "SABCEMM: A Simulator for Agent-Based Computational Economic Market Models," Computational Economics, Springer;Society for Computational Economics, vol. 55(2), pages 707-744, February.
    12. Westerhoff, Frank, 2009. "A simple agent-based financial market model: Direct interactions and comparisons of trading profits," BERG Working Paper Series 61, Bamberg University, Bamberg Economic Research Group.
    13. Chiarella, Carl & He, Xue-Zhong & Zwinkels, Remco C.J., 2014. "Heterogeneous expectations in asset pricing: Empirical evidence from the S&P500," Journal of Economic Behavior & Organization, Elsevier, vol. 105(C), pages 1-16.
    14. Radu T. Pruna & Maria Polukarov & Nicholas R. Jennings, 2016. "A new structural stochastic volatility model of asset pricing and its stylized facts," Papers 1604.08824, arXiv.org.
    15. E. Samanidou & E. Zschischang & D. Stauffer & T. Lux, 2001. "Microscopic Models of Financial Markets," Papers cond-mat/0110354, arXiv.org.
    16. Blaurock, Ivonne & Schmitt, Noemi & Westerhoff, Frank, 2018. "Market entry waves and volatility outbursts in stock markets," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 19-37.
    17. Bauer, Christian & De Grauwe, Paul & Reitz, Stefan, 2009. "Exchange rate dynamics in a target zone--A heterogeneous expectations approach," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 329-344, February.
    18. Simon Cramer & Torsten Trimborn, 2019. "Stylized Facts and Agent-Based Modeling," Papers 1912.02684, arXiv.org.
    19. Bàrbara Llacay & Gilbert Peffer, 2018. "Using realistic trading strategies in an agent-based stock market model," Computational and Mathematical Organization Theory, Springer, vol. 24(3), pages 308-350, September.
    20. Hommes, Cars & in ’t Veld, Daan, 2017. "Booms, busts and behavioural heterogeneity in stock prices," Journal of Economic Dynamics and Control, Elsevier, vol. 80(C), pages 101-124.

    More about this item

    Keywords

    stock market; heterogeneous agent-based models; indirect estimation; inverse model; trading strategies; chartists; fundamentalists; neural networks;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:14433. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.