IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v193y2012i1p129-15810.1007-s10479-011-0862-y.html
   My bibliography  Save this article

Heuristic optimisation in financial modelling

Author

Listed:
  • Manfred Gilli
  • Enrico Schumann

Abstract

There is a large number of optimisation problems in theoretical and applied finance that are difficult to solve as they exhibit multiple local optima or are not ‘well-behaved’ in other ways (e.g., discontinuities in the objective function). One way to deal with such problems is to adjust and to simplify them, for instance by dropping constraints, until they can be solved with standard numerical methods. We argue that an alternative approach is the application of optimisation heuristics like Simulated Annealing or Genetic Algorithms. These methods have been shown to be capable of handling non-convex optimisation problems with all kinds of constraints. To motivate the use of such techniques in finance, we present several actual problems where classical methods fail. Next, several well-known heuristic techniques that may be deployed in such cases are described. Since such presentations are quite general, we then describe in some detail how a particular problem, portfolio selection, can be tackled by a particular heuristic method, Threshold Accepting. Finally, the stochastics of the solutions obtained from heuristics are discussed. We show, again for the example from portfolio selection, how this random character of the solutions can be exploited to inform the distribution of computations. Copyright Springer Science+Business Media, LLC 2012

Suggested Citation

  • Manfred Gilli & Enrico Schumann, 2012. "Heuristic optimisation in financial modelling," Annals of Operations Research, Springer, vol. 193(1), pages 129-158, March.
  • Handle: RePEc:spr:annopr:v:193:y:2012:i:1:p:129-158:10.1007/s10479-011-0862-y
    DOI: 10.1007/s10479-011-0862-y
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-011-0862-y
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10479-011-0862-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David Pisinger & Stefan Ropke, 2010. "Large Neighborhood Search," International Series in Operations Research & Management Science, in: Michel Gendreau & Jean-Yves Potvin (ed.), Handbook of Metaheuristics, chapter 0, pages 399-419, Springer.
    2. Manfred Gilli & Enrico Schumann, 2008. "Distributed Optimisation of a Portfolio's Omega," Swiss Finance Institute Research Paper Series 08-17, Swiss Finance Institute.
    3. Gilli, M. & Winker, P., 2003. "A global optimization heuristic for estimating agent based models," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 299-312, March.
    4. Lars E.O. Svensson, 1994. "Estimating and Interpreting Forward Interest Rates: Sweden 1992 - 1994," NBER Working Papers 4871, National Bureau of Economic Research, Inc.
    5. Kontoghiorghes, Erricos & Van Dijk, Herman K. & Colubi, Ana, 2017. "Econometrics and Statistics," Econometrics and Statistics, Elsevier, vol. 1(C), pages 1-1.
    6. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    7. LeBaron, Blake, 2000. "Agent-based computational finance: Suggested readings and early research," Journal of Economic Dynamics and Control, Elsevier, vol. 24(5-7), pages 679-702, June.
    8. Rama Cont & Jose da Fonseca, 2002. "Dynamics of implied volatility surfaces," Quantitative Finance, Taylor & Francis Journals, vol. 2(1), pages 45-60.
    9. Winker, Peter & Gilli, Manfred, 2004. "Applications of optimization heuristics to estimation and modelling problems," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 211-223, September.
    10. Gilli, Manfred & Maringer, Dietmar & Schumann, Enrico, 2011. "Numerical Methods and Optimization in Finance," Elsevier Monographs, Elsevier, edition 1, number 9780123756626.
    11. Alan P. Kirman, 1992. "Whom or What Does the Representative Individual Represent?," Journal of Economic Perspectives, American Economic Association, vol. 6(2), pages 117-136, Spring.
    12. Alexei Chekhlov & Stanislav Uryasev & Michael Zabarankin, 2005. "Drawdown Measure In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 13-58.
    13. Diebold, Francis X. & Li, Canlin, 2006. "Forecasting the term structure of government bond yields," Journal of Econometrics, Elsevier, vol. 130(2), pages 337-364, February.
    14. Alan Kirman, 1993. "Ants, Rationality, and Recruitment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 137-156.
    15. Louis K.C. Chan & Jason Karceski & Josef Lakonishok, 1999. "On Portfolio Optimization: Forecasting Covariances and Choosing the Risk Model," NBER Working Papers 7039, National Bureau of Economic Research, Inc.
    16. Bakshi, Gurdip & Cao, Charles & Chen, Zhiwu, 1997. "Empirical Performance of Alternative Option Pricing Models," Journal of Finance, American Finance Association, vol. 52(5), pages 2003-2049, December.
    17. Svensson, Lars E O, 1994. "Estimating and Interpreting Forward Interest Rates: Sweden 1992-4," CEPR Discussion Papers 1051, C.E.P.R. Discussion Papers.
    18. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    19. Manfred Gilli & Dietmar Maringer & Peter Winker, 2008. "Applications of Heuristics in Finance," International Handbooks on Information Systems, in: Detlef Seese & Christof Weinhardt & Frank Schlottmann (ed.), Handbook on Information Technology in Finance, chapter 26, pages 635-653, Springer.
    20. Winker, Peter & Fang, Kai-Tai, 1995. "Application of threshold accepting to the evaluation of the discrepancy of a set of points," Discussion Papers, Series II 248, University of Konstanz, Collaborative Research Centre (SFB) 178 "Internationalization of the Economy".
    21. Stelios H. Zanakis & James R. Evans, 1981. "Heuristic “Optimization”: Why, When, and How to Use It," Interfaces, INFORMS, vol. 11(5), pages 84-91, October.
    22. Peter Winker & Manfred Gilli & Vahidin Jeleskovic, 2007. "An objective function for simulation based inference on exchange rate data," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 2(2), pages 125-145, December.
    23. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    24. Manfred Gilli & Peter Winker, 2008. "Review of Heuristic Optimization Methods in Econometrics," Working Papers 001, COMISEF.
    25. Dixit, Avinash K., 1990. "Optimization in Economic Theory," OUP Catalogue, Oxford University Press, edition 2, number 9780198772101.
    26. Fred Glover, 2007. "Tabu search—Uncharted domains," Annals of Operations Research, Springer, vol. 149(1), pages 89-98, February.
    27. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    28. Vasicek, Oldrich A, 1973. "A Note on Using Cross-Sectional Information in Bayesian Estimation of Security Betas," Journal of Finance, American Finance Association, vol. 28(5), pages 1233-1239, December.
    29. Ozgur S. Ince & R. Burt Porter, 2006. "Individual Equity Return Data From Thomson Datastream: Handle With Care!," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 29(4), pages 463-479, December.
    30. Manfred Gilli & Enrico Schumann, 2009. "Optimal enough?," Working Papers 010, COMISEF.
    31. Knez, Peter J & Ready, Mark J, 1997. "On the Robustness of Size and Book-to-Market in Cross-Sectional Regressions," Journal of Finance, American Finance Association, vol. 52(4), pages 1355-1382, September.
    32. Dietmar Maringer, 2008. "Risk Preferences and Loss Aversion in Portfolio Optimization," Springer Books, in: Erricos J. Kontoghiorghes & Berç Rustem & Peter Winker (ed.), Computational Methods in Financial Engineering, pages 27-45, Springer.
    33. LeBaron, Blake, 2006. "Agent-based Computational Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 24, pages 1187-1233, Elsevier.
    34. Eugene F. Fama & Kenneth R. French, 2004. "The Capital Asset Pricing Model: Theory and Evidence," Journal of Economic Perspectives, American Economic Association, vol. 18(3), pages 25-46, Summer.
    35. Nelson, Charles R & Siegel, Andrew F, 1987. "Parsimonious Modeling of Yield Curves," The Journal of Business, University of Chicago Press, vol. 60(4), pages 473-489, October.
    36. Frederick S. Hillier, 1983. "Heuristics: A Gambler's Roll," Interfaces, INFORMS, vol. 13(3), pages 9-12, June.
    37. Chan, Louis K C & Karceski, Jason & Lakonishok, Josef, 1999. "On Portfolio Optimization: Forecasting Covariances and Choosing the Risk Model," The Review of Financial Studies, Society for Financial Studies, vol. 12(5), pages 937-974.
    38. M. Gilli & E. Kellezi & H. Hysi, 2006. "A Data-Driven Optimization Heuristic for Downside Risk Minimization," Computing in Economics and Finance 2006 355, Society for Computational Economics.
    39. Gençay, Ramazan & Dacorogna, Michel & Muller, Ulrich A. & Pictet, Olivier & Olsen, Richard, 2001. "An Introduction to High-Frequency Finance," Elsevier Monographs, Elsevier, edition 1, number 9780122796715.
    40. Maringer, Dietmar G., 2004. "Finding the relevant risk factors for asset pricing," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 339-352, September.
    41. D. B. Madan, 2001. "On the modelling of option prices," Quantitative Finance, Taylor & Francis Journals, vol. 1(5), pages 481-481.
    42. Chan, Louis K. C. & Lakonishok, Josef, 1992. "Robust Measurement of Beta Risk," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 27(2), pages 265-282, June.
    43. Manfred GILLI & Enrico SCHUMANN & Giacomo DI TOLLO & Gerda CABEJ, 2008. "Constructing Long/Short Portfolios with the Omega ratio," Swiss Finance Institute Research Paper Series 08-34, Swiss Finance Institute.
    44. Blume, Marshall E, 1971. "On the Assessment of Risk," Journal of Finance, American Finance Association, vol. 26(1), pages 1-10, March.
    45. Marc G. Genton & Elvezio Ronchetti, 2008. "Robust Prediction of Beta," Springer Books, in: Erricos J. Kontoghiorghes & Berç Rustem & Peter Winker (ed.), Computational Methods in Financial Engineering, pages 147-161, Springer.
    46. Gilli, Manfred & Schumann, Enrico, 2010. "Optimization in financial engineering - an essay on 'good' solutions and misplaced exactitude," Journal of Financial Transformation, Capco Institute, vol. 28, pages 117-122.
    47. Bates, David S., 2003. "Empirical option pricing: a retrospection," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 387-404.
    48. Sana Ben Hamida & Rama Cont, 2005. "Recovering Volatility from Option Prices by Evolutionary Optimization," Post-Print hal-02490586, HAL.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cui, Yiran & del Baño Rollin, Sebastian & Germano, Guido, 2017. "Full and fast calibration of the Heston stochastic volatility model," European Journal of Operational Research, Elsevier, vol. 263(2), pages 625-638.
    2. Wei Zhao & Yi Lu & Genfu Feng, 2019. "How Many Agents are Rational in China’s Economy? Evidence from a Heterogeneous Agent-Based New Keynesian Model," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 575-611, August.
    3. Gaudard, Ludovic, 2015. "Pumped-storage project: A short to long term investment analysis including climate change," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 91-99.
    4. Jevtić, Petar & Luciano, Elisa & Vigna, Elena, 2013. "Mortality surface by means of continuous time cohort models," Insurance: Mathematics and Economics, Elsevier, vol. 53(1), pages 122-133.
    5. T. Gärtner & S. Kaniovski & Y. Kaniovski, 2021. "Numerical estimates of risk factors contingent on credit ratings," Computational Management Science, Springer, vol. 18(4), pages 563-589, October.
    6. Eudald Romo & Luis Ortiz-Gracia, 2021. "SWIFT calibration of the Heston model," Papers 2103.01570, arXiv.org.
    7. Andrea Scozzari & Fabio Tardella & Sandra Paterlini & Thiemo Krink, 2013. "Exact and heuristic approaches for the index tracking problem with UCITS constraints," Annals of Operations Research, Springer, vol. 205(1), pages 235-250, May.
    8. Konstantinos Konstantaras & Vasilios Sogiakas, 2019. "Is stock liquidity transferred and upgraded in acquisitions? Evidence from liquidity synergies in US freeze-outs," Annals of Operations Research, Springer, vol. 282(1), pages 179-216, November.
    9. Gregory Gadzinski & Markus Schuller & Shabnam Mousavi, 2022. "Long-lasting heuristics principles for efficient investment decisions," Qualitative Research in Financial Markets, Emerald Group Publishing Limited, vol. 14(4), pages 570-583, March.
    10. Gaudard, Ludovic & Madani, Kaveh, 2019. "Energy storage race: Has the monopoly of pumped-storage in Europe come to an end?," Energy Policy, Elsevier, vol. 126(C), pages 22-29.
    11. G.A. Vijayalakshmi Pai & Thierry Michel, 2012. "Integrated Metaheuristic Optimization Of 130–30 Investment‐Strategy‐Based Long–Short Portfolios," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 19(1), pages 43-74, January.
    12. Mansini, Renata & Ogryczak, Wlodzimierz & Speranza, M. Grazia, 2014. "Twenty years of linear programming based portfolio optimization," European Journal of Operational Research, Elsevier, vol. 234(2), pages 518-535.
    13. Doering, Jana & Kizys, Renatas & Juan, Angel A. & Fitó, Àngels & Polat, Onur, 2019. "Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends," Operations Research Perspectives, Elsevier, vol. 6(C).
    14. Ardia, David & Boudt, Kris & Carl, Peter & Mullen, Katharine M. & Peterson, Brian, 2010. "Differential Evolution (DEoptim) for Non-Convex Portfolio Optimization," MPRA Paper 22135, University Library of Munich, Germany.
    15. Filipa Fernandes & Charalampos Stasinakis & Zivile Zekaite, 2019. "Forecasting government bond spreads with heuristic models: evidence from the Eurozone periphery," Annals of Operations Research, Springer, vol. 282(1), pages 87-118, November.
    16. Giuseppe Montesi & Giovanni Papiro & Massimiliano Fazzini & Alessandro Ronga, 2020. "Stochastic Optimization System for Bank Reverse Stress Testing," JRFM, MDPI, vol. 13(8), pages 1-44, August.
    17. Billio, Monica & Caporin, Massimiliano & Costola, Michele, 2015. "Backward/forward optimal combination of performance measures for equity screening," The North American Journal of Economics and Finance, Elsevier, vol. 34(C), pages 63-83.
    18. Carole Bernard & Massimiliano Caporin & Bertrand Maillet & Xiang Zhang, 2023. "Omega Compatibility: A Meta-analysis," Computational Economics, Springer;Society for Computational Economics, vol. 62(2), pages 493-526, August.
    19. Eudald Romo & Luis Ortiz-Gracia, 2021. "SWIFT Calibration of the Heston Model," Mathematics, MDPI, vol. 9(5), pages 1-20, March.
    20. Leonardo Riegel Sant’Anna & Tiago Pascoal Filomena & Pablo Cristini Guedes & Denis Borenstein, 2017. "Index tracking with controlled number of assets using a hybrid heuristic combining genetic algorithm and non-linear programming," Annals of Operations Research, Springer, vol. 258(2), pages 849-867, November.
    21. Sana Ben Hamida & Wafa Abdelmalek & Fathi Abid, 2020. "Applying Dynamic Training-Subset Selection Methods Using Genetic Programming for Forecasting Implied Volatility," Papers 2007.07207, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Detlef Seese & Christof Weinhardt & Frank Schlottmann (ed.), 2008. "Handbook on Information Technology in Finance," International Handbooks on Information Systems, Springer, number 978-3-540-49487-4, November.
    2. Marianna Lyra, 2010. "Heuristic Strategies in Finance – An Overview," Working Papers 045, COMISEF.
    3. Peter Winker & Marianna Lyra & Chris Sharpe, 2011. "Least median of squares estimation by optimization heuristics with an application to the CAPM and a multi-factor model," Computational Management Science, Springer, vol. 8(1), pages 103-123, April.
    4. Alexandru Mandes & Peter Winker, 2017. "Complexity and model comparison in agent based modeling of financial markets," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 12(3), pages 469-506, October.
    5. Caldeira, João F. & Moura, Guilherme V. & Santos, André A.P., 2016. "Bond portfolio optimization using dynamic factor models," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 128-158.
    6. Klein, A. & Urbig, D. & Kirn, S., 2008. "Who Drives the Market? Estimating a Heterogeneous Agent-based Financial Market Model Using a Neural Network Approach," MPRA Paper 14433, University Library of Munich, Germany.
    7. Ivan Jericevich & Murray McKechnie & Tim Gebbie, 2021. "Calibrating an adaptive Farmer-Joshi agent-based model for financial markets," Papers 2104.09863, arXiv.org.
    8. Hommes, Cars H., 2006. "Heterogeneous Agent Models in Economics and Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 23, pages 1109-1186, Elsevier.
    9. Zhenxi Chen & Thomas Lux, 2018. "Estimation of Sentiment Effects in Financial Markets: A Simulated Method of Moments Approach," Computational Economics, Springer;Society for Computational Economics, vol. 52(3), pages 711-744, October.
    10. Ivan Jericevich & Patrick Chang & Tim Gebbie, 2021. "Simulation and estimation of an agent-based market-model with a matching engine," Papers 2108.07806, arXiv.org, revised Aug 2021.
    11. Sudarshan Kumar & Sobhesh Kumar Agarwalla & Jayanth R. Varma & Vineet Virmani, 2023. "Harvesting the volatility smile in a large emerging market: A Dynamic Nelson–Siegel approach," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(11), pages 1615-1644, November.
    12. Pascal François & Rémi Galarneau‐Vincent & Geneviève Gauthier & Frédéric Godin, 2022. "Venturing into uncharted territory: An extensible implied volatility surface model," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(10), pages 1912-1940, October.
    13. Björn Fastrich & Peter Winker, 2012. "Robust portfolio optimization with a hybrid heuristic algorithm," Computational Management Science, Springer, vol. 9(1), pages 63-88, February.
    14. Caldeira, João F. & Moura, Guilherme V. & Santos, André A.P., 2016. "Predicting the yield curve using forecast combinations," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 79-98.
    15. Manfred Gilli & Enrico Schumann, 2010. "Calibrating Option Pricing Models with Heuristics," Working Papers 030, COMISEF.
    16. Hommes, C.H., 2005. "Heterogeneous Agent Models in Economics and Finance, In: Handbook of Computational Economics II: Agent-Based Computational Economics, edited by Leigh Tesfatsion and Ken Judd , Elsevier, Amsterdam 2006," CeNDEF Working Papers 05-03, Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance.
    17. R. Douglas Martin & Daniel Z. Xia, 2022. "Efficient bias robust regression for time series factor models," Journal of Asset Management, Palgrave Macmillan, vol. 23(3), pages 215-234, May.
    18. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    19. Tae-Seok Jang, 2015. "Identification of Social Interaction Effects in Financial Data," Computational Economics, Springer;Society for Computational Economics, vol. 45(2), pages 207-238, February.
    20. Manfred Gilli & Enrico Schumann, 2009. "Robust regression with optimisation heuristics," Working Papers 011, COMISEF.

    More about this item

    Keywords

    Optimisation heuristics; Financial optimisation; Portfolio optimisation;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:193:y:2012:i:1:p:129-158:10.1007/s10479-011-0862-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.