IDEAS home Printed from https://ideas.repec.org/p/chf/rpseri/rp0812.html
   My bibliography  Save this paper

A review of heuristic optimization methods in econometrics

Author

Listed:
  • Manfred GILLI

    (University of Geneva and Swiss Finance Institute)

  • Peter WINKER

    (University of Giessen)

Abstract

Estimation and modelling problems as they arise in many fields often turn out to be intractable by standard numerical methods. One way to deal with such a situation consists in simplifying models and procedures. However, the solutions to these simplified problems might not be satisfying. A different approach consists in applying optimization heuristics such as evolutionary algorithms (Simulated Annealing, Threshold Accepting), Neural Networks, Genetic Algorithms, Tabu Search, hybrid methods and many others, which have been developed over the last two decades. Although the use of these methods became more standard in several fields of sciences, their use in estimation and modelling in econometrics appears to be still limited. We present an introduction to heuristic optimization methods and provide some examples for which these methods are found to work efficiently.

Suggested Citation

  • Manfred GILLI & Peter WINKER, 2008. "A review of heuristic optimization methods in econometrics," Swiss Finance Institute Research Paper Series 08-12, Swiss Finance Institute.
  • Handle: RePEc:chf:rpseri:rp0812
    as

    Download full text from publisher

    File URL: http://ssrn.com/abstract=1140655
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Baragona, R. & Battaglia, F. & Cucina, D., 2004. "Fitting piecewise linear threshold autoregressive models by means of genetic algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 277-295, September.
    2. Kontoghiorghes, Erricos & Van Dijk, Herman K. & Colubi, Ana, 2017. "Econometrics and Statistics," Econometrics and Statistics, Elsevier, vol. 1(C), pages 1-1.
    3. Doornik, Jurgen A. & Ooms, Marius, 2008. "Multimodality in GARCH regression models," International Journal of Forecasting, Elsevier, vol. 24(3), pages 432-448.
    4. Winker, Peter & Fang, Kai-Tai, 1995. "Application of threshold accepting to the evaluation of the discrepancy of a set of points," Discussion Papers, Series II 248, University of Konstanz, Collaborative Research Centre (SFB) 178 "Internationalization of the Economy".
    5. Staszewska, Anna, 2007. "Representing uncertainty about response paths: The use of heuristic optimisation methods," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 121-132, September.
    6. Hawkins, Dollena S. & Allen, David M. & Stromberg, Arnold J., 2001. "Determining the number of components in mixtures of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 38(1), pages 15-48, November.
    7. Alcock, Jamie & Burrage, Kevin, 2004. "A genetic estimation algorithm for parameters of stochastic ordinary differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 255-275, September.
    8. Yang, Zheng & Tian, Zheng & Yuan, Zixia, 2007. "GSA-based maximum likelihood estimation for threshold vector error correction model," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 109-120, September.
    9. S. P. Brooks & N. Friel & R. King, 2003. "Classical model selection via simulated annealing," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 503-520, May.
    10. Kapetanios, George, 2007. "Variable selection in regression models using nonstandard optimisation of information criteria," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 4-15, September.
    11. Peter Winker & Dietmar Maringer, 2004. "Optimal Lag Structure Selection in VEC-Models," Contributions to Economic Analysis, in: New Directions in Macromodelling, pages 213-234, Emerald Group Publishing Limited.
    12. Chao, John C. & Phillips, Peter C. B., 1999. "Model selection in partially nonstationary vector autoregressive processes with reduced rank structure," Journal of Econometrics, Elsevier, vol. 91(2), pages 227-271, August.
    13. Fitzenberger, Bernd & Winker, Peter, 2007. "Improving the computation of censored quantile regressions," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 88-108, September.
    14. Dorsey, Robert E & Mayer, Walter J, 1995. "Genetic Algorithms for Estimation Problems with Multiple Optima, Nondifferentiability, and Other Irregular Features," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(1), pages 53-66, January.
    15. Winker, Peter, 1995. "Identification of multivariate AR-models by threshold accepting," Computational Statistics & Data Analysis, Elsevier, vol. 20(3), pages 295-307, September.
    16. Maddala, G S & Nelson, Forrest D, 1974. "Maximum Likelihood Methods for Models of Markets in Disequilibrium," Econometrica, Econometric Society, vol. 42(6), pages 1013-1030, November.
    17. Chipman, J. & Winker, P., 2005. "Optimal aggregation of linear time series models," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 311-331, April.
    18. Eduardo Acosta-González & Fernando Fernández-Rodríguez, 2007. "Model selection via genetic algorithms illustrated with cross-country growth data," Empirical Economics, Springer, vol. 33(2), pages 313-337, September.
    19. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    20. G. A. Croes, 1958. "A Method for Solving Traveling-Salesman Problems," Operations Research, INFORMS, vol. 6(6), pages 791-812, December.
    21. Baragona, Roberto & Battaglia, Francesco & Calzini, Claudio, 2001. "Genetic algorithms for the identification of additive and innovation outliers in time series," Computational Statistics & Data Analysis, Elsevier, vol. 37(1), pages 1-12, July.
    22. Helmut Luetkepohl, 2007. "Econometric Analysis with Vector Autoregressive Models," Economics Working Papers ECO2007/11, European University Institute.
    23. Kapetanios, George, 2006. "Choosing the optimal set of instruments from large instrument sets," Computational Statistics & Data Analysis, Elsevier, vol. 51(2), pages 612-620, November.
    24. Bauer, Dietmar & Wagner, Martin, 2002. "Estimating cointegrated systems using subspace algorithms," Journal of Econometrics, Elsevier, vol. 111(1), pages 47-84, November.
    25. Winker, Peter & Maringer, Dietmar, 2005. "The convergence of optimization based estimators : theory and application to a GARCH-model," Discussion Papers 2005,004E, University of Erfurt, Faculty of Economics, Law and Social Sciences.
    26. Kwami Adanu, 2006. "Optimizing the Garch Model–An Application of Two Global and Two Local Search Methods," Computational Economics, Springer;Society for Computational Economics, vol. 28(3), pages 277-290, October.
    27. Peter Winker, 2000. "Optimized Multivariate Lag Structure Selection," Computational Economics, Springer;Society for Computational Economics, vol. 16(1/2), pages 87-103, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Manfred Gilli & Enrico Schumann, 2012. "Heuristic optimisation in financial modelling," Annals of Operations Research, Springer, vol. 193(1), pages 129-158, March.
    2. Jakob Grazzini, 2011. "Consistent Estimation of Agent Based Models," LABORatorio R. Revelli Working Papers Series 110, LABORatorio R. Revelli, Centre for Employment Studies.
    3. Florios, Kostas, 2018. "A hyperplanes intersection simulated annealing algorithm for maximum score estimation," Econometrics and Statistics, Elsevier, vol. 8(C), pages 37-55.
    4. Liu, Yu-Hsin, 2011. "Incorporating scatter search and threshold accepting in finding maximum likelihood estimates for the multinomial probit model," European Journal of Operational Research, Elsevier, vol. 211(1), pages 130-138, May.
    5. Ardia, David & Boudt, Kris & Carl, Peter & Mullen, Katharine M. & Peterson, Brian, 2010. "Differential Evolution (DEoptim) for Non-Convex Portfolio Optimization," MPRA Paper 22135, University Library of Munich, Germany.
    6. Peter Winker & Marianna Lyra & Chris Sharpe, 2011. "Least median of squares estimation by optimization heuristics with an application to the CAPM and a multi-factor model," Computational Management Science, Springer, vol. 8(1), pages 103-123, April.
    7. Maciel, Leandro & Gomide, Fernando & Ballini, Rosangela, 2016. "A differential evolution algorithm for yield curve estimation," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 129(C), pages 10-30.
    8. Hazar Altınbaş & Vincenzo Pacelli & Edgardo Sica, 2022. "An Empirical Assessment of the Contagion Determinants in the Euro Area in a Period of Sovereign Debt Risk," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 8(2), pages 339-371, July.
    9. Jakob Grazzini & Matteo G. Richiardi, 2013. "Consistent Estimation of Agent-Based Models by Simulated Minimum Distance," LABORatorio R. Revelli Working Papers Series 130, LABORatorio R. Revelli, Centre for Employment Studies.
    10. Grazzini Jakob, 2011. "Estimating Micromotives from Macrobehavior," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201111, University of Turin.
    11. Bj�rn Fastrich & Sandra Paterlini & Peter Winker, 2014. "Cardinality versus q -norm constraints for index tracking," Quantitative Finance, Taylor & Francis Journals, vol. 14(11), pages 2019-2032, November.
    12. Stephen Kinsella, 2012. "Blueprint For An Algorithmic Economics," New Mathematics and Natural Computation (NMNC), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 101-111.
    13. Makram El-Shagi, 2011. "An evolutionary algorithm for the estimation of threshold vector error correction models," International Economics and Economic Policy, Springer, vol. 8(4), pages 341-362, December.
    14. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    15. Jin Zhang & Dietmar Maringer, 2010. "Asset Allocation under Hierarchical Clustering," Working Papers 036, COMISEF.
    16. Liu, Liwei & Sun, Xiaoru & Chen, Chuxiang & Zhao, Erdong, 2016. "How will auctioning impact on the carbon emission abatement cost of electric power generation sector in China?," Applied Energy, Elsevier, vol. 168(C), pages 594-609.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Winker, Peter & Gilli, Manfred, 2004. "Applications of optimization heuristics to estimation and modelling problems," Computational Statistics & Data Analysis, Elsevier, vol. 47(2), pages 211-223, September.
    2. Gilli, Manfred & Winker, Peter, 2007. "2nd Special Issue on Applications of Optimization Heuristics to Estimation and Modelling Problems," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 2-3, September.
    3. Kapetanios, George & Marcellino, Massimiliano & Papailias, Fotis, 2016. "Forecasting inflation and GDP growth using heuristic optimisation of information criteria and variable reduction methods," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 369-382.
    4. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    5. Peter Winker & Dietmar Maringer, 2009. "The convergence of estimators based on heuristics: theory and application to a GARCH model," Computational Statistics, Springer, vol. 24(3), pages 533-550, August.
    6. Schleer, Frauke, 2013. "Finding starting-values for maximum likelihood estimation of vector STAR models," ZEW Discussion Papers 13-076, ZEW - Leibniz Centre for European Economic Research.
    7. Kapetanios, George, 2007. "Variable selection in regression models using nonstandard optimisation of information criteria," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 4-15, September.
    8. Max Jerrell, 2000. "Applications Of Public Global Optimization Software To Difficult Econometric Functions," Computing in Economics and Finance 2000 161, Society for Computational Economics.
    9. Staszewska-Bystrova, Anna & Winker, Peter, 2013. "Constructing narrowest pathwise bootstrap prediction bands using threshold accepting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 221-233.
    10. Ferraresi Tommaso & Roventini Andrea & Semmler Willi, 2019. "Macroeconomic Regimes, Technological Shocks and Employment Dynamics," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(4), pages 599-625, August.
    11. Peter Winker & Dietmar Maringer, 2004. "Optimal Lag Structure Selection in VEC-Models," Contributions to Economic Analysis, in: New Directions in Macromodelling, pages 213-234, Emerald Group Publishing Limited.
    12. Frauke Schleer, 2015. "Finding Starting-Values for the Estimation of Vector STAR Models," Econometrics, MDPI, vol. 3(1), pages 1-26, January.
    13. Ivan Savin & Peter Winker, 2012. "Heuristic Optimization Methods for Dynamic Panel Data Model Selection: Application on the Russian Innovative Performance," Computational Economics, Springer;Society for Computational Economics, vol. 39(4), pages 337-363, April.
    14. Makram El-Shagi, 2011. "An evolutionary algorithm for the estimation of threshold vector error correction models," International Economics and Economic Policy, Springer, vol. 8(4), pages 341-362, December.
    15. Tucci, Marco P., 2002. "A note on global optimization in adaptive control, econometrics and macroeconomics," Journal of Economic Dynamics and Control, Elsevier, vol. 26(9-10), pages 1739-1764, August.
    16. Peter Winker & Marianna Lyra & Chris Sharpe, 2011. "Least median of squares estimation by optimization heuristics with an application to the CAPM and a multi-factor model," Computational Management Science, Springer, vol. 8(1), pages 103-123, April.
    17. Savin Ivan, 2013. "A Comparative Study of the Lasso-type and Heuristic Model Selection Methods," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 233(4), pages 526-549, August.
    18. Gimeno, Ricardo & Nave, Juan M., 2009. "A genetic algorithm estimation of the term structure of interest rates," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2236-2250, April.
    19. repec:hal:spmain:info:hdl:2441/2beljp6noq9u6oh9p9agr8ugra is not listed on IDEAS
    20. Liu, Yu-Hsin, 2011. "Incorporating scatter search and threshold accepting in finding maximum likelihood estimates for the multinomial probit model," European Journal of Operational Research, Elsevier, vol. 211(1), pages 130-138, May.
    21. Francesco Battaglia & Mattheos K. Protopapas, 2010. "Multi-regime models for nonlinear nonstationary time series," Working Papers 026, COMISEF.

    More about this item

    Keywords

    Optimization heuristics; Estimation; Modelling;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chf:rpseri:rp0812. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ridima Mittal (email available below). General contact details of provider: https://edirc.repec.org/data/fameech.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.