IDEAS home Printed from https://ideas.repec.org/p/ihs/ihsesp/160.html
   My bibliography  Save this paper

Parameter Instability and Forecasting Performance. A Monte Carlo Study

Author

Listed:
  • Anyfantakis, Costas

    (University of Piraeus)

  • Caporale, Guglielmo M.

    (London South Bank University)

  • Pittis, Nikitas

    (University of Piraeus)

Abstract

This paper uses Monte Carlo techniques to assess the loss in terms of forecast accuracy which is incurred when the true DGP exhibits parameter instability which is either overlooked or incorrectly modelled. We find that the loss is considerable when a FCM is estimated instead of the true TVCM, this loss being an increasing function of the degree of persistence and of the variance of the process driving the slope coefficient. A loss is also incurred when a TVCM different from the correct one is specified, the resulting forecasts being even less accurate than those of a FCM. However, the loss can be minimised by selecting a TVCM which, although incorrect, nests the true one, more specifically an AR(1) model with a constant. Finally, there is hardly any loss resulting from using a TVCM when the underlying DGP is characterised by fixed coefficients.

Suggested Citation

  • Anyfantakis, Costas & Caporale, Guglielmo M. & Pittis, Nikitas, 2004. "Parameter Instability and Forecasting Performance. A Monte Carlo Study," Economics Series 160, Institute for Advanced Studies.
  • Handle: RePEc:ihs:ihsesp:160
    as

    Download full text from publisher

    File URL: https://irihs.ihs.ac.at/id/eprint/1580
    File Function: First version, 2004
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Caporale, Guglielmo Maria & Pittis, Nikitas, 2002. "Unit Roots versus Other Types of Time Heterogeneity, Parameter Time Dependence and Superexogeneity," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(3), pages 207-223, April.
    2. Harvey,Andrew C., 1991. "Forecasting, Structural Time Series Models and the Kalman Filter," Cambridge Books, Cambridge University Press, number 9780521405737, January.
    3. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521632423, January.
    4. Siem Jan Koopman & Neil Shephard & Jurgen A. Doornik, 1999. "Statistical algorithms for models in state space using SsfPack 2.2," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 107-160.
    5. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
    6. Cooley, Thomas F & Prescott, Edward C, 1976. "Estimation in the Presence of Stochastic Parameter Variation," Econometrica, Econometric Society, vol. 44(1), pages 167-184, January.
    7. Moryson, Martin, 1994. "Testing for Random Walk Coefficients in a Simple State Space Model," SFB 373 Discussion Papers 1994,21, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    8. Guglielmo Caporale & Nikitas Pittis, 2001. "Parameter instability, superexogeneity, and the monetary model of the exchange rate," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 137(3), pages 501-524, September.
    9. Michael P. Clements & David F. Hendry, 2001. "Forecasting Non-Stationary Economic Time Series," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262531895, December.
    10. Clements, Michael P. & Hendry, David F., 1998. "Forecasting economic processes," International Journal of Forecasting, Elsevier, vol. 14(1), pages 111-131, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Filippo di Mauro & L. Vanessa Smith & Stephane Dees & M. Hashem Pesaran, 2007. "Exploring the international linkages of the euro area: a global VAR analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-38.
    2. M. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2006. "Forecasting Time Series Subject to Multiple Structural Breaks," Review of Economic Studies, Oxford University Press, vol. 73(4), pages 1057-1084.
    3. Hashem Pesaran & Davide Pettenuzzo & Allan Timmermann, 2007. "Learning, Structural Instability, and Present Value Calculations," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 253-288.
    4. Guillaume Chevillon, 2007. "Direct Multi‐Step Estimation And Forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 21(4), pages 746-785, September.
    5. Victor Bystrov, 2006. "Forecasting Emerging Market Indicators: Brazil and Russia," Economics Working Papers ECO2006/12, European University Institute.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
    8. Lindh, Thomas & Malmberg, Bo, 2007. "Demographically based global income forecasts up to the year 2050," International Journal of Forecasting, Elsevier, vol. 23(4), pages 553-567.
    9. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    10. Mandalinci, Zeyyad, 2017. "Forecasting inflation in emerging markets: An evaluation of alternative models," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1082-1104.
    11. Rob Luginbuhl, 2020. "Estimation of the Financial Cycle with a Rank-Reduced Multivariate State-Space Model," CPB Discussion Paper 409, CPB Netherlands Bureau for Economic Policy Analysis.
    12. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    13. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    14. Moosa, Imad & Burns, Kelly, 2014. "The unbeatable random walk in exchange rate forecasting: Reality or myth?," Journal of Macroeconomics, Elsevier, vol. 40(C), pages 69-81.
    15. P. Geoffrey Allen & Robert Fildes, 2005. "Levels, Differences and ECMs – Principles for Improved Econometric Forecasting," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 881-904, December.
    16. Hendry, David F., 2006. "Robustifying forecasts from equilibrium-correction systems," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 399-426.
    17. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Boston University - Department of Economics - Working Papers Series WP2019-02, Boston University - Department of Economics.
    18. Hendry, David F. & Hubrich, Kirstin, 2006. "Forecasting economic aggregates by disaggregates," Working Paper Series 589, European Central Bank.
    19. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    20. Geweke, John & Jiang, Yu, 2011. "Inference and prediction in a multiple-structural-break model," Journal of Econometrics, Elsevier, vol. 163(2), pages 172-185, August.

    More about this item

    Keywords

    Fixed coefficient model; Time varying parameter models; Forecasting;
    All these keywords.

    JEL classification:

    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G15 - Financial Economics - - General Financial Markets - - - International Financial Markets
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ihs:ihsesp:160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Doris Szoncsitz (email available below). General contact details of provider: https://edirc.repec.org/data/deihsat.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.