IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v31y2015i3p769-781.html
   My bibliography  Save this article

Interpretation and use of sensitivity in econometrics, illustrated with forecast combinations

Author

Listed:
  • Magnus, Jan R.
  • Vasnev, Andrey L.

Abstract

Sensitivity analysis is important both for its own sake and in combination with diagnostic testing. We consider the question of how to use sensitivity statistics in practice, and in particular, how to judge whether the sensitivity is large or small. For this purpose, we distinguish between absolute and relative sensitivity, and highlight the context-dependent nature of sensitivity analysis. The relative sensitivity is then applied to forecast combinations, and sensitivity-based weights are introduced. All of the concepts are illustrated using the European yield curve. In this context, it is natural to consider the sensitivity to autocorrelation and normality assumptions. Different forecasting models are combined using equal, fit-based and sensitivity-based weights, and compared with the multivariate and random walk benchmarks. We show that the fit-based and sensitivity-based weights are complementary, but that the sensitivity-based weights perform better than other weights for long-term maturities.

Suggested Citation

  • Magnus, Jan R. & Vasnev, Andrey L., 2015. "Interpretation and use of sensitivity in econometrics, illustrated with forecast combinations," International Journal of Forecasting, Elsevier, vol. 31(3), pages 769-781.
  • Handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:769-781
    DOI: 10.1016/j.ijforecast.2013.08.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207013001325
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2013.08.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Piazzesi, Monika & Swanson, Eric T., 2008. "Futures prices as risk-adjusted forecasts of monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 677-691, May.
    2. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    3. Banerjee, Anurag N. & Magnus, Jan R., 1999. "The sensitivity of OLS when the variance matrix is (partially) unknown," Journal of Econometrics, Elsevier, vol. 92(2), pages 295-323, October.
    4. Libor Pospisil & Jan Vecer, 2010. "Portfolio sensitivity to changes in the maximum and the maximum drawdown," Quantitative Finance, Taylor & Francis Journals, vol. 10(6), pages 617-627.
    5. Alan T.K. Wan & Guohua Zou & Huaizhen Qin, 2007. "On the sensitivity of the restricted least squares estimators to covariance misspecification," Econometrics Journal, Royal Economic Society, vol. 10(3), pages 471-487, November.
    6. Richard Ashley, 2009. "Assessing the credibility of instrumental variables inference with imperfect instruments via sensitivity analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(2), pages 325-337, March.
    7. Gourieroux, C. & Laurent, J. P. & Scaillet, O., 2000. "Sensitivity analysis of Values at Risk," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 225-245, November.
    8. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2013. "Complete subset regressions," Journal of Econometrics, Elsevier, vol. 177(2), pages 357-373.
    9. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    10. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    11. Vasnev, Andrey L., 2010. "Sensitivity of GLS estimators in random effects models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1252-1262, May.
    12. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    13. Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
    14. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    15. Robert L. Winkler & Robert T. Clemen, 1992. "Sensitivity of Weights in Combining Forecasts," Operations Research, INFORMS, vol. 40(3), pages 609-614, June.
    16. Pauwels, Laurent & Vasnev, Andrey, 2013. "Practical considerations for optimal weights in density forecast combi nation," Working Papers 01/2013, University of Sydney Business School, Discipline of Business Analytics.
    17. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    18. Magnus, Jan R. & Vasnev, Andrey L., 2008. "Using Macro Data To Obtain Better Micro Forecasts," Econometric Theory, Cambridge University Press, vol. 24(2), pages 553-579, April.
    19. Qin, Huaizhen & Wan, Alan T.K. & Zou, Guohua, 2009. "On the sensitivity of the one-sided t test to covariance misspecification," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1593-1609, September.
    20. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    21. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Yuying & Zhang, Xinyu & Wan, Alan T.K. & Wang, Shouyang, 2022. "Model averaging for interval-valued data," European Journal of Operational Research, Elsevier, vol. 301(2), pages 772-784.
    2. Huang, Weiting & He, Jia, 2023. "Impact of energy intensity, green economy, and natural resources development to achieve sustainable economic growth in Asian countries," Resources Policy, Elsevier, vol. 84(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    2. Zhao, Albert Bo & Cheng, Tingting, 2022. "Stock return prediction: Stacking a variety of models," Journal of Empirical Finance, Elsevier, vol. 67(C), pages 288-317.
    3. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    4. Ren, Yu & Liang, Xuanxuan & Wang, Qin, 2021. "Short-term exchange rate forecasting: A panel combination approach," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 73(C).
    5. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    6. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    7. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    8. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    9. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    10. Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017. "Forecasting GDP with global components: This time is different," International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
    11. Jin, Sainan & Corradi, Valentina & Swanson, Norman R., 2017. "Robust Forecast Comparison," Econometric Theory, Cambridge University Press, vol. 33(6), pages 1306-1351, December.
    12. Nicoletta Pashourtidou & Christos Papamichael & Charalampos Karagiannakis, 2018. "Forecasting economic activity in sectors of the Cypriot economy," Cyprus Economic Policy Review, University of Cyprus, Economics Research Centre, vol. 12(2), pages 24-66, December.
    13. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    14. Jiang, Yu & Guo, Yongji & Zhang, Yihao, 2017. "Forecasting China's GDP growth using dynamic factors and mixed-frequency data," Economic Modelling, Elsevier, vol. 66(C), pages 132-138.
    15. Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
    16. Cotter, John & Eyiah-Donkor, Emmanuel & Potì, Valerio, 2023. "Commodity futures return predictability and intertemporal asset pricing," Journal of Commodity Markets, Elsevier, vol. 31(C).
    17. Soybilgen, Barış & Yazgan, Ege, 2018. "Evaluating nowcasts of bridge equations with advanced combination schemes for the Turkish unemployment rate," Economic Modelling, Elsevier, vol. 72(C), pages 99-108.
    18. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    19. Chan, Felix & Pauwels, Laurent L., 2018. "Some theoretical results on forecast combinations," International Journal of Forecasting, Elsevier, vol. 34(1), pages 64-74.
    20. Hansen, Bruce E., 2010. "Averaging estimators for autoregressions with a near unit root," Journal of Econometrics, Elsevier, vol. 158(1), pages 142-155, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:769-781. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.