IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v31y2015i3p799-814.html
   My bibliography  Save this article

Generalized autocontours: Evaluation of multivariate density models

Author

Listed:
  • González-Rivera, Gloria
  • Sun, Yingying

Abstract

We propose a new tool, the Generalized Autocontour (G-ACR), as the basis for a battery of dynamic specification tests that are applicable (in-sample or out-of-sample) to univariate or multivariate random processes. We apply this methodology to the modeling of a multivariate system by specifying the dynamics of the marginal distributions of each process in the system, together with a copula that ties up the marginals to produce their multivariate distribution. We work with the probability integral transforms (PIT) of the system that, under a correct specification of the conditional model, should be i.i.d. U[0,1]. The dimensionality of the system is not a constraint, because the information contained in the vector of PITs is condensed into an indicator, which is the basis of the proposed tests. We construct hyper-cubes of different sizes within the maximum hyper-cube formed by a multidimensional uniform density [0,1]n, and assess the locations of the empirical PITs (duplex, triplex, n-plex of observations) within the corresponding population hyper-cubes. If the conditional model is correct, the volumes of the population hyper-cubes must be the same as those in their empirical counterparts. This approach allows the researcher to focus on different areas of the conditional density model, so as to assess the regions of interest. We estimate a trivariate model for a very large number of trades on the stocks of three large U.S. banks and find that the contemporaneous dependence among institutions is asymmetric, which implies that when liquidity drains (due to a lack of trading) in one institution, we should expect a concurrent effect among similar institutions. On the other hand, when liquidity is plentiful (due to dense trading), the trades on the stocks of the institutions are not correlated. We assess the models’ performances by evaluating their one-step-ahead density forecasts of trades.

Suggested Citation

  • González-Rivera, Gloria & Sun, Yingying, 2015. "Generalized autocontours: Evaluation of multivariate density models," International Journal of Forecasting, Elsevier, vol. 31(3), pages 799-814.
  • Handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:799-814
    DOI: 10.1016/j.ijforecast.2014.03.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207014000867
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2014.03.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. González-Rivera, Gloria & Senyuz, Zeynep & Yoldas, Emre, 2011. "Autocontours: Dynamic Specification Testing," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 186-200.
    2. Andrew J. Patton, 2006. "Estimation of multivariate models for time series of possibly different lengths," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(2), pages 147-173, March.
    3. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    4. González-Rivera, Gloria & Yoldas, Emre, 2012. "Autocontour-based evaluation of multivariate predictive densities," International Journal of Forecasting, Elsevier, vol. 28(2), pages 328-342.
    5. Cameron,A. Colin & Trivedi,Pravin K., 2005. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9780521848053, October.
    6. Madhavan, Ananth, 2000. "Market microstructure: A survey," Journal of Financial Markets, Elsevier, vol. 3(3), pages 205-258, August.
    7. Heinen, Andreas & Rengifo, Erick, 2007. "Multivariate autoregressive modeling of time series count data using copulas," Journal of Empirical Finance, Elsevier, vol. 14(4), pages 564-583, September.
    8. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. González-Rivera, Gloria & Sun, Yingying, 2017. "Density forecast evaluation in unstable environments," International Journal of Forecasting, Elsevier, vol. 33(2), pages 416-432.
    2. João Henrique G. Mazzeu & Gloria González-Rivera & Esther Ruiz & Helena Veiga, 2020. "A bootstrap approach for generalized Autocontour testing Implications for VIX forecast densities," Econometric Reviews, Taylor & Francis Journals, vol. 39(10), pages 971-990, November.
    3. Lenza, Michele & Moutachaker, Inès & Paredes, Joan, 2023. "Density forecasts of inflation: a quantile regression forest approach," CEPR Discussion Papers 18298, C.E.P.R. Discussion Papers.
    4. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    5. Gloria Gonzalez‐Rivera & Yun Luo & Esther Ruiz, 2020. "Prediction regions for interval‐valued time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 373-390, June.
    6. González-Rivera, Gloria & Veiga, Helena, 2016. "A Bootstrap Approach for Generalized Autocontour Testing," DES - Working Papers. Statistics and Econometrics. WS 23457, Universidad Carlos III de Madrid. Departamento de Estadística.
    7. Anatolyev, Stanislav & Baruník, Jozef, 2019. "Forecasting dynamic return distributions based on ordered binary choice," International Journal of Forecasting, Elsevier, vol. 35(3), pages 823-835.
    8. Gloria Gonzalez-Rivera & Yun Luo, 2020. "A Truncated Mixture Transition Model for Interval-valued Time Series," Working Papers 202005, University of California at Riverside, Department of Economics.
    9. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    10. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    2. João Henrique G. Mazzeu & Gloria González-Rivera & Esther Ruiz & Helena Veiga, 2020. "A bootstrap approach for generalized Autocontour testing Implications for VIX forecast densities," Econometric Reviews, Taylor & Francis Journals, vol. 39(10), pages 971-990, November.
    3. González-Rivera, Gloria & Sun, Yingying, 2017. "Density forecast evaluation in unstable environments," International Journal of Forecasting, Elsevier, vol. 33(2), pages 416-432.
    4. González-Rivera, Gloria & Yoldas, Emre, 2012. "Autocontour-based evaluation of multivariate predictive densities," International Journal of Forecasting, Elsevier, vol. 28(2), pages 328-342.
    5. González-Rivera, Gloria & Veiga, Helena, 2016. "A Bootstrap Approach for Generalized Autocontour Testing," DES - Working Papers. Statistics and Econometrics. WS 23457, Universidad Carlos III de Madrid. Departamento de Estadística.
    6. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    7. Patton, Andrew, 2013. "Copula Methods for Forecasting Multivariate Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 899-960, Elsevier.
    8. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    9. Patton, Andrew J., 2012. "A review of copula models for economic time series," Journal of Multivariate Analysis, Elsevier, vol. 110(C), pages 4-18.
    10. Dovern, Jonas & Manner, Hans, 2016. "Robust Evaluation of Multivariate Density Forecasts," VfS Annual Conference 2016 (Augsburg): Demographic Change 145547, Verein für Socialpolitik / German Economic Association.
    11. Kuang-Liang Chang, 2021. "A New Dynamic Mixture Copula Mechanism to Examine the Nonlinear and Asymmetric Tail Dependence Between Stock and Exchange Rate Returns," Computational Economics, Springer;Society for Computational Economics, vol. 58(4), pages 965-999, December.
    12. Igor L. Kheifets, 2015. "Specification tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 18(1), pages 67-94, February.
    13. Gloria Gonzalez-Rivera & Yun Luo, 2020. "A Truncated Mixture Transition Model for Interval-valued Time Series," Working Papers 202005, University of California at Riverside, Department of Economics.
    14. Dovern, Jonas & Manner, Hans, 2016. "Order Invariant Evaluation of Multivariate Density Forecasts," Working Papers 0608, University of Heidelberg, Department of Economics.
    15. Ben Omrane, Walid & Heinen, Andréas, 2010. "Public news announcements and quoting activity in the Euro/Dollar foreign exchange market," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2419-2431, November.
    16. Ivanova, Vesela & Puigvert Gutiérrez, Josep Maria, 2014. "Interest rate forecasts, state price densities and risk premium from Euribor options," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 210-223.
    17. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    18. Corradi, Valentina & Swanson, Norman R., 2004. "A test for the distributional comparison of simulated and historical data," Economics Letters, Elsevier, vol. 85(2), pages 185-193, November.
    19. Allen, David & Lazarov, Zdravetz & McAleer, Michael & Peiris, Shelton, 2009. "Comparison of alternative ACD models via density and interval forecasts: Evidence from the Australian stock market," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(8), pages 2535-2555.
    20. Corradi, Valentina & Swanson, Norman R., 2004. "Some recent developments in predictive accuracy testing with nested models and (generic) nonlinear alternatives," International Journal of Forecasting, Elsevier, vol. 20(2), pages 185-199.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:31:y:2015:i:3:p:799-814. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.