Gaussian Process Regression Networks
We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates input dependent signal and noise correlations between multiple response variables, input dependent length-scales and amplitudes, and heavy-tailed predictive distributions. We derive both efficient Markov chain Monte Carlo and variational Bayes inference procedures for this model. We apply GPRN as a multiple output regression and multivariate volatility model, demonstrating substantially improved performance over eight popular multiple output (multi-task) Gaussian process models and three multivariate volatility models on benchmark datasets, including a 1000 dimensional gene expression dataset.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Alexandra M. Schmidt & Anthony O'Hagan, 2003. "Bayesian inference for non-stationary spatial covariance structure via spatial deformations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(3), pages 743-758.
- Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2006. "Analysis of high dimensional multivariate stochastic volatility models," Journal of Econometrics, Elsevier, vol. 134(2), pages 341-371, October.
- Brooks, Chris & Burke, Simon P. & Persand, Gita, 2001. "Benchmarks and the accuracy of GARCH model estimation," International Journal of Forecasting, Elsevier, vol. 17(1), pages 45-56.
- Engle, Robert F. & Kroner, Kenneth F., 1995. "Multivariate Simultaneous Generalized ARCH," Econometric Theory, Cambridge University Press, vol. 11(01), pages 122-150, February.
- Asger Lunde & Peter R. Hansen, 2005.
"A forecast comparison of volatility models: does anything beat a GARCH(1,1)?,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
- Asger Lunde & Peter Reinhard Hansen, 2001. "A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH(1,1)?," Working Papers 2001-04, Brown University, Department of Economics.
- Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," Review of Economic Studies, Oxford University Press, vol. 61(2), pages 247-264.
- Bollerslev, Tim & Engle, Robert F & Wooldridge, Jeffrey M, 1988. "A Capital Asset Pricing Model with Time-Varying Covariances," Journal of Political Economy, University of Chicago Press, vol. 96(1), pages 116-131, February.
- Gourieroux, C. & Jasiak, J. & Sufana, R., 2009.
"The Wishart Autoregressive process of multivariate stochastic volatility,"
Journal of Econometrics,
Elsevier, vol. 150(2), pages 167-181, June.
- Joan Jasiak & R. Sufana & C. Gourieroux, 2005. "The Wishart Autoregressive Process of Multivariate Stochastic Volatility," Working Papers 2005_2, York University, Department of Economics.
When requesting a correction, please mention this item's handle: RePEc:arx:papers:1110.4411. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators)
If references are entirely missing, you can add them using this form.