IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: an application of flexible sampling methods using neural networks

  • Hoogerheide, L.F.
  • Kaashoek, J.F.
  • van Dijk, H.K.

Likelihoods and posteriors of instrumental variable regression models with strong endogeneity and/or weak instruments may exhibit rather non-elliptical contours in the parameter space. This may seriously affect inference based on Bayesian credible sets. When approximating such contours using Monte Carlo integration methods like importance sampling or Markov chain Monte Carlo procedures the speed of the algorithm and the quality of the results greatly depend on the choice of the importance or candidate density. Such a density has to be `close' to the target density in order to yield accurate results with numerically efficient sampling. For this purpose we introduce neural networks which seem to be natural importance or candidate densities, as they have a universal approximation property and are easy to sample from. A key step in the proposed class of methods is the construction of a neural network that approximates the target density accurately. The methods are tested on a set of illustrative models. The results indicate the feasibility of the neural network approach.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute in its series Econometric Institute Research Papers with number EI 2005-12.

in new window

Date of creation: 31 Mar 2005
Date of revision:
Handle: RePEc:ems:eureir:2007
Contact details of provider: Postal: Postbus 1738, 3000 DR Rotterdam
Phone: 31 10 4081111
Web page:

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Donaldson, R. Glen & Kamstra, Mark, 1997. "An artificial neural network-GARCH model for international stock return volatility," Journal of Empirical Finance, Elsevier, vol. 4(1), pages 17-46, January.
  2. Frank Kleibergen & Eric Zivot, 1998. "Bayesian and Classical Approaches to Instrumental Variable Regression," Working Papers 0063, University of Washington, Department of Economics.
  3. Richard Paap & Herman K. van Dijk, 1999. "Bayes Estimates of Markov Trends in possibly Cointegrated Series: An Application to US Consumption and Income," Tinbergen Institute Discussion Papers 99-024/4, Tinbergen Institute.
  4. James M. Hutchinson & Andrew W. Lo & Tomaso Poggio, 1994. "A Nonparametric Approach to Pricing and Hedging Derivative Securities Via Learning Networks," NBER Working Papers 4718, National Bureau of Economic Research, Inc.
  5. Chao, J. C. & Phillips, P. C. B., 1998. "Posterior distributions in limited information analysis of the simultaneous equations model using the Jeffreys prior," Journal of Econometrics, Elsevier, vol. 87(1), pages 49-86, August.
  6. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
  7. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2004. "Neural network based approximations to posterior densities: a class of flexible sampling methods with applications to reduced rank models," Econometric Institute Research Papers EI 2004-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  8. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
  9. Chib, Siddhartha & Greenberg, Edward, 1996. "Markov Chain Monte Carlo Simulation Methods in Econometrics," Econometric Theory, Cambridge University Press, vol. 12(03), pages 409-431, August.
  10. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  11. Charles S. Bos & Ronald J. Mahieu & Herman K. van Dijk, 2000. "Daily Exchange Rate Behaviour and Hedging of Currency Risk," Econometric Society World Congress 2000 Contributed Papers 0504, Econometric Society.
  12. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, Oxford University Press, vol. 106(4), pages 979-1014.
  13. Zellner, Arnold & Bauwens, Luc & Van Dijk, Herman K., 1988. "Bayesian specification analysis and estimation of simultaneous equation models using Monte Carlo methods," Journal of Econometrics, Elsevier, vol. 38(1-2), pages 39-72.
  14. Sylvia Fruhwirth-Schnatter, 2004. "Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 143-167, 06.
  15. Bauwens, Luc & Bos, Charles S. & van Dijk, Herman K. & van Oest, Rutger D., 2004. "Adaptive radial-based direction sampling: some flexible and robust Monte Carlo integration methods," Journal of Econometrics, Elsevier, vol. 123(2), pages 201-225, December.
  16. Maddala, G S, 1976. "Weak Priors and Sharp Posteriors in Simultaneous Equation Models," Econometrica, Econometric Society, vol. 44(2), pages 345-51, March.
  17. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
  18. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
  19. Kleibergen, F.R. & van Dijk, H.K., 1997. "Bayesian Simultaneous Equations Analysis using Reduced Rank Structures," Econometric Institute Research Papers EI 9714/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  20. Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
  21. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-39, November.
  22. P. Damlen & J. Wakefield & S. Walker, 1999. "Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 331-344.
  23. Dreze, Jacques H., 1977. "Bayesian regression analysis using poly-t densities," Journal of Econometrics, Elsevier, vol. 6(3), pages 329-354, November.
  24. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139, July.
  25. Dreze, Jacques H, 1976. "Bayesian Limited Information Analysis of the Simultaneous Equations Model," Econometrica, Econometric Society, vol. 44(5), pages 1045-75, September.
  26. Strachan, R.W. & van Dijk, H.K., 2004. "Improper priors with well defined Bayes Factors," Econometric Institute Research Papers EI 2004-18, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  27. Kleibergen, Frank & van Dijk, Herman K., 1994. "On the Shape of the Likelihood/Posterior in Cointegration Models," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 514-551, August.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ems:eureir:2007. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (RePub)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.