Advanced Search
MyIDEAS: Login

On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks

Contents:

Author Info

  • HOOGERHEIDE, Lennart F.
  • KAASHOEK, Johan F.
  • VAN DIJK, Herman K.

Abstract

Likelihoods and posteriors of instrumental variable regression models with strong endogeneity and/or weak instruments may exhibit rather non-elliptical contours in the parameter space. This may seriously affect inference based on Bayesian credible sets. When approximating such contours using Monte Carlo integration methods like importance sampling or Markov chain Monte Carlo procedures the speed of the algorithm and the quality of the results greatly depend on the choice of the importance or candidate density. Such a density has to be 'close' to the target density in order to yield accurate results with numerically efficient sampling. For this purpose we introduce neural networks which seem to be natural importance or candidate densities, as they have a universal approximation property and are easy to sample from. A key step in the proposed class of methods is the construction of a neural network that approximates the target density accurately. The methods are tested on a set of illustrative models. The results indicate the feasibility of the neural network approach.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://alfresco.uclouvain.be/alfresco/download/attach/workspace/SpacesStore/91736191-1dad-4ec8-a36f-cb8bc40c01f0/coredp_2005_29.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Université catholique de Louvain, Center for Operations Research and Econometrics (CORE) in its series CORE Discussion Papers with number 2005029.

as in new window
Length:
Date of creation: 00 2005
Date of revision:
Handle: RePEc:cor:louvco:2005029

Contact details of provider:
Postal: Voie du Roman Pays 34, 1348 Louvain-la-Neuve (Belgium)
Phone: 32(10)474321
Fax: +32 10474304
Email:
Web page: http://www.uclouvain.be/core
More information through EDIRC

Related research

Keywords: instrumental variables; reduced rank; importance sampling; Markov chain Monte Carlo; neural networks; Bayesian inference; credible sets;

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
  2. Pesaran, M.H. & Smith, R., 1992. "Estimating Long-Run Relationships From Dynamic Heterogeneous Panels," Cambridge Working Papers in Economics 9215, Faculty of Economics, University of Cambridge.
  3. Bos, C.S. & Mahieu, R.J. & van Dijk, H.K., 1999. "Daily exchange rate behaviour and hedging of currency risk," Econometric Institute Research Papers EI 9936/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  4. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  5. Chao, J. C. & Phillips, P. C. B., 1998. "Posterior distributions in limited information analysis of the simultaneous equations model using the Jeffreys prior," Journal of Econometrics, Elsevier, vol. 87(1), pages 49-86, August.
  6. Dreze, Jacques H., 1977. "Bayesian regression analysis using poly-t densities," Journal of Econometrics, Elsevier, vol. 6(3), pages 329-354, November.
  7. Angrist, Joshua D & Krueger, Alan B, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, MIT Press, vol. 106(4), pages 979-1014, November.
  8. Kleibergen, F.R. & van Dijk, H.K., 1997. "Bayesian Simultaneous Equations Analysis using Reduced Rank Structures," Econometric Institute Research Papers EI 9714/A, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  9. Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2003. "Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2003-22, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  10. ZELLNER, A. & BAUWENS, Luc & VAN DIJK, H., 1987. "Bayesian specification analysis and estimation of simultaneous equation models using Monte Carlo methods," CORE Discussion Papers 1987056, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  11. James M. Hutchinson & Andrew W. Lo & Tomaso Poggio, 1995. "A Nonparametric Approach to Pricing and Hedging Derivative Securities Via Learning Networks," NBER Working Papers 4718, National Bureau of Economic Research, Inc.
  12. Kleibergen, Frank & van Dijk, Herman K., 1994. "On the Shape of the Likelihood/Posterior in Cointegration Models," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 514-551, August.
  13. Frank Kleibergen & Eric Zivot, 1998. "Bayesian and Classical Approaches to Instrumental Variable Regression," Working Papers 0063, University of Washington, Department of Economics.
  14. Richard Paap & Herman K. van Dijk, 1999. "Bayes Estimates of Markov Trends in Possibly Cointegrated Series: An Application to US Consumption and Income," Tinbergen Institute Discussion Papers 99-024/4, Tinbergen Institute.
  15. Sylvia Fruhwirth-Schnatter, 2004. "Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 143-167, 06.
  16. Dreze, Jacques H, 1976. "Bayesian Limited Information Analysis of the Simultaneous Equations Model," Econometrica, Econometric Society, vol. 44(5), pages 1045-75, September.
  17. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
  18. P. Damlen & J. Wakefield & S. Walker, 1999. "Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 331-344.
  19. Strachan, R.W. & van Dijk, H.K., 2004. "Improper priors with well defined Bayes Factors," Econometric Institute Research Papers EI 2004-18, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  20. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139.
  21. Donaldson, R. Glen & Kamstra, Mark, 1997. "An artificial neural network-GARCH model for international stock return volatility," Journal of Empirical Finance, Elsevier, vol. 4(1), pages 17-46, January.
  22. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-39, November.
  23. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
  24. Chib, Siddhartha & Greenberg, Edward, 1996. "Markov Chain Monte Carlo Simulation Methods in Econometrics," Econometric Theory, Cambridge University Press, vol. 12(03), pages 409-431, August.
  25. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
  26. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2004. "Neural network based approximations to posterior densities: a class of flexible sampling methods with applications to reduced rank models," Econometric Institute Research Papers EI 2004-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  27. Maddala, G S, 1976. "Weak Priors and Sharp Posteriors in Simultaneous Equation Models," Econometrica, Econometric Society, vol. 44(2), pages 345-51, March.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2005029. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alain GILLIS).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.