IDEAS home Printed from https://ideas.repec.org/p/cor/louvco/2005029.html
   My bibliography  Save this paper

On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks

Author

Listed:
  • HOOGERHEIDE, Lennart F.
  • KAASHOEK, Johan F.
  • VAN DIJK, Herman K.

Abstract

Likelihoods and posteriors of instrumental variable regression models with strong endogeneity and/or weak instruments may exhibit rather non-elliptical contours in the parameter space. This may seriously affect inference based on Bayesian credible sets. When approximating such contours using Monte Carlo integration methods like importance sampling or Markov chain Monte Carlo procedures the speed of the algorithm and the quality of the results greatly depend on the choice of the importance or candidate density. Such a density has to be 'close' to the target density in order to yield accurate results with numerically efficient sampling. For this purpose we introduce neural networks which seem to be natural importance or candidate densities, as they have a universal approximation property and are easy to sample from. A key step in the proposed class of methods is the construction of a neural network that approximates the target density accurately. The methods are tested on a set of illustrative models. The results indicate the feasibility of the neural network approach.

Suggested Citation

  • HOOGERHEIDE, Lennart F. & KAASHOEK, Johan F. & VAN DIJK, Herman K., 2005. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," CORE Discussion Papers 2005029, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  • Handle: RePEc:cor:louvco:2005029
    as

    Download full text from publisher

    File URL: https://uclouvain.be/en/research-institutes/immaq/core/dp-2005.html
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, Oxford University Press, vol. 106(4), pages 979-1014.
    2. Maddala, G S, 1976. "Weak Priors and Sharp Posteriors in Simultaneous Equation Models," Econometrica, Econometric Society, vol. 44(2), pages 345-351, March.
    3. Kleibergen, Frank & van Dijk, Herman K., 1998. "Bayesian Simultaneous Equations Analysis Using Reduced Rank Structures," Econometric Theory, Cambridge University Press, vol. 14(06), pages 701-743, December.
    4. Bauwens, Luc & Bos, Charles S. & van Dijk, Herman K. & van Oest, Rutger D., 2004. "Adaptive radial-based direction sampling: some flexible and robust Monte Carlo integration methods," Journal of Econometrics, Elsevier, vol. 123(2), pages 201-225, December.
    5. Kleibergen, Frank & Zivot, Eric, 2003. "Bayesian and classical approaches to instrumental variable regression," Journal of Econometrics, Elsevier, vol. 114(1), pages 29-72, May.
    6. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    7. Paap, Richard & van Dijk, Herman K, 2003. "Bayes Estimates of Markov Trends in Possibly Cointegrated Series: An Application to U.S. Consumption and Income," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(4), pages 547-563, October.
    8. P. Damlen & J. Wakefield & S. Walker, 1999. "Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 331-344.
    9. Zellner, Arnold & Bauwens, Luc & Van Dijk, Herman K., 1988. "Bayesian specification analysis and estimation of simultaneous equation models using Monte Carlo methods," Journal of Econometrics, Elsevier, vol. 38(1-2), pages 39-72.
    10. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    11. Strachan, R.W. & van Dijk, H.K., 2004. "Improper priors with well defined Bayes Factors," Econometric Institute Research Papers EI 2004-18, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    12. Hutchinson, James M & Lo, Andrew W & Poggio, Tomaso, 1994. " A Nonparametric Approach to Pricing and Hedging Derivative Securities via Learning Networks," Journal of Finance, American Finance Association, vol. 49(3), pages 851-889, July.
    13. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    14. Dreze, Jacques H, 1976. "Bayesian Limited Information Analysis of the Simultaneous Equations Model," Econometrica, Econometric Society, vol. 44(5), pages 1045-1075, September.
    15. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    16. Donaldson, R. Glen & Kamstra, Mark, 1997. "An artificial neural network-GARCH model for international stock return volatility," Journal of Empirical Finance, Elsevier, vol. 4(1), pages 17-46, January.
    17. Chib, Siddhartha & Greenberg, Edward, 1996. "Markov Chain Monte Carlo Simulation Methods in Econometrics," Econometric Theory, Cambridge University Press, vol. 12(03), pages 409-431, August.
    18. Charles S. Bos & Ronald J. Mahieu & Herman K. Van Dijk, 2000. "Daily exchange rate behaviour and hedging of currency risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 671-696.
    19. Pesaran, M. Hashem & Smith, Ron, 1995. "Estimating long-run relationships from dynamic heterogeneous panels," Journal of Econometrics, Elsevier, vol. 68(1), pages 79-113, July.
    20. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
    21. Kleibergen, Frank & van Dijk, Herman K., 1994. "On the Shape of the Likelihood/Posterior in Cointegration Models," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 514-551, August.
    22. Dreze, Jacques H., 1977. "Bayesian regression analysis using poly-t densities," Journal of Econometrics, Elsevier, vol. 6(3), pages 329-354, November.
    23. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139.
    24. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2004. "Neural network based approximations to posterior densities: a class of flexible sampling methods with applications to reduced rank models," Econometric Institute Research Papers EI 2004-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    25. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    26. Sylvia Fruhwirth-Schnatter, 2004. "Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 143-167, June.
    27. Chao, J. C. & Phillips, P. C. B., 1998. "Posterior distributions in limited information analysis of the simultaneous equations model using the Jeffreys prior," Journal of Econometrics, Elsevier, vol. 87(1), pages 49-86, August.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    instrumental variables; reduced rank; importance sampling; Markov chain Monte Carlo; neural networks; Bayesian inference; credible sets;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2005029. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alain GILLIS). General contact details of provider: http://edirc.repec.org/data/coreebe.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.