IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/18-17.html
   My bibliography  Save this paper

Uncertain identification

Author

Listed:
  • Raffaella Giacomini
  • Toru Kitagawa
  • Alessio Volpicella

Abstract

Uncertainty about the choice of identifying assumptions is common in causal studies, but is often ignored in empirical practice. This paper considers uncertainty over models that impose different identifying assumptions, which, in general, leads to a mix of point- and set-identified models. We propose performing inference in the presence of such uncertainty by generalizing Bayesian model averaging. The method considers multiple posteriors for the set-identified models and combines them with a single posterior for models that are either point-identified or that impose non-dogmatic assumptions. The output is a set of posteriors (post-averaging ambiguous belief) that are mixtures of the single posterior and any element of the class of multiple posteriors, with weights equal to the posterior model probabilities. We suggest reporting the range of posterior means and the associated credible region in practice, and provide a simple algorithm to compute them. We establish that the prior model probabilities are updated when the models are "distinguishable" and/or they specify different priors for reduced-form parameters, and characterize the asymptotic behavior of the posterior model probabilities. The method provides a formal framework for conducting sensitivity analysis of empirical findings to the choice of identifying assumptions. In a standard monetary model, for example, we show that, in order to support a negative response of output to a contractionary monetary policy shock, one would need to attach a prior probability greater than 0.32 to the validity of the assumption that prices do not react contemporaneously to such a shock. The method is general and allows for dogmatic and non-dogmatic identifying assumptions, multiple point-identified models, multiple set-identified models, and nested or non-nested models.

Suggested Citation

  • Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers 18/17, Institute for Fiscal Studies.
  • Handle: RePEc:azt:cemmap:18/17
    DOI: 10.1920/wp.cem.2017.1817
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP1817.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1920/wp.cem.2017.1817?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    2. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    3. S. Boragan Aruoba & Frank Schorfheide, 2011. "Sticky Prices versus Monetary Frictions: An Estimation of Policy Trade-Offs," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 60-90, January.
    4. Andrew Mountford, 2005. "Leaning into the Wind: A Structural VAR Investigation of UK Monetary Policy," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(5), pages 597-621, October.
    5. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    6. Christiano, Lawrence J. & Eichenbaum, Martin & Evans, Charles L., 1999. "Monetary policy shocks: What have we learned and to what end?," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 2, pages 65-148, Elsevier.
    7. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    8. Patrick Bajari & Han Hong & Stephen P. Ryan, 2010. "Identification and Estimation of a Discrete Game of Complete Information," Econometrica, Econometric Society, vol. 78(5), pages 1529-1568, September.
    9. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    10. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    11. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    12. Gert Peersman & Roland Straub, 2009. "Technology Shocks And Robust Sign Restrictions In A Euro Area Svar," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(3), pages 727-750, August.
    13. Yuan Liao & Anna Simoni, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," Papers 1212.3267, arXiv.org, revised Nov 2013.
    14. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    15. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    16. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    17. Canova, Fabio & Nicolo, Gianni De, 2002. "Monetary disturbances matter for business fluctuations in the G-7," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1131-1159, September.
    18. Faust, Jon, 1998. "The robustness of identified VAR conclusions about money," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 49(1), pages 207-244, December.
    19. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    20. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    21. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    22. A. Norets & X. Tang, 2014. "Semiparametric Inference in Dynamic Binary Choice Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1229-1262.
    23. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    24. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    25. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    26. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, November.
    27. Vargas-Silva, Carlos, 2008. "Monetary policy and the US housing market: A VAR analysis imposing sign restrictions," Journal of Macroeconomics, Elsevier, vol. 30(3), pages 977-990, September.
    28. Rafiq, M.S. & Mallick, S.K., 2008. "The effect of monetary policy on output in EMU3: A sign restriction approach," Journal of Macroeconomics, Elsevier, vol. 30(4), pages 1756-1791, December.
    29. Reichenstein, William, 1987. "The Impact of Money on Short-term Interest Rates," Economic Inquiry, Western Economic Association International, vol. 25(1), pages 67-82, January.
    30. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    31. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    32. Lutz Kilian & Daniel P. Murphy, 2012. "Why Agnostic Sign Restrictions Are Not Enough: Understanding The Dynamics Of Oil Market Var Models," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1166-1188, October.
    33. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    34. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    35. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    36. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    37. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    38. Scholl, Almuth & Uhlig, Harald, 2008. "New evidence on the puzzles: Results from agnostic identification on monetary policy and exchange rates," Journal of International Economics, Elsevier, vol. 76(1), pages 1-13, September.
    39. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    40. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    41. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers CWP18/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2022. "Uncertain identification," Quantitative Economics, Econometric Society, vol. 13(1), pages 95-123, January.
    3. Alessio Volpicella, 2019. "SVARs Identification through Bounds on the Forecast Error Variance," Working Papers 890, Queen Mary University of London, School of Economics and Finance.
    4. Victor Pontines, 2021. "The real effects of loan-to-value limits: empirical evidence from Korea," Empirical Economics, Springer, vol. 61(3), pages 1311-1350, September.
    5. Renée Fry & Adrian Pagan, 2011. "Sign Restrictions in Structural Vector Autoregressions: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 938-960, December.
    6. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    7. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    8. Baumeister, Christiane & Hamilton, James D., 2020. "Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 109(C).
    9. Baumeister, Christiane & Hamilton, James D., 2021. "Reprint: Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 114(C).
    10. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Nadav Ben Zeev, 2019. "Is There A Single Shock That Drives The Majority Of Business Cycle Fluctuations?," Working Papers 1906, Ben-Gurion University of the Negev, Department of Economics.
    12. Emanuele Bacchiocchi & Toru Kitagawa, 2020. "Locally- but not globally-identified SVARs," CeMMAP working papers CWP40/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Oladunni, Sunday, 2019. "External Shocks and Business Cycle Fluctuations in Oil-exporting Small Open Economies: The Case of Nigeria," MPRA Paper 98639, University Library of Munich, Germany.
    14. Inoue, Atsushi & Kilian, Lutz, 2013. "Inference on impulse response functions in structural VAR models," Journal of Econometrics, Elsevier, vol. 177(1), pages 1-13.
    15. Herwartz, Helmut & Plödt, Martin, 2014. "Sign restrictions and statistical identification under volatility breaks -- Simulation based evidence and an empirical application to monetary policy analysis," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100326, Verein für Socialpolitik / German Economic Association.
    16. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    17. Tim Berg, 2012. "Did monetary or technology shocks move euro area stock prices?," Empirical Economics, Springer, vol. 43(2), pages 693-722, October.
    18. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    19. Helmut Lütkepohl & Aleksei NetŠunajev, 2014. "Disentangling Demand And Supply Shocks In The Crude Oil Market: How To Check Sign Restrictions In Structural Vars," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(3), pages 479-496, April.
    20. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:18/17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.