IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/18-17.html
   My bibliography  Save this paper

Uncertain identification

Author

Listed:
  • Raffaella Giacomini
  • Toru Kitagawa
  • Alessio Volpicella

Abstract

Uncertainty about the choice of identifying assumptions is common in causal studies, but is often ignored in empirical practice. This paper considers uncertainty over models that impose different identifying assumptions, which, in general, leads to a mix of point- and set-identified models. We propose performing inference in the presence of such uncertainty by generalizing Bayesian model averaging. The method considers multiple posteriors for the set-identified models and combines them with a single posterior for models that are either point-identified or that impose non-dogmatic assumptions. The output is a set of posteriors (post-averaging ambiguous belief) that are mixtures of the single posterior and any element of the class of multiple posteriors, with weights equal to the posterior model probabilities. We suggest reporting the range of posterior means and the associated credible region in practice, and provide a simple algorithm to compute them. We establish that the prior model probabilities are updated when the models are "distinguishable" and/or they specify different priors for reduced-form parameters, and characterize the asymptotic behavior of the posterior model probabilities. The method provides a formal framework for conducting sensitivity analysis of empirical findings to the choice of identifying assumptions. In a standard monetary model, for example, we show that, in order to support a negative response of output to a contractionary monetary policy shock, one would need to attach a prior probability greater than 0.32 to the validity of the assumption that prices do not react contemporaneously to such a shock. The method is general and allows for dogmatic and non-dogmatic identifying assumptions, multiple point-identified models, multiple set-identified models, and nested or non-nested models.

Suggested Citation

  • Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers 18/17, Institute for Fiscal Studies.
  • Handle: RePEc:azt:cemmap:18/17
    DOI: 10.1920/wp.cem.2017.1817
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP1817.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1920/wp.cem.2017.1817?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    2. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    3. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    4. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    5. Patrick Bajari & Han Hong & Stephen P. Ryan, 2010. "Identification and Estimation of a Discrete Game of Complete Information," Econometrica, Econometric Society, vol. 78(5), pages 1529-1568, September.
    6. Faust, Jon, 1998. "The robustness of identified VAR conclusions about money," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 49(1), pages 207-244, December.
    7. A. Norets & X. Tang, 2014. "Semiparametric Inference in Dynamic Binary Choice Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1229-1262.
    8. Rafiq, M.S. & Mallick, S.K., 2008. "The effect of monetary policy on output in EMU3: A sign restriction approach," Journal of Macroeconomics, Elsevier, vol. 30(4), pages 1756-1791, December.
    9. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    10. S. Boragan Aruoba & Frank Schorfheide, 2011. "Sticky Prices versus Monetary Frictions: An Estimation of Policy Trade-Offs," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 60-90, January.
    11. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    12. Christiano, Lawrence J. & Eichenbaum, Martin & Evans, Charles L., 1999. "Monetary policy shocks: What have we learned and to what end?," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 2, pages 65-148, Elsevier.
    13. Scholl, Almuth & Uhlig, Harald, 2008. "New evidence on the puzzles: Results from agnostic identification on monetary policy and exchange rates," Journal of International Economics, Elsevier, vol. 76(1), pages 1-13, September.
    14. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    15. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    16. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    17. Liao, Yuan & Simoni, Anna, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," MPRA Paper 43262, University Library of Munich, Germany.
    18. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    19. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    20. Lutz Kilian & Daniel P. Murphy, 2012. "Why Agnostic Sign Restrictions Are Not Enough: Understanding The Dynamics Of Oil Market Var Models," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1166-1188, October.
    21. Vargas-Silva, Carlos, 2008. "Monetary policy and the US housing market: A VAR analysis imposing sign restrictions," Journal of Macroeconomics, Elsevier, vol. 30(3), pages 977-990, September.
    22. Gert Peersman & Roland Straub, 2009. "Technology Shocks And Robust Sign Restrictions In A Euro Area Svar," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(3), pages 727-750, August.
    23. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    24. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    25. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    26. Andrew Mountford, 2005. "Leaning into the Wind: A Structural VAR Investigation of UK Monetary Policy," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(5), pages 597-621, October.
    27. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    28. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    29. Canova, Fabio & Nicolo, Gianni De, 2002. "Monetary disturbances matter for business fluctuations in the G-7," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1131-1159, September.
    30. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    31. Reichenstein, William, 1987. "The Impact of Money on Short-term Interest Rates," Economic Inquiry, Western Economic Association International, vol. 25(1), pages 67-82, January.
    32. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    33. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    34. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    35. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    36. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    37. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    38. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    39. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    40. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers CWP18/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2022. "Uncertain identification," Quantitative Economics, Econometric Society, vol. 13(1), pages 95-123, January.
    3. Alessio Volpicella, 2019. "SVARs Identification through Bounds on the Forecast Error Variance," Working Papers 890, Queen Mary University of London, School of Economics and Finance.
    4. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    5. Victor Pontines, 2021. "The real effects of loan-to-value limits: empirical evidence from Korea," Empirical Economics, Springer, vol. 61(3), pages 1311-1350, September.
    6. Renée Fry & Adrian Pagan, 2011. "Sign Restrictions in Structural Vector Autoregressions: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 938-960, December.
    7. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Emanuele Bacchiocchi & Toru Kitagawa, 2020. "Locally- but not globally-identified SVARs," CeMMAP working papers CWP40/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    10. Baumeister, Christiane & Hamilton, James D., 2021. "Reprint: Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 114(C).
    11. Baumeister, Christiane & Hamilton, James D., 2020. "Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 109(C).
    12. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    13. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    14. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    15. Nadav Ben Zeev, 2019. "Is There A Single Shock That Drives The Majority Of Business Cycle Fluctuations?," Working Papers 1906, Ben-Gurion University of the Negev, Department of Economics.
    16. Helene Olsen & Harald Wieslander, 2020. "The Impact of Monetary Policy on Leading Variables for Financial Stability in Norway," Working Papers No 02/2020, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    17. Oladunni, Sunday, 2019. "External Shocks and Business Cycle Fluctuations in Oil-exporting Small Open Economies: The Case of Nigeria," MPRA Paper 98639, University Library of Munich, Germany.
    18. Britta Gehrke & Fang Yao, 2016. "Persistence and volatility of real exchange rates: the role of supply shocks revisited," Reserve Bank of New Zealand Discussion Paper Series DP2016/02, Reserve Bank of New Zealand.
    19. Carlo A. Favero, 2007. "Model Evaluation in Macroeconometrics: from early empirical macroeconomic models to DSGE models," Working Papers 327, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    20. Robin Braun & Ralf Brüggemann, 2017. "Identification of SVAR Models by Combining Sign Restrictions With External Instruments," Working Paper Series of the Department of Economics, University of Konstanz 2017-07, Department of Economics, University of Konstanz.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:18/17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.