IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/18-17.html
   My bibliography  Save this paper

Uncertain identification

Author

Listed:
  • Raffaella Giacomini

    (Institute for Fiscal Studies and University College London)

  • Toru Kitagawa

    (Institute for Fiscal Studies and University College London)

  • Alessio Volpicella

    (Institute for Fiscal Studies and Queen Mary University of London)

Abstract

Uncertainty about the choice of identifying assumptions is common in causal studies, but is often ignored in empirical practice. This paper considers uncertainty over models that impose different identifying assumptions, which, in general, leads to a mix of point- and set-identified models. We propose performing inference in the presence of such uncertainty by generalizing Bayesian model averaging. The method considers multiple posteriors for the set-identified models and combines them with a single posterior for models that are either point-identified or that impose non-dogmatic assumptions. The output is a set of posteriors (post-averaging ambiguous belief) that are mixtures of the single posterior and any element of the class of multiple posteriors, with weights equal to the posterior model probabilities. We suggest reporting the range of posterior means and the associated credible region in practice, and provide a simple algorithm to compute them. We establish that the prior model probabilities are updated when the models are "distinguishable" and/or they specify different priors for reduced-form parameters, and characterize the asymptotic behavior of the posterior model probabilities. The method provides a formal framework for conducting sensitivity analysis of empirical findings to the choice of identifying assumptions. In a standard monetary model, for example, we show that, in order to support a negative response of output to a contractionary monetary policy shock, one would need to attach a prior probability greater than 0.32 to the validity of the assumption that prices do not react contemporaneously to such a shock. The method is general and allows for dogmatic and non-dogmatic identifying assumptions, multiple point-identified models, multiple set-identified models, and nested or non-nested models.

Suggested Citation

  • Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers CWP18/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:18/17
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/cemmap/wps/CWP181717.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    2. Andrew Mountford, 2005. "Leaning into the Wind: A Structural VAR Investigation of UK Monetary Policy," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(5), pages 597-621, October.
    3. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    4. Patrick Bajari & Han Hong & Stephen P. Ryan, 2010. "Identification and Estimation of a Discrete Game of Complete Information," Econometrica, Econometric Society, vol. 78(5), pages 1529-1568, September.
    5. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    6. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    7. Gert Peersman & Roland Straub, 2009. "Technology Shocks And Robust Sign Restrictions In A Euro Area Svar," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(3), pages 727-750, August.
    8. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    9. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    10. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    11. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    12. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    13. Shigeru Fujita, 2011. "Dynamics of worker flows and vacancies: evidence from the sign restriction approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 89-121, January/F.
    14. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    15. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    16. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    17. Liao, Yuan & Simoni, Anna, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," MPRA Paper 43262, University Library of Munich, Germany.
    18. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    19. Rafiq, M.S. & Mallick, S.K., 2008. "The effect of monetary policy on output in EMU3: A sign restriction approach," Journal of Macroeconomics, Elsevier, vol. 30(4), pages 1756-1791, December.
    20. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    21. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    22. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    23. Dimitris Korobilis, 2020. "Sign restrictions in high-dimensional vector autoregressions," Working Papers 2020_21, Business School - Economics, University of Glasgow.
    24. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    25. A. Norets & X. Tang, 2014. "Semiparametric Inference in Dynamic Binary Choice Models," Review of Economic Studies, Oxford University Press, vol. 81(3), pages 1229-1262.
    26. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    27. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    28. Scholl, Almuth & Uhlig, Harald, 2008. "New evidence on the puzzles: Results from agnostic identification on monetary policy and exchange rates," Journal of International Economics, Elsevier, vol. 76(1), pages 1-13, September.
    29. Toru Kitagawa, 2020. "The Identification Region of the Potential Outcome Distributions under Instrument Independence," CeMMAP working papers CWP23/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    30. Lutz Kilian & Daniel P. Murphy, 2012. "Why Agnostic Sign Restrictions Are Not Enough: Understanding The Dynamics Of Oil Market Var Models," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1166-1188, October.
    31. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    32. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    33. S. Boragan Aruoba & Frank Schorfheide, 2011. "Sticky Prices versus Monetary Frictions: An Estimation of Policy Trade-Offs," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 60-90, January.
    34. Francesco Furlanetto & Francesco Ravazzolo & Samad Sarferaz, 2019. "Identification of Financial Factors in Economic Fluctuations," The Economic Journal, Royal Economic Society, vol. 129(617), pages 311-337.
    35. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    36. Nigar Hashimzade & Michael A. Thornton (ed.), 2013. "Handbook of Research Methods and Applications in Empirical Macroeconomics," Books, Edward Elgar Publishing, number 14327.
    37. Blanchard, Olivier Jean & Quah, Danny, 1993. "The Dynamic Effects of Aggregate Demand and Supply Disturbances: Reply," American Economic Review, American Economic Association, vol. 83(3), pages 653-658, June.
    38. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    39. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    40. Canova, Fabio & Nicolo, Gianni De, 2002. "Monetary disturbances matter for business fluctuations in the G-7," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1131-1159, September.
    41. Faust, Jon, 1998. "The robustness of identified VAR conclusions about money," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 49(1), pages 207-244, December.
    42. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    43. Vargas-Silva, Carlos, 2008. "Monetary policy and the US housing market: A VAR analysis imposing sign restrictions," Journal of Macroeconomics, Elsevier, vol. 30(3), pages 977-990, September.
    44. Antolín-Díaz, Juan & Petrella, Ivan & Rubio-Ramírez, Juan F., 2021. "Structural scenario analysis with SVARs," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 798-815.
    45. Reichenstein, William, 1987. "The Impact of Money on Short-term Interest Rates," Economic Inquiry, Western Economic Association International, vol. 25(1), pages 67-82, January.
    46. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    47. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    48. Christian Matthes & Felipe Schwartzman, 2019. "What Do Sectoral Dynamics Tell Us About the Origins of Business Cycles?," Working Paper 19-9, Federal Reserve Bank of Richmond.
    49. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    50. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    51. repec:hrv:faseco:30780157 is not listed on IDEAS
    52. Andriy Norets & Xun Tang, 2010. "Semiparametric Inference in Dynamic Binary Choice Models, Second Version," PIER Working Paper Archive 12-017, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 17 Apr 2012.
    53. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    54. Gafarov, Bulat & Meier, Matthias & Montiel Olea, José Luis, 2018. "Delta-method inference for a class of set-identified SVARs," Journal of Econometrics, Elsevier, vol. 203(2), pages 316-327.
    55. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2022. "Uncertain identification," Quantitative Economics, Econometric Society, vol. 13(1), pages 95-123, January.
    2. Francesca Molinari, 2020. "Microeconometrics with Partial Identification," Papers 2004.11751, arXiv.org.
    3. Alessio Volpicella, 2019. "SVARs Identification through Bounds on the Forecast Error Variance," Working Papers 890, Queen Mary University of London, School of Economics and Finance.
    4. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    5. Renée Fry & Adrian Pagan, 2011. "Sign Restrictions in Structural Vector Autoregressions: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 938-960, December.
    6. Emanuele Bacchiocchi & Toru Kitagawa, 2020. "Locally- but not globally-identified SVARs," CeMMAP working papers CWP40/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. Victor Pontines, 0. "The real effects of loan-to-value limits: empirical evidence from Korea," Empirical Economics, Springer, vol. 0, pages 1-40.
    8. Victor Pontines, 2021. "The real effects of loan-to-value limits: empirical evidence from Korea," Empirical Economics, Springer, vol. 61(3), pages 1311-1350, September.
    9. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    10. Inoue, Atsushi & Kilian, Lutz, 2013. "Inference on impulse response functions in structural VAR models," Journal of Econometrics, Elsevier, vol. 177(1), pages 1-13.
    11. Lutz Kilian, 2013. "Structural vector autoregressions," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 22, pages 515-554, Edward Elgar Publishing.
    12. Baumeister, Christiane & Hamilton, James D., 2021. "Reprint: Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 114(C).
    13. Baumeister, Christiane & Hamilton, James D., 2020. "Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 109(C).
    14. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    15. Helmut Lütkepohl & Aleksei NetŠunajev, 2014. "Disentangling Demand And Supply Shocks In The Crude Oil Market: How To Check Sign Restrictions In Structural Vars," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(3), pages 479-496, April.
    16. Giacomini, Raffaella & Kitagawa, Toru, 2014. "Inference about Non-Identified SVARs," CEPR Discussion Papers 10287, C.E.P.R. Discussion Papers.
    17. Herwartz, Helmut & Plödt, Martin, 2014. "Sign restrictions and statistical identification under volatility breaks -- Simulation based evidence and an empirical application to monetary policy analysis," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100326, Verein für Socialpolitik / German Economic Association.
    18. Ivan A. Canay & Azeem M. Shaikh, 2016. "Practical and theoretical advances in inference for partially identified models," CeMMAP working papers CWP05/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Baumeister, Christiane & Hamilton, James D., 2018. "Inference in structural vector autoregressions when the identifying assumptions are not fully believed: Re-evaluating the role of monetary policy in economic fluctuations," Journal of Monetary Economics, Elsevier, vol. 100(C), pages 48-65.
    20. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.

    More about this item

    Keywords

    Partial Identification; Sensitivity Analysis; Model Averaging; Bayesian Robustness; Ambiguity.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:18/17. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.