IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v34y2010i10p1951-1966.html
   My bibliography  Save this article

Robust hidden Markov LQG problems

Author

Listed:
  • Hansen, Lars Peter
  • Mayer, Ricardo
  • Sargent, Thomas

Abstract

For linear quadratic Gaussian problems, this paper uses two risk-sensitivity operators defined by Hansen and Sargent (2007b) to construct decision rules that are robust to misspecifications of (1) transition dynamics for state variables and (2) a probability density over hidden states induced by Bayes' law. Duality of risk sensitivity to the multiplier version of min-max expected utility theory of Hansen and Sargent (2001) allows us to compute risk-sensitivity operators by solving two-player zero-sum games. Because the approximating model is a Gaussian probability density over sequences of signals and states, we can exploit a modified certainty equivalence principle to solve four games that differ in continuation value functions and discounting of time t increments to entropy. The different games express different dimensions of concerns about robustness. All four games give rise to time consistent worst-case distributions for observed signals. But in Games I-III, the minimizing players' worst-case densities over hidden states are time inconsistent, while Game IV is an LQG version of a game of Hansen and Sargent (2005) that builds in time consistency. We show how detection error probabilities can be used to calibrate the risk-sensitivity parameters that govern fear of model misspecification in hidden Markov models.

Suggested Citation

  • Hansen, Lars Peter & Mayer, Ricardo & Sargent, Thomas, 2010. "Robust hidden Markov LQG problems," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1951-1966, October.
  • Handle: RePEc:eee:dyncon:v:34:y:2010:i:10:p:1951-1966
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165-1889(10)00104-1
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lars Peter Hansen & Thomas J Sargent, 2014. "Robust Control and Model Uncertainty," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 5, pages 145-154, World Scientific Publishing Co. Pte. Ltd..
    2. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    3. Cerreia-Vioglio, S. & Maccheroni, F. & Marinacci, M. & Montrucchio, L., 2011. "Uncertainty averse preferences," Journal of Economic Theory, Elsevier, vol. 146(4), pages 1275-1330, July.
    4. Lars Ljungqvist & Thomas J. Sargent, 2004. "Recursive Macroeconomic Theory, 2nd Edition," MIT Press Books, The MIT Press, edition 2, volume 1, number 026212274x, December.
    5. Christopher A. Sims & Tao Zha, 2006. "Were There Regime Switches in U.S. Monetary Policy?," American Economic Review, American Economic Association, vol. 96(1), pages 54-81, March.
    6. Lars E.O. Svensson & Noah Williams, 2009. "Optimal Monetary Policy under Uncertainty in DSGE Models: A Markov Jump-Linear-Quadratic Approach," Central Banking, Analysis, and Economic Policies Book Series, in: Klaus Schmidt-Hebbel & Carl E. Walsh & Norman Loayza (Series Editor) & Klaus Schmidt-Hebbel (Series (ed.),Monetary Policy under Uncertainty and Learning, edition 1, volume 13, chapter 3, pages 077-114, Central Bank of Chile.
    7. Larry G. Epstein & Martin Schneider, 2007. "Learning Under Ambiguity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1275-1303.
    8. Epstein, Larry G. & Schneider, Martin, 2003. "Recursive multiple-priors," Journal of Economic Theory, Elsevier, vol. 113(1), pages 1-31, November.
    9. Kasa, Kenneth, 2001. "A robust Hansen-Sargent prediction formula," Economics Letters, Elsevier, vol. 71(1), pages 43-48, April.
    10. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    11. Hansen, Lars Peter & Sargent, Thomas J., 2007. "Recursive robust estimation and control without commitment," Journal of Economic Theory, Elsevier, vol. 136(1), pages 1-27, September.
    12. Kasa, Kenneth, 2002. "Model Uncertainty, Robust Policies, And The Value Of Commitment," Macroeconomic Dynamics, Cambridge University Press, vol. 6(1), pages 145-166, February.
    13. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    14. Timothy Cogley & Riccardo Colacito & Lars Peter Hansen & Thomas J. Sargent, 2008. "Robustness and U.S. Monetary Policy Experimentation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1599-1623, December.
    15. Hansen, Lars Peter & Sargent, Thomas J. & Wang, Neng E., 2002. "Robust Permanent Income And Pricing With Filtering," Macroeconomic Dynamics, Cambridge University Press, vol. 6(1), pages 40-84, February.
    16. Hansen, Lars Peter & Sargent, Thomas J., 2005. "Robust estimation and control under commitment," Journal of Economic Theory, Elsevier, vol. 124(2), pages 258-301, October.
    17. Lars Peter Hansen & Thomas J Sargent, 2014. "A Quartet of Semigroups for Model Specification, Robustness, Prices of Risk, and Model Detection," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 4, pages 83-143, World Scientific Publishing Co. Pte. Ltd..
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luo, Yulei & Nie, Jun & Young, Eric R., 2014. "Robust control, informational frictions, and international consumption correlations," European Economic Review, Elsevier, vol. 67(C), pages 1-27.
    2. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    3. Vladimir Dombrovskii & Tatyana Obyedko, 2014. "Dynamic Investment Portfolio Optimization under Constraints in the Financial Market with Regime Switching using Model Predictive Control," Papers 1410.1136, arXiv.org.
    4. Lee, Sang Seok & Luk, Paul, 2018. "The Asian Financial Crisis and international reserve accumulation: A robust control approach," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 284-309.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nengjiu Ju & Jianjun Miao, 2012. "Ambiguity, Learning, and Asset Returns," Econometrica, Econometric Society, vol. 80(2), pages 559-591, March.
    2. Karantounias, Anastasios G., 2023. "Doubts about the model and optimal policy," Journal of Economic Theory, Elsevier, vol. 210(C).
    3. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    4. Hansen, Lars Peter & Sargent, Thomas J., 2011. "Robustness and ambiguity in continuous time," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1195-1223, May.
    5. Cogley, Timothy & Sargent, Thomas J., 2008. "The market price of risk and the equity premium: A legacy of the Great Depression?," Journal of Monetary Economics, Elsevier, vol. 55(3), pages 454-476, April.
    6. Li, Jing, 2018. "Essays on model uncertainty in financial models," Other publications TiSEM 202cd910-7ef1-4db4-94ae-d, Tilburg University, School of Economics and Management.
    7. Dennis, Richard, 2014. "Imperfect credibility and robust monetary policy," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 218-234.
    8. Lars Peter Hansen & Thomas J Sargent, 2014. "Doubts or Variability?," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 7, pages 217-256, World Scientific Publishing Co. Pte. Ltd..
    9. Massimo Guidolin & Francesca Rinaldi, 2013. "Ambiguity in asset pricing and portfolio choice: a review of the literature," Theory and Decision, Springer, vol. 74(2), pages 183-217, February.
    10. Zhao, Guihai, 2017. "Confidence, bond risks, and equity returns," Journal of Financial Economics, Elsevier, vol. 126(3), pages 668-688.
    11. Larry G. Epstein & Martin Schneider, 2010. "Ambiguity and Asset Markets," Annual Review of Financial Economics, Annual Reviews, vol. 2(1), pages 315-346, December.
    12. Liu, Hening, 2011. "Dynamic portfolio choice under ambiguity and regime switching mean returns," Journal of Economic Dynamics and Control, Elsevier, vol. 35(4), pages 623-640, April.
    13. Hui Chen & Nengjiu Ju & Jianjun Miao, 2014. "Dynamic Asset Allocation with Ambiguous Return Predictability," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 17(4), pages 799-823, October.
    14. Szőke, Bálint, 2022. "Estimating robustness," Journal of Economic Theory, Elsevier, vol. 199(C).
    15. Agliardi, Elettra & Xepapadeas, Anastasios, 2022. "Temperature targets, deep uncertainty and extreme events in the design of optimal climate policy," Journal of Economic Dynamics and Control, Elsevier, vol. 139(C).
    16. Chahrour, Ryan & Svec, Justin, 2014. "Optimal capital taxation and consumer uncertainty," Journal of Macroeconomics, Elsevier, vol. 41(C), pages 178-198.
    17. Beber, Alessandro & Breedon, Francis & Buraschi, Andrea, 2010. "Differences in beliefs and currency risk premiums," Journal of Financial Economics, Elsevier, vol. 98(3), pages 415-438, December.
    18. Saghafian, Soroush, 2018. "Ambiguous partially observable Markov decision processes: Structural results and applications," Journal of Economic Theory, Elsevier, vol. 178(C), pages 1-35.
    19. Yulei Luo & Jun Nie & Eric Young, 2015. "Robust permanent income in general equilibrium," Research Working Paper RWP 15-14, Federal Reserve Bank of Kansas City.
    20. Jianjun Miao, 2022. "Introduction to the special issue in honor of Larry Epstein," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 74(2), pages 329-333, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:34:y:2010:i:10:p:1951-1966. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.