IDEAS home Printed from https://ideas.repec.org/p/use/tkiwps/0820.html
   My bibliography  Save this paper

Learning About Learning in Dynamic Economic Models

Author

Listed:
  • D.A. Kendrick
  • H.M. Amman
  • M.P. Tucci

Abstract

This chapter of the Handbook of Computational Economics is mostly about research on active learning and is confined to discussion of learning in dynamic models in which the systems equations are linear, the criterion function is quadratic and the additive noise terms are Gaussian. Though there is much work on learning in more general systems, it is useful here to focus on models with these specifications since more general systems can be approximated in this way and since much of the early work on learning has been done with these quadraticlinear-gaussian systems. We begin with what has been learned about learning in dynamic economic models in the last few decades. Then we progress to a discussion of what we hope to learn in the future from a new project that is just getting underway. However before doing either of these it is useful to provide a short description of the mathematical framework that will be used in the chapter.

Suggested Citation

  • D.A. Kendrick & H.M. Amman & M.P. Tucci, 2008. "Learning About Learning in Dynamic Economic Models," Working Papers 08-20, Utrecht School of Economics.
  • Handle: RePEc:use:tkiwps:0820
    as

    Download full text from publisher

    File URL: https://dspace.library.uu.nl/bitstream/handle/1874/309733/08_20.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tucci, Marco P., 2002. "A note on global optimization in adaptive control, econometrics and macroeconomics," Journal of Economic Dynamics and Control, Elsevier, vol. 26(9-10), pages 1739-1764, August.
    2. Philippe Aghion & Patrick Bolton & Christopher Harris & Bruno Jullien, 1991. "Optimal Learning by Experimentation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(4), pages 621-654.
    3. Kendrick, David, 2000. "Control theory with applications to economics," Handbook of Mathematical Economics, in: K. J. Arrow & M.D. Intriligator (ed.), Handbook of Mathematical Economics, edition 4, volume 1, chapter 4, pages 111-158, Elsevier.
    4. Mizrach, Bruce, 1991. "Nonconvexities in a stochastic control problem with learning," Journal of Economic Dynamics and Control, Elsevier, vol. 15(3), pages 515-538, July.
    5. David Kendrick, 1976. "Applications of Control Theory to Macroeconomics," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 2, pages 171-190, National Bureau of Economic Research, Inc.
    6. Fair, Ray C & Taylor, John B, 1983. "Solution and Maximum Likelihood Estimation of Dynamic Nonlinear Rational Expectations Models," Econometrica, Econometric Society, vol. 51(4), pages 1169-1185, July.
    7. Tucci, Marco P. & Kendrick, David A. & Amman, Hans M., 2010. "The parameter set in an adaptive control Monte Carlo experiment: Some considerations," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1531-1549, September.
    8. Alfred L. Norman, 1976. "First Order Dual Control," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 3, pages 311-321, National Bureau of Economic Research, Inc.
    9. Kiefer, Nicholas M., 1989. "A value function arising in the economics of information," Journal of Economic Dynamics and Control, Elsevier, vol. 13(2), pages 201-223, April.
    10. Amman, Hans M & Kendrick, David A, 1999. "Should Macroeconomic Policy Makers Consider Parameter Covariances?," Computational Economics, Springer;Society for Computational Economics, vol. 14(3), pages 263-267, December.
    11. Mewael F. Tesfaselassie & Eric Schaling & Sylvester Eijffinger, 2011. "Learning about the Term Structure and Optimal Rules for Inflation Targeting," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(8), pages 1685-1706, December.
    12. Amman, Hans M. & Kendrick, David A., 2003. "Mitigation of the Lucas critique with stochastic control methods," Journal of Economic Dynamics and Control, Elsevier, vol. 27(11), pages 2035-2057.
    13. Marco Tucci & David Kendrick & Hans Amman, 2013. "Expected Optimal Feedback with Time-Varying Parameters," Computational Economics, Springer;Society for Computational Economics, vol. 42(3), pages 351-371, October.
    14. Wieland, Volker, 2000. "Learning by doing and the value of optimal experimentation," Journal of Economic Dynamics and Control, Elsevier, vol. 24(4), pages 501-534, April.
    15. Amman, Hans, 1996. "Numerical methods for linear-quadratic models," Handbook of Computational Economics, in: H. M. Amman & D. A. Kendrick & J. Rust (ed.), Handbook of Computational Economics, edition 1, volume 1, chapter 13, pages 587-618, Elsevier.
    16. Hans M. Amman & David A. Kendrick, 1996. "The DUALI/DUALPC Software for Optimal Control Models: Introduction," CARE Working Papers 9602, The University of Texas at Austin, Center for Applied Research in Economics.
    17. Beck, Gunter W. & Wieland, Volker, 2002. "Learning and control in a changing economic environment," Journal of Economic Dynamics and Control, Elsevier, vol. 26(9-10), pages 1359-1377, August.
    18. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    19. David Kendrick & Hans Amman, 2006. "A Classification System for Economic Stochastic Control Models," Computational Economics, Springer;Society for Computational Economics, vol. 27(4), pages 453-481, June.
    20. Amman, Hans & Kendrick, David, 1999. "Linear-Quadratic Optimization For Models With Rational Expectations," Macroeconomic Dynamics, Cambridge University Press, vol. 3(4), pages 534-543, December.
    21. Anderson, Gary & Moore, George, 1985. "A linear algebraic procedure for solving linear perfect foresight models," Economics Letters, Elsevier, vol. 17(3), pages 247-252.
    22. Amman, Hans M. & Kendrick, David A., 1997. "Active learning: A correction," Journal of Economic Dynamics and Control, Elsevier, vol. 21(10), pages 1613-1614, August.
    23. Tucci, Marco P, 1998. "The Nonconvexities Problem in Adaptive Control Models: A Simple Computational Solution," Computational Economics, Springer;Society for Computational Economics, vol. 12(3), pages 203-222, December.
    24. MacRae, Elizabeth Chase, 1975. "An Adaptive Learning Rule for Multiperiod Decision Problems," Econometrica, Econometric Society, vol. 43(5-6), pages 893-906, Sept.-Nov.
    25. Elizabeth Chase MacRae, 1972. "Linear Decision with Experimentation," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 4, pages 437-447, National Bureau of Economic Research, Inc.
    26. Tucci, Marco P., 1997. "Adaptive control in the presence of time-varying parameters," Journal of Economic Dynamics and Control, Elsevier, vol. 22(1), pages 39-47, November.
    27. Amman, Hans M & Kendrick, David A, 1995. "Nonconvexities in Stochastic Control Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 36(2), pages 455-475, May.
    28. Alfred L. Norman & M. R. Norman & Carl Palash, 1979. "Multiple relative maxima in optimal macroeconomic policy: an illustration," Special Studies Papers 134, Board of Governors of the Federal Reserve System (U.S.).
    29. Catherina J. Schenck & Kotie J. M. M. Viljoen & Phillip F. Blaauw, 2016. "Sometimes you don’t make enough money to buy food: An analysis of South African street waste pickers income," Working Papers 62, Economic Research Southern Africa.
    30. Prescott, Edward C, 1972. "The Multi-Period Control Problem Under Uncertainty," Econometrica, Econometric Society, vol. 40(6), pages 1043-1058, November.
    31. Kiefer, Nicholas M & Nyarko, Yaw, 1989. "Optimal Control of an Unknown Linear Process with Learning," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(3), pages 571-586, August.
    32. David A. Kendrick & Marco P. Tucci & Hans M. Amman, 2008. "Duali: Software for Solving Stochastic Control Problems in Economics," Springer Books, in: Erricos J. Kontoghiorghes & Berç Rustem & Peter Winker (ed.), Computational Methods in Financial Engineering, pages 393-419, Springer.
    33. Kendrick, David A., 2005. "Stochastic control for economic models: past, present and the paths ahead," Journal of Economic Dynamics and Control, Elsevier, vol. 29(1-2), pages 3-30, January.
    34. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    35. Gunter Coenen, Volker Wieland, Andrew Levin, 2001. "Evaluating Information Variables for Monetary Policy in a Noisy Economic Environment," Computing in Economics and Finance 2001 131, Society for Computational Economics.
    36. Fisher, P. G. & Holly, S. & Hughes Hallett, A. J., 1986. "Efficient solution techniques for dynamic non-linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 10(1-2), pages 139-145, June.
    37. Amman, Hans M. & Kendrick, David A., 1994. "Active learning Monte Carlo results," Journal of Economic Dynamics and Control, Elsevier, vol. 18(1), pages 119-124, January.
    38. Taylor, John B, 1974. "Asymptotic Properties of Multiperiod Control Rules in the Linear Regression Model," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 15(2), pages 472-484, June.
    39. Thomas F. Cosimano, 2003. "Optimal Experimentation and the Perturbation Method," Computing in Economics and Finance 2003 71, Society for Computational Economics.
    40. Hans M. Amman & David A. Kendrick, . "Computational Economics," Online economics textbooks, SUNY-Oswego, Department of Economics, number comp1.
    41. Pindyck, Robert S, 1973. "Optimal Policies for Economic Stabilization," Econometrica, Econometric Society, vol. 41(3), pages 529-560, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tim Willems, 2017. "Actively Learning by Pricing: A Model of an Experimenting Seller," Economic Journal, Royal Economic Society, vol. 127(604), pages 2216-2239, September.
    2. H.M. Amman & D.A. Kendrick, 2012. "Conjectures on the policy function in the presence of optimal experimentation," Working Papers 12-09, Utrecht School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:use:tkiwps:2020 is not listed on IDEAS
    2. Kendrick, David A., 2005. "Stochastic control for economic models: past, present and the paths ahead," Journal of Economic Dynamics and Control, Elsevier, vol. 29(1-2), pages 3-30, January.
    3. David Kendrick & Hans Amman, 2006. "A Classification System for Economic Stochastic Control Models," Computational Economics, Springer;Society for Computational Economics, vol. 27(4), pages 453-481, June.
    4. H.M. Amman & D.A. Kendrick, 2012. "Conjectures on the policy function in the presence of optimal experimentation," Working Papers 12-09, Utrecht School of Economics.
    5. Amman, Hans M. & Kendrick, David A. & Tucci, Marco P., 2020. "Approximating The Value Function For Optimal Experimentation," Macroeconomic Dynamics, Cambridge University Press, vol. 24(5), pages 1073-1086, July.
    6. Hans Amman & David Kendrick, 2014. "Comparison of policy functions from the optimal learning and adaptive control frameworks," Computational Management Science, Springer, vol. 11(3), pages 221-235, July.
    7. Hans M. Amman & Marco Paolo Tucci, 2018. "How active is active learning: value function method vs an approximation method," Department of Economics University of Siena 788, Department of Economics, University of Siena.
    8. Wieland, Volker, 2000. "Learning by doing and the value of optimal experimentation," Journal of Economic Dynamics and Control, Elsevier, vol. 24(4), pages 501-534, April.
    9. Hans M. Amman & Marco P. Tucci, 2020. "How Active is Active Learning: Value Function Method Versus an Approximation Method," Computational Economics, Springer;Society for Computational Economics, vol. 56(3), pages 675-693, October.
    10. Tucci, Marco P. & Kendrick, David A. & Amman, Hans M., 2010. "The parameter set in an adaptive control Monte Carlo experiment: Some considerations," Journal of Economic Dynamics and Control, Elsevier, vol. 34(9), pages 1531-1549, September.
    11. Beck, Gunter W. & Wieland, Volker, 2002. "Learning and control in a changing economic environment," Journal of Economic Dynamics and Control, Elsevier, vol. 26(9-10), pages 1359-1377, August.
    12. Tim Willems, 2017. "Actively Learning by Pricing: A Model of an Experimenting Seller," Economic Journal, Royal Economic Society, vol. 127(604), pages 2216-2239, September.
    13. Cosimano, Thomas F., 2008. "Optimal experimentation and the perturbation method in the neighborhood of the augmented linear regulator problem," Journal of Economic Dynamics and Control, Elsevier, vol. 32(6), pages 1857-1894, June.
    14. Peter John Robinson & W.J.W. Botzen & F. Zhou, 2019. "An experimental study of charity hazard: The effect of risky and ambiguous government compensation on flood insurance demand," Working Papers 19-19, Utrecht School of Economics.
    15. Volker Wieland, "undated". "Monetary Policy and Uncertainty about the Natural Unemployment Rate," Computing in Economics and Finance 1997 11, Society for Computational Economics.
    16. Bond, Craig A., 2008. "On the Potential Use of Adaptive Control Methods for Improving Adaptive Natural Resource Management," Working Papers 108721, Colorado State University, Department of Agricultural and Resource Economics.
    17. In Chang Hwang, 2016. "Active learning and optimal climate policy," EcoMod2016 9611, EcoMod.
    18. Wieland, Volker, 2000. "Monetary policy, parameter uncertainty and optimal learning," Journal of Monetary Economics, Elsevier, vol. 46(1), pages 199-228, August.
    19. Stephen J. Turnovsky, 2011. "Stabilization Theory and Policy: 50 Years after the Phillips Curve," Economica, London School of Economics and Political Science, vol. 78(309), pages 67-88, January.
    20. Amman, Hans & Kendrick, David, 1999. "Linear-Quadratic Optimization For Models With Rational Expectations," Macroeconomic Dynamics, Cambridge University Press, vol. 3(4), pages 534-543, December.
    21. Amman, Hans M. & Kendrick, David A., 1998. "Computing the steady state of linear quadratic optimization models with rational expectations," Economics Letters, Elsevier, vol. 58(2), pages 185-191, February.

    More about this item

    Keywords

    Active learning; dual control; optimal experimentation; stochastic optimization; time-varying parameters; forward looking variables; numerical experiments;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:use:tkiwps:0820. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marina Muilwijk (email available below). General contact details of provider: https://edirc.repec.org/data/eiruunl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.