IDEAS home Printed from https://ideas.repec.org/p/cam/camdae/1667.html
   My bibliography  Save this paper

Experimentation and Learning-by-Doing

Author

Listed:
  • Safronov, M.

Abstract

I consider a multi-armed bandit problem, where by experimenting with any arm an agent not only learns its payoffs, but also due to learning-by-doing becomes experienced at that arm. Experience provides an additional payoffs to the agent. I study the interaction between the processes of experimentation, and learning-by-doing. The presence of learning-by-doing always reduces the agent's willingness to experiment, regardless of whether the agent is actually experienced at the arm she is currently pulling. Moreover, this effect is nonmonotone in the arrival rate of experience, and reaches maximum at intermediate arrival rates. The arms with extreme arrival rate of experience yield the highest payoff to the agent, making her pulling those arms first. This non-monotonicity result is extended to the case of collective experimentation with two agents, where equilibrium payoffs of the agents reach maximum at extreme arrival rates of experience. If the agent obtains experience by learning certain 'skills' at the arm, then the presence of experimentation effects which skills the agent learns first. If the process of learning-by-doing is deterministic, the agent learns the easier skills first; if the process is stochastic and memoryless, the agent learns the harder skills first.

Suggested Citation

  • Safronov, M., 2016. "Experimentation and Learning-by-Doing," Cambridge Working Papers in Economics 1667, Faculty of Economics, University of Cambridge.
  • Handle: RePEc:cam:camdae:1667
    as

    Download full text from publisher

    File URL: http://www.econ.cam.ac.uk/research-files/repec/cam/pdf/cwpe1666.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Diamond, Douglas W, 1991. "Monitoring and Reputation: The Choice between Bank Loans and Directly Placed Debt," Journal of Political Economy, University of Chicago Press, vol. 99(4), pages 689-721, August.
    2. Bernanke, Ben S. & Gertler, Mark & Gilchrist, Simon, 1999. "The financial accelerator in a quantitative business cycle framework," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 21, pages 1341-1393, Elsevier.
    3. Lown, Cara & Morgan, Donald P., 2006. "The Credit Cycle and the Business Cycle: New Findings Using the Loan Officer Opinion Survey," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(6), pages 1575-1597, September.
    4. Fiorella De Fiore & Harald Uhlig, 2015. "Corporate Debt Structure and the Financial Crisis," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(8), pages 1571-1598, December.
    5. Altinkilic, Oya & Hansen, Robert S, 2000. "Are There Economies of Scale in Underwriting Fees? Evidence of Rising External Financing Costs," Review of Financial Studies, Society for Financial Studies, vol. 13(1), pages 191-218.
    6. Francisco Covas & Wouter J. Den Haan, 2012. "The Role of Debt and Equity Finance Over the Business Cycle," Economic Journal, Royal Economic Society, vol. 122(565), pages 1262-1286, December.
    7. Kashyap, Anil K & Stein, Jeremy C & Wilcox, David W, 1993. "Monetary Policy and Credit Conditions: Evidence from the Composition of External Finance," American Economic Review, American Economic Association, vol. 83(1), pages 78-98, March.
    8. Aubhik Khan & Julia K. Thomas, 2013. "Credit Shocks and Aggregate Fluctuations in an Economy with Production Heterogeneity," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1055-1107.
    9. Kiyotaki, Nobuhiro & Moore, John, 1997. "Credit Cycles," Journal of Political Economy, University of Chicago Press, vol. 105(2), pages 211-248, April.
    10. Berlin, Mitchell & Mester, Loretta J., 1992. "Debt covenants and renegotiation," Journal of Financial Intermediation, Elsevier, vol. 2(2), pages 95-133, June.
    11. R?diger Bachmann & Ricardo J. Caballero & Eduardo M. R. A. Engel, 2013. "Aggregate Implications of Lumpy Investment: New Evidence and a DSGE Model," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(4), pages 29-67, October.
    12. Antonio Falato & Dalida Kadyrzhanova & Jae W. Sim, 2013. "Rising intangible capital, shrinking debt capacity, and the US corporate savings glut," Finance and Economics Discussion Series 2013-67, Board of Governors of the Federal Reserve System (U.S.).
    13. Christopher A. Hennessy & Toni M. Whited, 2007. "How Costly Is External Financing? Evidence from a Structural Estimation," Journal of Finance, American Finance Association, vol. 62(4), pages 1705-1745, August.
    14. Thomas Philippon, 2015. "Has the US Finance Industry Become Less Efficient? On the Theory and Measurement of Financial Intermediation," American Economic Review, American Economic Association, vol. 105(4), pages 1408-1438, April.
    15. Timothy Dunne & Mark J. Roberts & Larry Samuelson, 1988. "Patterns of Firm Entry and Exit in U.S. Manufacturing Industries," RAND Journal of Economics, The RAND Corporation, vol. 19(4), pages 495-515, Winter.
    16. Thomas W. Bates & Kathleen M. Kahle & René M. Stulz, 2009. "Why Do U.S. Firms Hold So Much More Cash than They Used To?," Journal of Finance, American Finance Association, vol. 64(5), pages 1985-2021, October.
    17. Leigh A. Riddick & Toni M. Whited, 2009. "The Corporate Propensity to Save," Journal of Finance, American Finance Association, vol. 64(4), pages 1729-1766, August.
    18. Jae Sim & Egon Zakrajsek & Simon Gilchrist, 2010. "Uncertainty, Financial Frictions, and Investment Dynamics," 2010 Meeting Papers 1285, Society for Economic Dynamics.
    19. Andrew B. Abel & Janice C. Eberly, 1996. "Optimal Investment with Costly Reversibility," Review of Economic Studies, Oxford University Press, vol. 63(4), pages 581-593.
    20. Becker, Bo & Ivashina, Victoria, 2014. "Cyclicality of credit supply: Firm level evidence," Journal of Monetary Economics, Elsevier, vol. 62(C), pages 76-93.
    21. Joshua D. Rauh & Amir Sufi, 2010. "Capital Structure and Debt Structure," Review of Financial Studies, Society for Financial Studies, vol. 23(12), pages 4242-4280, December.
    22. Lily Hua Fang, 2005. "Investment Bank Reputation and the Price and Quality of Underwriting Services," Journal of Finance, American Finance Association, vol. 60(6), pages 2729-2761, December.
    23. Cristina Arellano & Yan Bai & Patrick J. Kehoe, 2019. "Financial Frictions and Fluctuations in Volatility," Journal of Political Economy, University of Chicago Press, vol. 127(5), pages 2049-2103.
    24. Tobias Adrian & Paolo Colla & Hyun Song Shin, 2013. "Which Financial Frictions? Parsing the Evidence from the Financial Crisis of 2007 to 2009," NBER Macroeconomics Annual, University of Chicago Press, vol. 27(1), pages 159-214.
    25. Christiano, Lawrence J & Eichenbaum, Martin, 1995. "Liquidity Effects, Monetary Policy, and the Business Cycle," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 27(4), pages 1113-1136, November.
    26. Acharya, Viral V. & Almeida, Heitor & Campello, Murillo, 2007. "Is cash negative debt? A hedging perspective on corporate financial policies," Journal of Financial Intermediation, Elsevier, vol. 16(4), pages 515-554, October.
    27. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    28. Berger, Philip G. & Ofek, Eli & Swary, Itzhak, 1996. "Investor valuation of the abandonment option," Journal of Financial Economics, Elsevier, vol. 42(2), pages 257-287, October.
    29. Aubhik Khan & Julia K. Thomas, 2008. "Idiosyncratic Shocks and the Role of Nonconvexities in Plant and Aggregate Investment Dynamics," Econometrica, Econometric Society, vol. 76(2), pages 395-436, March.
    30. Tauchen, George, 1986. "Finite state markov-chain approximations to univariate and vector autoregressions," Economics Letters, Elsevier, vol. 20(2), pages 177-181.
    31. Anil K Kashyap & Owen A. Lamont & Jeremy C. Stein, 1994. "Credit Conditions and the Cyclical Behavior of Inventories," The Quarterly Journal of Economics, Oxford University Press, vol. 109(3), pages 565-592.
    32. Blundell, Richard & Bond, Stephen, 1998. "Initial conditions and moment restrictions in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 87(1), pages 115-143, August.
    33. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    34. Opler, Tim & Pinkowitz, Lee & Stulz, Rene & Williamson, Rohan, 1999. "The determinants and implications of corporate cash holdings," Journal of Financial Economics, Elsevier, vol. 52(1), pages 3-46, April.
    35. Fiorella De Fiore & Harald Uhlig, 2011. "Bank Finance versus Bond Finance," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(7), pages 1399-1421, October.
    36. Roberto Motto & Massimo Rostagno & Lawrence J. Christiano, 2010. "Financial Factors in Economic Fluctuations," 2010 Meeting Papers 141, Society for Economic Dynamics.
    37. Bolton, Patrick & Scharfstein, David S, 1996. "Optimal Debt Structure and the Number of Creditors," Journal of Political Economy, University of Chicago Press, vol. 104(1), pages 1-25, February.
    38. Fischer, Edwin O & Heinkel, Robert & Zechner, Josef, 1989. " Dynamic Capital Structure Choice: Theory and Tests," Journal of Finance, American Finance Association, vol. 44(1), pages 19-40, March.
    39. Besanko, David & Kanatas, George, 1996. "The Regulation of Bank Capital: Do Capital Standards Promote Bank Safety?," Journal of Financial Intermediation, Elsevier, vol. 5(2), pages 160-183, April.
    40. Michael R. Roberts & Amir Sufi, 2009. "Control Rights and Capital Structure: An Empirical Investigation," Journal of Finance, American Finance Association, vol. 64(4), pages 1657-1695, August.
    41. Tobias Adrian & Paolo Colla & Hyun Song Shin, 2012. "Which Financial Frictions? Parsing the Evidence from the Financial Crisis of 2007-9," NBER Working Papers 18335, National Bureau of Economic Research, Inc.
    42. Per Krusell & Anthony A. Smith & Jr., 1998. "Income and Wealth Heterogeneity in the Macroeconomy," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 867-896, October.
    43. Bernanke, Ben & Gertler, Mark, 1989. "Agency Costs, Net Worth, and Business Fluctuations," American Economic Review, American Economic Association, vol. 79(1), pages 14-31, March.
    44. Cem Demiroglu & Christopher M. James, 2010. "The Information Content of Bank Loan Covenants," Review of Financial Studies, Society for Financial Studies, vol. 23(10), pages 3700-3737, October.
    45. Patrick Bolton & Olivier Jeanne, 2009. "Structuring and Restructuring Sovereign Debt: The Role of Seniority -super-1," Review of Economic Studies, Oxford University Press, vol. 76(3), pages 879-902.
    46. Fritz Foley, C. & Hartzell, Jay C. & Titman, Sheridan & Twite, Garry, 2007. "Why do firms hold so much cash? A tax-based explanation," Journal of Financial Economics, Elsevier, vol. 86(3), pages 579-607, December.
    47. Tobias Adrian & Hyun Song Shin, 2011. "Financial Intermediary Balance Sheet Management," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 289-307, December.
    48. Gian Luca Clementi & Hugo A. Hopenhayn, 2006. "A Theory of Financing Constraints and Firm Dynamics," The Quarterly Journal of Economics, Oxford University Press, vol. 121(1), pages 229-265.
    49. Andrea Gamba & Alexander Triantis, 2008. "The Value of Financial Flexibility," Journal of Finance, American Finance Association, vol. 63(5), pages 2263-2296, October.
    50. Fiorella De Fiore & Harald Uhlig, 2011. "Bank Finance versus Bond Finance," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43(7), pages 1399-1421, October.
    51. Begenau, Juliane & Palazzo, Berardino, 2021. "Firm selection and corporate cash holdings," Journal of Financial Economics, Elsevier, vol. 139(3), pages 697-718.
    52. Mark T. Leary & Michael R. Roberts, 2005. "Do Firms Rebalance Their Capital Structures?," Journal of Finance, American Finance Association, vol. 60(6), pages 2575-2619, December.
    53. Boot, Arnoud W A & Greenbaum, Stuart I & Thakor, Anjan V, 1993. "Reputation and Discretion in Financial Contracting," American Economic Review, American Economic Association, vol. 83(5), pages 1165-1183, December.
    54. Michael L. Lemmon & Michael R. Roberts & Jaime F. Zender, 2008. "Back to the Beginning: Persistence and the Cross‐Section of Corporate Capital Structure," Journal of Finance, American Finance Association, vol. 63(4), pages 1575-1608, August.
    55. Houston, Joel & James, Christopher, 1996. "Bank Information Monopolies and the Mix of Private and Public Debt Claims," Journal of Finance, American Finance Association, vol. 51(5), pages 1863-1889, December.
    56. Dirk Hackbarth & Christopher A. Hennessy & Hayne E. Leland, 2007. "Can the Trade-off Theory Explain Debt Structure?," Review of Financial Studies, Society for Financial Studies, vol. 20(5), pages 1389-1428, 2007 04.
    57. Townsend, Robert M., 1979. "Optimal contracts and competitive markets with costly state verification," Journal of Economic Theory, Elsevier, vol. 21(2), pages 265-293, October.
    58. Gilson, Stuart C. & John, Kose & Lang, Larry H. P., 1990. "Troubled debt restructurings*1: An empirical study of private reorganization of firms in default," Journal of Financial Economics, Elsevier, vol. 27(2), pages 315-353, October.
    59. Chemmanur, Thomas J & Fulghieri, Paolo, 1994. "Investment Bank Reputation, Information Production, and Financial Intermediation," Journal of Finance, American Finance Association, vol. 49(1), pages 57-79, March.
    60. Bachmann, Rüdiger & Bayer, Christian, 2013. "‘Wait-and-See’ business cycles?," Journal of Monetary Economics, Elsevier, vol. 60(6), pages 704-719.
    61. Sudheer Chava & Michael R. Roberts, 2008. "How Does Financing Impact Investment? The Role of Debt Covenants," Journal of Finance, American Finance Association, vol. 63(5), pages 2085-2121, October.
    62. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    63. Rajan, Raghuram G, 1992. "Insiders and Outsiders: The Choice between Informed and Arm's-Length Debt," Journal of Finance, American Finance Association, vol. 47(4), pages 1367-1400, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiao, J., 2016. "Corporate Debt Structure, Precautionary Savings, and Investment Dynamics," Cambridge Working Papers in Economics 1666, Faculty of Economics, University of Cambridge.
    2. Alfaro, Ivan & Bloom, Nicholas & Lin, Xiaoji, 2017. "The Finance Uncertainty Multiplier," Working Paper Series 2017-30, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    3. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    4. Fiorella De Fiore & Harald Uhlig, 2015. "Corporate Debt Structure and the Financial Crisis," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(8), pages 1571-1598, December.
    5. Antonio Falato & Dalida Kadyrzhanova & Jae W. Sim, 2013. "Rising intangible capital, shrinking debt capacity, and the US corporate savings glut," Finance and Economics Discussion Series 2013-67, Board of Governors of the Federal Reserve System (U.S.).
    6. Jae Sim & Egon Zakrajsek & Simon Gilchrist, 2010. "Uncertainty, Financial Frictions, and Investment Dynamics," 2010 Meeting Papers 1285, Society for Economic Dynamics.
    7. Macnamara, Patrick, 2019. "Taxes and financial frictions: Implications for corporate capital structure," Journal of Economic Dynamics and Control, Elsevier, vol. 101(C), pages 82-100.
    8. Chang, Roberto & Fernández, Andrés & Gulan, Adam, 2017. "Bond finance, bank credit, and aggregate fluctuations in an open economy," Journal of Monetary Economics, Elsevier, vol. 85(C), pages 90-109.
    9. Eisfeldt, Andrea L. & Muir, Tyler, 2016. "Aggregate external financing and savings waves," Journal of Monetary Economics, Elsevier, vol. 84(C), pages 116-133.
    10. Matthieu Darracq Paries, 2018. "Financial frictions and monetary policy conduct," Erudite Ph.D Dissertations, Erudite, number ph18-01 edited by Ferhat Mihoubi.
    11. Melcangi, Davide, 2016. "Firms’ precautionary savings and employment during a credit crisis," LSE Research Online Documents on Economics 86237, London School of Economics and Political Science, LSE Library.
    12. Holm-Hadulla, Fédéric & Thürwächter, Claire, 2021. "Heterogeneity in corporate debt structures and the transmission of monetary policy," European Economic Review, Elsevier, vol. 136(C).
    13. Tobias Adrian & Paolo Colla & Hyun Song Shin, 2013. "Which Financial Frictions? Parsing the Evidence from the Financial Crisis of 2007 to 2009," NBER Macroeconomics Annual, University of Chicago Press, vol. 27(1), pages 159-214.
    14. Grjebine, Thomas & Szczerbowicz, Urszula & Tripier, Fabien, 2018. "Corporate debt structure and economic recoveries," European Economic Review, Elsevier, vol. 101(C), pages 77-100.
    15. Tobias Adrian & Paolo Colla & Hyun Song Shin, 2012. "Which Financial Frictions? Parsing the Evidence from the Financial Crisis of 2007-9," NBER Working Papers 18335, National Bureau of Economic Research, Inc.
    16. Xiaodan Gao & Shaofeng Xu, 2018. "The Role of Corporate Saving over the Business Cycle: Shock Absorber or Amplifier?," Staff Working Papers 18-59, Bank of Canada.
    17. Favara, Giovanni & Gao, Janet & Giannetti, Mariassunta, 2021. "Uncertainty, access to debt, and firm precautionary behavior," Journal of Financial Economics, Elsevier, vol. 141(2), pages 436-453.
    18. Gryglewicz, Sebastian, 2011. "A theory of corporate financial decisions with liquidity and solvency concerns," Journal of Financial Economics, Elsevier, vol. 99(2), pages 365-384, February.
    19. Bhamra, Harjoat S. & Fisher, Adlai J. & Kuehn, Lars-Alexander, 2011. "Monetary policy and corporate default," Journal of Monetary Economics, Elsevier, vol. 58(5), pages 480-494.
    20. Aubhik Khan & Julia K. Thomas, 2013. "Credit Shocks and Aggregate Fluctuations in an Economy with Production Heterogeneity," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1055-1107.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cam:camdae:1667. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://www.econ.cam.ac.uk/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jake Dyer (email available below). General contact details of provider: https://www.econ.cam.ac.uk/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.