IDEAS home Printed from https://ideas.repec.org/h/nbr/nberch/13583.html
   My bibliography  Save this book chapter

Innovation Experiments: Researching Technical Advance, Knowledge Production, and the Design of Supporting Institutions

In: Innovation Policy and the Economy, Volume 16

Author

Listed:
  • Kevin J. Boudreau
  • Karim R. Lakhani

Abstract

This paper discusses several challenges in designing field experiments to better understand how organizational and institutional design shapes innovation outcomes and the production of knowledge. We proceed to describe the field experimental research program carried out by our Crowd Innovation Laboratory at Harvard University to clarify how we have attempted to address these research design challenges. This program has simultaneously solved important practical innovation problems for partner organizations, like NASA and Harvard Medical School (HMS), while contributing research advances, particularly in relation to innovation contests and tournaments. We conclude by proceeding to highlight the opportunity for the scholarly community to develop a “science of innovation” that utilized field experiments as means to generate knowledge.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Kevin J. Boudreau & Karim R. Lakhani, 2015. "Innovation Experiments: Researching Technical Advance, Knowledge Production, and the Design of Supporting Institutions," NBER Chapters, in: Innovation Policy and the Economy, Volume 16, pages 135-167, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberch:13583
    as

    Download full text from publisher

    File URL: http://www.nber.org/chapters/c13583.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Benjamin F. Jones, 2009. "The Burden of Knowledge and the "Death of the Renaissance Man": Is Innovation Getting Harder?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(1), pages 283-317.
    2. Holmstrom, Bengt, 1989. "Agency costs and innovation," Journal of Economic Behavior & Organization, Elsevier, vol. 12(3), pages 305-327, December.
    3. Josh Lerner & Jean Tirole, 2002. "Some Simple Economics of Open Source," Journal of Industrial Economics, Wiley Blackwell, vol. 50(2), pages 197-234, June.
    4. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    5. Douglas J. Besharov & Heidi Williams, 2012. "Innovation Inducement Prizes: Connecting Research to Policy," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 752-776, June.
    6. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2011. "Field Experiments with Firms," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 63-82, Summer.
    7. Edward P. Lazear & Ulrike Malmendier & Roberto A. Weber, 2012. "Sorting in Experiments with Application to Social Preferences," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 136-163, January.
    8. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    9. Josh Lerner & Julie Wulf, 2007. "Innovation and Incentives: Evidence from Corporate R&D," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 634-644, November.
    10. repec:ner:ucllon:http://discovery.ucl.ac.uk/17678/ is not listed on IDEAS
    11. Boudreau, Kevin J. & Lakhani, Karim R., 2015. "“Open” disclosure of innovations, incentives and follow-on reuse: Theory on processes of cumulative innovation and a field experiment in computational biology," Research Policy, Elsevier, vol. 44(1), pages 4-19.
    12. Holmström, Bengt, 1989. "Agency Costs and Innovation," Working Paper Series 214, Research Institute of Industrial Economics.
    13. Pierre Azoulay, 2004. "Capturing Knowledge within and across Firm Boundaries: Evidence from Clinical Development," American Economic Review, American Economic Association, vol. 94(5), pages 1591-1612, December.
    14. repec:feb:artefa:0089 is not listed on IDEAS
    15. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    16. Henry Sauermann & Wesley M. Cohen, 2010. "What Makes Them Tick? Employee Motives and Firm Innovation," Management Science, INFORMS, vol. 56(12), pages 2134-2153, December.
    17. Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
    18. List, John A., 2009. "An introduction to field experiments in economics," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 439-442, June.
    19. Aghion, Philippe & Tirole, Jean, 1997. "Formal and Real Authority in Organizations," Journal of Political Economy, University of Chicago Press, vol. 105(1), pages 1-29, February.
    20. repec:feb:artefa:0110 is not listed on IDEAS
    21. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    22. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    23. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b.
    24. Liam Brunt & Josh Lerner & Tom Nicholas, 2012. "Inducement Prizes and Innovation," Journal of Industrial Economics, Wiley Blackwell, vol. 60(4), pages 657-696, December.
    25. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    26. Lars Bo Jeppesen & Karim R. Lakhani, 2010. "Marginality and Problem-Solving Effectiveness in Broadcast Search," Organization Science, INFORMS, vol. 21(5), pages 1016-1033, October.
    27. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a.
    28. Murray, Fiona & Stern, Scott & Campbell, Georgina & MacCormack, Alan, 2012. "Grand Innovation Prizes: A theoretical, normative, and empirical evaluation," Research Policy, Elsevier, vol. 41(10), pages 1779-1792.
    29. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bengtsson, Lars & Edquist, Charles, 2020. "Towards a holistic user innovation policy," Papers in Innovation Studies 2020/11, Lund University, CIRCLE - Centre for Innovation Research.
    2. Oliver Schilke & Sheen S. Levine & Olenka Kacperczyk & Lynne G. Zucker, 2019. "Call for Papers-Special Issue on Experiments in Organizational Theory," Organization Science, INFORMS, vol. 30(1), pages 232-234, February.
    3. Ina Ganguli & Marieke Huysentruyt & Chloé Le Coq, 2021. "How Do Nascent Social Entrepreneurs Respond to Rewards? A Field Experiment on Motivations in a Grant Competition," Management Science, INFORMS, vol. 67(10), pages 6294-6316, October.
    4. Albert Bravo-Biosca, 2020. "Experimental Innovation Policy," Innovation Policy and the Economy, University of Chicago Press, vol. 20(1), pages 191-232.
    5. Hameeda A. AlMalki & Christopher M. Durugbo, 2023. "Systematic review of institutional innovation literature: towards a multi-level management model," Management Review Quarterly, Springer, vol. 73(2), pages 731-785, June.
    6. Oliver Alexy, 2022. "How flat can it get? From better at flatter to the promise of the decentralized, boundaryless organization," Journal of Organization Design, Springer;Organizational Design Community, vol. 11(1), pages 31-36, March.
    7. Emma von Essen & Marieke Huysentruyt & Topi Miettinen, 2020. "Exploration in Teams and the Encouragement Effect: Theory and Experimental Evidence," Management Science, INFORMS, vol. 66(12), pages 5861-5885, December.
    8. Lars Hornuf & Daniel Vrankar, 2022. "Hourly Wages in Crowdworking: A Meta-Analysis," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 64(5), pages 553-573, October.
    9. Emma von Essen & Marieke Huysentruyt & Topi Miettinen, 2019. "Exploration in Teams and the Encouragement Effect: Theory and Evidence," Economics Working Papers 2019-10, Department of Economics and Business Economics, Aarhus University.
    10. Jorge Guzman & Jean Joohyun Oh & Ananya Sen, 2020. "What Motivates Innovative Entrepreneurs? Evidence from a Global Field Experiment," Management Science, INFORMS, vol. 66(10), pages 4808-4819, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kyle Myers & Wei Yang Tham, 2023. "Money, Time, and Grant Design," Papers 2312.06479, arXiv.org.
    2. Jasmijn Bol & Lisa Laviers & Jason Sandvik, 2023. "Creativity Contests: An Experimental Investigation of Eliciting Employee Creativity," Journal of Accounting Research, Wiley Blackwell, vol. 61(1), pages 47-94, March.
    3. ONISHI Koichiro & OWAN Hideo & NAGAOKA Sadao, 2015. "Monetary Incentives for Corporate Inventors: Intrinsic motivation, project selection and inventive performance," Discussion papers 15071, Research Institute of Economy, Trade and Industry (RIETI).
    4. Ciaran Driver & Maria João Coelho Guedes, 2017. "R&D and CEO departure date: do financial incentives make CEOs more opportunistic?," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(5), pages 801-820.
    5. Ashish Arora & Michelle Gittelman & Sarah Kaplan & John Lynch & Will Mitchell & Nicolaj Siggelkow & Aaron K. Chatterji & Michael Findley & Nathan M. Jensen & Stephan Meier & Daniel Nielson, 2016. "Field experiments in strategy research," Strategic Management Journal, Wiley Blackwell, vol. 37(1), pages 116-132, January.
    6. Liotard, Isabelle & Revest, Valérie, 2018. "Contests as innovation policy instruments: Lessons from the US federal agencies' experience," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 57-69.
    7. Guido Friebel & Matthias Heinz & Miriam Krueger & Nikolay Zubanov, 2017. "Team Incentives and Performance: Evidence from a Retail Chain," American Economic Review, American Economic Association, vol. 107(8), pages 2168-2203, August.
    8. Galasso, Alberto & Mitchell, Matthew & Virag, Gabor, 2018. "A theory of grand innovation prizes," Research Policy, Elsevier, vol. 47(2), pages 343-362.
    9. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    10. Brueggemann, Julia & Meub, Lukas, 2015. "Experimental evidence on the effects of innovation contests," University of Göttingen Working Papers in Economics 251, University of Goettingen, Department of Economics.
    11. Jacqueline N. Lane & Ina Ganguli & Patrick Gaule & Eva Guinan & Karim R. Lakhani, 2021. "Engineering serendipity: When does knowledge sharing lead to knowledge production?," Strategic Management Journal, Wiley Blackwell, vol. 42(6), pages 1215-1244, June.
    12. Inderst, Roman, 2009. "Innovation management in organizations," European Economic Review, Elsevier, vol. 53(8), pages 871-887, November.
    13. Richard T. Carson & Joshua Graff Zivin & Jordan J. Louviere & Sally Sadoff & Jeffrey G. Shrader, 2022. "The Risk of Caution: Evidence from an Experiment," Management Science, INFORMS, vol. 68(12), pages 9042-9060, December.
    14. repec:eee:respol:v:48:y:2019:i:8:p:- is not listed on IDEAS
    15. Bordunos, A. & Kokoulina, L. & Ermolaeva, L., 2015. "Role of enterprise gamified system in fostering innovation capacity: A field experiment," Working Papers 6420, Graduate School of Management, St. Petersburg State University.
    16. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    17. Lacetera, Nicola & Zirulia, Lorenzo, 2012. "Individual preferences, organization, and competition in a model of R&D incentive provision," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 550-570.
    18. Speckbacher, Gerhard & Wabnegg, Markus, 2020. "Incentivizing innovation: The role of knowledge exchange and distal search behavior," Accounting, Organizations and Society, Elsevier, vol. 86(C).
    19. Nishimura, Junichi & Okamuro, Hiroyuki, 2018. "Internal and external discipline: The effect of project leadership and government monitoring on the performance of publicly funded R&D consortia," Research Policy, Elsevier, vol. 47(5), pages 840-853.
    20. Brent B Allred & Michael G Findley & Daniel Nielson & J C Sharman, 2017. "Anonymous shell companies: A global audit study and field experiment in 176 countries," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 48(5), pages 596-619, July.
    21. d’Andria, D. & Savin, I., 2018. "A Win-Win-Win? Motivating innovation in a knowledge economy with tax incentives," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 38-56.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberch:13583. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.