IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i3p1395-1420.html
   My bibliography  Save this article

How Do You Search for the Best Alternative? Experimental Evidence on Search Strategies to Solve Complex Problems

Author

Listed:
  • Svenja C. Sommer

    (Operations Management and Information Technology, HEC Paris, Jouy-en-Josas 78351, France)

  • Elliot Bendoly

    (Fisher College of Business, The Ohio State University, Columbus, Ohio 43210)

  • Stylianos Kavadias

    (Judge Business School, University of Cambridge, Cambridge, Cambridgeshire CB2 1AG, United Kingdom)

Abstract

Through a controlled two-stage experiment, we explore the performance of solution search strategies to resolve problems of varying complexity. We validate theoretical results that collaborative group structures may search more effectively in problems of low complexity but are outperformed by nominal structures at higher complexity levels. We call into question the dominance of the nominal group technique. Further close examination of search strategies reveals important insights: the number of generated solutions, a typical proxy for good problem-solving performance, does not consistently drive performance benefits across different levels of problem complexity. The average distance of search steps and the problem space coverage also play critical roles. Moreover, their effect is contingent on complexity: a wider variety of solutions is helpful only in complex problems. Overall, we caution management about the limitations of generic, albeit common, rules of thumb, such as “generate as many ideas as possible.”

Suggested Citation

  • Svenja C. Sommer & Elliot Bendoly & Stylianos Kavadias, 2020. "How Do You Search for the Best Alternative? Experimental Evidence on Search Strategies to Solve Complex Problems," Management Science, INFORMS, vol. 66(3), pages 1395-1420, March.
    • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1395-1420
    DOI: 10.1287/mnsc.2018.3247
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2018.3247
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2018.3247?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Florian Ederer & Gustavo Manso, 2013. "Is Pay for Performance Detrimental to Innovation?," Management Science, INFORMS, vol. 59(7), pages 1496-1513, July.
    2. Sanjiv Erat & Vish Krishnan, 2012. "Managing Delegated Search Over Design Spaces," Management Science, INFORMS, vol. 58(3), pages 606-623, March.
    3. Clark, Jeremy, 1998. "Fairness preferences and optimization skills: are they substitutes?: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 34(4), pages 541-557, March.
    4. Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
    5. Nicolaj Siggelkow & Jan W. Rivkin, 2005. "Speed and Search: Designing Organizations for Turbulence and Complexity," Organization Science, INFORMS, vol. 16(2), pages 101-122, April.
    6. Sendil K. Ethiraj & Daniel Levinthal, 2009. "Hoping for A to Z While Rewarding Only A: Complex Organizations and Multiple Goals," Organization Science, INFORMS, vol. 20(1), pages 4-21, February.
    7. Sanjiv Erat & Stylianos Kavadias, 2008. "Sequential Testing of Product Designs: Implications for Learning," Management Science, INFORMS, vol. 54(5), pages 956-968, May.
    8. Jeremy Hutchison-Krupat & Stylianos Kavadias, 2015. "Strategic Resource Allocation: Top-Down, Bottom-Up, and the Value of Strategic Buckets," Management Science, INFORMS, vol. 61(2), pages 391-412, February.
    9. Svenja C. Sommer & Christoph H. Loch, 2004. "Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty," Management Science, INFORMS, vol. 50(10), pages 1334-1347, October.
    10. Laura J. Kornish & Karl T. Ulrich, 2011. "Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas," Management Science, INFORMS, vol. 57(1), pages 107-128, January.
    11. Sanjiv Erat, 2017. "Making The Best Idea Better: The Role of Idea Pool Structure," Production and Operations Management, Production and Operations Management Society, vol. 26(10), pages 1946-1959, October.
    12. Raul O. Chao & Stylianos Kavadias, 2008. "A Theoretical Framework for Managing the New Product Development Portfolio: When and How to Use Strategic Buckets," Management Science, INFORMS, vol. 54(5), pages 907-921, May.
    13. Camerer, Colin & Weber, Martin, 1992. "Recent Developments in Modeling Preferences: Uncertainty and Ambiguity," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 325-370, October.
    14. Stylianos Kavadias & Svenja C. Sommer, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Management Science, INFORMS, vol. 55(12), pages 1899-1913, December.
    15. Weitzman, Martin L, 1979. "Optimal Search for the Best Alternative," Econometrica, Econometric Society, vol. 47(3), pages 641-654, May.
    16. Svenja Sommer & Stylianos Kavadias, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Post-Print hal-00491685, HAL.
    17. Michael T. Pich & Christoph H. Loch & Arnoud De Meyer, 2002. "On Uncertainty, Ambiguity, and Complexity in Project Management," Management Science, INFORMS, vol. 48(8), pages 1008-1023, August.
    18. J. Neil Bearden & Amnon Rapoport & Ryan O. Murphy, 2006. "Sequential Observation and Selection with Rank-Dependent Payoffs: An Experimental Study," Management Science, INFORMS, vol. 52(9), pages 1437-1449, September.
    19. Ely Dahan & Haim Mendelson, 2001. "An Extreme-Value Model of Concept Testing," Management Science, INFORMS, vol. 47(1), pages 102-116, January.
    20. Jan W. Rivkin, 2000. "Imitation of Complex Strategies," Management Science, INFORMS, vol. 46(6), pages 824-844, June.
    21. Daniel A. Levinthal, 1997. "Adaptation on Rugged Landscapes," Management Science, INFORMS, vol. 43(7), pages 934-950, July.
    22. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    23. Stephan Billinger & Nils Stieglitz & Terry R. Schumacher, 2014. "Search on Rugged Landscapes: An Experimental Study," Organization Science, INFORMS, vol. 25(1), pages 93-108, February.
    24. Thorbjørn Knudsen & Daniel A. Levinthal, 2007. "Two Faces of Search: Alternative Generation and Alternative Evaluation," Organization Science, INFORMS, vol. 18(1), pages 39-54, February.
    25. Jesse Shore & Ethan Bernstein & David Lazer, 2015. "Facts and Figuring: An Experimental Investigation of Network Structure and Performance in Information and Solution Spaces," Organization Science, INFORMS, vol. 26(5), pages 1432-1446, October.
    26. Kauffman, Stuart & Lobo, Jose & Macready, William G., 2000. "Optimal search on a technology landscape," Journal of Economic Behavior & Organization, Elsevier, vol. 43(2), pages 141-166, October.
    27. Jasjit Singh & Lee Fleming, 2010. "Lone Inventors as Sources of Breakthroughs: Myth or Reality?," Management Science, INFORMS, vol. 56(1), pages 41-56, January.
    28. Karan Girotra & Christian Terwiesch & Karl T. Ulrich, 2010. "Idea Generation and the Quality of the Best Idea," Management Science, INFORMS, vol. 56(4), pages 591-605, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tian Heong Chan & Shi-Ying Lim, 2023. "The Emergence of Novel Product Uses: An Investigation of Exaptations in IKEA Hacks," Management Science, INFORMS, vol. 69(5), pages 2870-2892, May.
    2. Jeongsik “Jay” Lee & Hyun Ju Jung & Hyunwoo Park, 2023. "Rare is beautiful? Rareness, technology value, and the moderating role of search domain and knowledge maturity," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1019-1040, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura J. Kornish & Karl T. Ulrich, 2011. "Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas," Management Science, INFORMS, vol. 57(1), pages 107-128, January.
    2. Sanjiv Erat & Vish Krishnan, 2012. "Managing Delegated Search Over Design Spaces," Management Science, INFORMS, vol. 58(3), pages 606-623, March.
    3. Svenja C. Sommer & Christoph H. Loch, 2004. "Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty," Management Science, INFORMS, vol. 50(10), pages 1334-1347, October.
    4. Laura J. Kornish & Jeremy Hutchison‐Krupat, 2017. "Research on Idea Generation and Selection: Implications for Management of Technology," Production and Operations Management, Production and Operations Management Society, vol. 26(4), pages 633-651, April.
    5. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    6. Stylianos Kavadias & Karl T. Ulrich, 2020. "Innovation and New Product Development: Reflections and Insights from the Research Published in the First 20 Years of Manufacturing & Service Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 84-92, January.
    7. Jin Xu & Joep Cornelissen, 2023. "Disequilibrium and complexity across scales: a patch-dynamics framework for organizational ecology," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.
    8. Svenja C. Sommer & Christoph H. Loch & Jing Dong, 2009. "Managing Complexity and Unforeseeable Uncertainty in Startup Companies: An Empirical Study," Organization Science, INFORMS, vol. 20(1), pages 118-133, February.
    9. Felipe A. Csaszar, 2018. "A note on how NK landscapes work," Journal of Organization Design, Springer;Organizational Design Community, vol. 7(1), pages 1-6, December.
    10. Glenn Dutcher & Cortney S. Rodet, 2022. "Which two heads are better than one? Uncovering the positive effects of diversity in creative teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 884-897, November.
    11. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    12. Oliver Baumann, 2015. "Models of complex adaptive systems in strategy and organization research," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 14(2), pages 169-183, November.
    13. Stylianos Kavadias & Svenja C. Sommer, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Management Science, INFORMS, vol. 55(12), pages 1899-1913, December.
    14. Oliver Baumann & Nicolaj Siggelkow, 2013. "Dealing with Complexity: Integrated vs. Chunky Search Processes," Organization Science, INFORMS, vol. 24(1), pages 116-132, February.
    15. Mohsen Jafari Songhori & Madjid Tavana & Takao Terano, 2020. "Product development team formation: effects of organizational- and product-related factors," Computational and Mathematical Organization Theory, Springer, vol. 26(1), pages 88-122, March.
    16. Cha Li & Felipe A. Csaszar, 2019. "Government as Landscape Designer: A Behavioral View of Industrial Policy," Strategy Science, INFORMS, vol. 4(3), pages 175-192, September.
    17. Bleda, Mercedes & Querbes, Adrien & Healey, Mark, 2021. "The influence of motivational factors on ongoing product design decisions," Journal of Business Research, Elsevier, vol. 129(C), pages 562-569.
    18. Hasan, Sharique & Koning, Rembrand, 2019. "Conversations and idea generation: Evidence from a field experiment," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    19. Juha Uotila, 2018. "Punctuated equilibrium or ambidexterity: dynamics of incremental and radical organizational change over time," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(1), pages 131-148.
    20. Natalicchio, A. & Messeni Petruzzelli, A. & Garavelli, A.C., 2017. "Innovation problems and search for solutions in crowdsourcing platforms – A simulation approach," Technovation, Elsevier, vol. 64, pages 28-42.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1395-1420. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.