IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i3p1395-1420.html

How Do You Search for the Best Alternative? Experimental Evidence on Search Strategies to Solve Complex Problems

Author

Listed:
  • Svenja C. Sommer

    (Operations Management and Information Technology, HEC Paris, Jouy-en-Josas 78351, France)

  • Elliot Bendoly

    (Fisher College of Business, The Ohio State University, Columbus, Ohio 43210)

  • Stylianos Kavadias

    (Judge Business School, University of Cambridge, Cambridge, Cambridgeshire CB2 1AG, United Kingdom)

Abstract

Through a controlled two-stage experiment, we explore the performance of solution search strategies to resolve problems of varying complexity. We validate theoretical results that collaborative group structures may search more effectively in problems of low complexity but are outperformed by nominal structures at higher complexity levels. We call into question the dominance of the nominal group technique. Further close examination of search strategies reveals important insights: the number of generated solutions, a typical proxy for good problem-solving performance, does not consistently drive performance benefits across different levels of problem complexity. The average distance of search steps and the problem space coverage also play critical roles. Moreover, their effect is contingent on complexity: a wider variety of solutions is helpful only in complex problems. Overall, we caution management about the limitations of generic, albeit common, rules of thumb, such as “generate as many ideas as possible.”

Suggested Citation

  • Svenja C. Sommer & Elliot Bendoly & Stylianos Kavadias, 2020. "How Do You Search for the Best Alternative? Experimental Evidence on Search Strategies to Solve Complex Problems," Management Science, INFORMS, vol. 66(3), pages 1395-1420, March.
  • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1395-1420
    DOI: 10.1287/mnsc.2018.3247
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2018.3247
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2018.3247?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Weitzman, Martin L, 1979. "Optimal Search for the Best Alternative," Econometrica, Econometric Society, vol. 47(3), pages 641-654, May.
    2. Sendil K. Ethiraj & Daniel Levinthal, 2009. "Hoping for A to Z While Rewarding Only A: Complex Organizations and Multiple Goals," Organization Science, INFORMS, vol. 20(1), pages 4-21, February.
    3. Sanjiv Erat & Stylianos Kavadias, 2008. "Sequential Testing of Product Designs: Implications for Learning," Management Science, INFORMS, vol. 54(5), pages 956-968, May.
    4. Svenja Sommer & Stylianos Kavadias, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Post-Print hal-00491685, HAL.
    5. Michael T. Pich & Christoph H. Loch & Arnoud De Meyer, 2002. "On Uncertainty, Ambiguity, and Complexity in Project Management," Management Science, INFORMS, vol. 48(8), pages 1008-1023, August.
    6. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    7. Stephan Billinger & Nils Stieglitz & Terry R. Schumacher, 2014. "Search on Rugged Landscapes: An Experimental Study," Organization Science, INFORMS, vol. 25(1), pages 93-108, February.
    8. Thorbjørn Knudsen & Daniel A. Levinthal, 2007. "Two Faces of Search: Alternative Generation and Alternative Evaluation," Organization Science, INFORMS, vol. 18(1), pages 39-54, February.
    9. Camerer, Colin & Weber, Martin, 1992. "Recent Developments in Modeling Preferences: Uncertainty and Ambiguity," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 325-370, October.
    10. Sanjiv Erat & Vish Krishnan, 2012. "Managing Delegated Search Over Design Spaces," Management Science, INFORMS, vol. 58(3), pages 606-623, March.
    11. Jeremy Hutchison-Krupat & Stylianos Kavadias, 2015. "Strategic Resource Allocation: Top-Down, Bottom-Up, and the Value of Strategic Buckets," Management Science, INFORMS, vol. 61(2), pages 391-412, February.
    12. Svenja C. Sommer & Christoph H. Loch, 2004. "Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty," Management Science, INFORMS, vol. 50(10), pages 1334-1347, October.
    13. Jesse Shore & Ethan Bernstein & David Lazer, 2015. "Facts and Figuring: An Experimental Investigation of Network Structure and Performance in Information and Solution Spaces," Organization Science, INFORMS, vol. 26(5), pages 1432-1446, October.
    14. Kauffman, Stuart & Lobo, Jose & Macready, William G., 2000. "Optimal search on a technology landscape," Journal of Economic Behavior & Organization, Elsevier, vol. 43(2), pages 141-166, October.
    15. Clark, Jeremy, 1998. "Fairness preferences and optimization skills: are they substitutes?: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 34(4), pages 541-557, March.
    16. Florian Ederer & Gustavo Manso, 2013. "Is Pay for Performance Detrimental to Innovation?," Management Science, INFORMS, vol. 59(7), pages 1496-1513, July.
    17. Laura J. Kornish & Karl T. Ulrich, 2011. "Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas," Management Science, INFORMS, vol. 57(1), pages 107-128, January.
    18. Sanjiv Erat, 2017. "Making The Best Idea Better: The Role of Idea Pool Structure," Production and Operations Management, Production and Operations Management Society, vol. 26(10), pages 1946-1959, October.
    19. Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
    20. Raul O. Chao & Stylianos Kavadias, 2008. "A Theoretical Framework for Managing the New Product Development Portfolio: When and How to Use Strategic Buckets," Management Science, INFORMS, vol. 54(5), pages 907-921, May.
    21. Nicolaj Siggelkow & Jan W. Rivkin, 2005. "Speed and Search: Designing Organizations for Turbulence and Complexity," Organization Science, INFORMS, vol. 16(2), pages 101-122, April.
    22. J. Neil Bearden & Amnon Rapoport & Ryan O. Murphy, 2006. "Sequential Observation and Selection with Rank-Dependent Payoffs: An Experimental Study," Management Science, INFORMS, vol. 52(9), pages 1437-1449, September.
    23. Ely Dahan & Haim Mendelson, 2001. "An Extreme-Value Model of Concept Testing," Management Science, INFORMS, vol. 47(1), pages 102-116, January.
    24. Stylianos Kavadias & Svenja C. Sommer, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Management Science, INFORMS, vol. 55(12), pages 1899-1913, December.
    25. Jan W. Rivkin, 2000. "Imitation of Complex Strategies," Management Science, INFORMS, vol. 46(6), pages 824-844, June.
    26. Jasjit Singh & Lee Fleming, 2010. "Lone Inventors as Sources of Breakthroughs: Myth or Reality?," Management Science, INFORMS, vol. 56(1), pages 41-56, January.
    27. Karan Girotra & Christian Terwiesch & Karl T. Ulrich, 2010. "Idea Generation and the Quality of the Best Idea," Management Science, INFORMS, vol. 56(4), pages 591-605, April.
    28. Daniel A. Levinthal, 1997. "Adaptation on Rugged Landscapes," Management Science, INFORMS, vol. 43(7), pages 934-950, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tian Heong Chan & Shi-Ying Lim, 2023. "The Emergence of Novel Product Uses: An Investigation of Exaptations in IKEA Hacks," Management Science, INFORMS, vol. 69(5), pages 2870-2892, May.
    2. Sunkee Lee & Manuel E. Sosa, 2026. "Spaces for Creativity: Unconventional Workspaces and Divergent Thinking," Management Science, INFORMS, vol. 72(2), pages 1072-1094, February.
    3. Sanghyun Park & Phanish Puranam, 2024. "Vicarious Learning Without Knowledge Differentials," Management Science, INFORMS, vol. 70(5), pages 2999-3019, May.
    4. Panos Markou & Stylianos Kavadias & Nektarios Oraiopoulos, 2023. "Rival Signals and Project Selection: Insights from the Drug Development Process," Management Science, INFORMS, vol. 69(9), pages 5298-5315, September.
    5. Reinsberger, Kathrin & Kolbjørnsrud, Vegard & Mehner, Barbara, 2026. "Deliberate exploratory search in technology innovation: Discovering and developing need-solution pairs," Research Policy, Elsevier, vol. 55(1).
    6. Evgeny Kagan & Christian Jost & Tobias Lieberum & Sebastian Schiffels, 2026. "On Repeat: Does Iteration Drive Innovation?," Manufacturing & Service Operations Management, INFORMS, vol. 28(2), pages 343-361, March.
    7. Lucas Böttcher & Ronald Klingebiel, 2025. "Organizational Selection of Innovation," Organization Science, INFORMS, vol. 36(1), pages 387-410, January.
    8. Ronald Klingebiel, 2022. "Motivating Innovation: Tunnels vs. Funnels," Strategy Science, INFORMS, vol. 7(4), pages 300-316, December.
    9. Sreekumar Bhaskaran & Sanjiv Erat, 2025. "Optimal Prototyping with Noisy Measurements," Manufacturing & Service Operations Management, INFORMS, vol. 27(1), pages 322-338, January.
    10. Jeongsik “Jay” Lee & Hyun Ju Jung & Hyunwoo Park, 2023. "Rare is beautiful? Rareness, technology value, and the moderating role of search domain and knowledge maturity," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1019-1040, April.
    11. Hwang, Chiung-Yi & Chen, Hao-Chen, 2026. "The Knowledge-Trust Nexus: Unraveling dual trust and knowledge similarity paths to breakthrough innovation in the ICT sector," Journal of Business Research, Elsevier, vol. 206(C).
    12. Sina Khorasani & Lakshminarayana Nittala & Vish V. Krishnan, 2023. "Screening in Multistage Contests," Manufacturing & Service Operations Management, INFORMS, vol. 25(6), pages 2249-2267, November.
    13. Abhishek Deshmane & Victor Martínez-de-Albéniz, 2023. "Come Together, Right Now? An Empirical Study of Collaborations in the Music Industry," Management Science, INFORMS, vol. 69(12), pages 7217-7235, December.
    14. Gurney, Nikolos & Miller, John H. & Pynadath, David V., 2025. "Exploring the choice landscape: Anchoring and framing effects on search behavior in complex choices," Journal of choice modelling, Elsevier, vol. 55(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura J. Kornish & Karl T. Ulrich, 2011. "Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas," Management Science, INFORMS, vol. 57(1), pages 107-128, January.
    2. Jochen Schlapp & Gerrit Schumacher, 2022. "Delegated Concept Testing in New Product Development," Operations Research, INFORMS, vol. 70(5), pages 2732-2748, September.
    3. Sanjiv Erat & Vish Krishnan, 2012. "Managing Delegated Search Over Design Spaces," Management Science, INFORMS, vol. 58(3), pages 606-623, March.
    4. Sunkee Lee & Manuel E. Sosa, 2026. "Spaces for Creativity: Unconventional Workspaces and Divergent Thinking," Management Science, INFORMS, vol. 72(2), pages 1072-1094, February.
    5. Svenja C. Sommer & Christoph H. Loch, 2004. "Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty," Management Science, INFORMS, vol. 50(10), pages 1334-1347, October.
    6. Felipe A. Csaszar, 2018. "A note on how NK landscapes work," Journal of Organization Design, Springer;Organizational Design Community, vol. 7(1), pages 1-6, December.
    7. Laura J. Kornish & Jeremy Hutchison‐Krupat, 2017. "Research on Idea Generation and Selection: Implications for Management of Technology," Production and Operations Management, Production and Operations Management Society, vol. 26(4), pages 633-651, April.
    8. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    9. Stylianos Kavadias & Karl T. Ulrich, 2020. "Innovation and New Product Development: Reflections and Insights from the Research Published in the First 20 Years of Manufacturing & Service Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 84-92, January.
    10. Jin Xu & Joep Cornelissen, 2023. "Disequilibrium and complexity across scales: a patch-dynamics framework for organizational ecology," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.
    11. Svenja C. Sommer & Christoph H. Loch & Jing Dong, 2009. "Managing Complexity and Unforeseeable Uncertainty in Startup Companies: An Empirical Study," Organization Science, INFORMS, vol. 20(1), pages 118-133, February.
    12. Jörg Claussen & Tobias Kretschmer & Nils Stieglitz, 2015. "Vertical Scope, Turbulence, and the Benefits of Commitment and Flexibility," Management Science, INFORMS, vol. 61(4), pages 915-929, April.
    13. Glenn Dutcher & Cortney S. Rodet, 2022. "Which two heads are better than one? Uncovering the positive effects of diversity in creative teams," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 884-897, November.
    14. Felipe A. Csaszar & Daniel A. Levinthal, 2016. "Mental representation and the discovery of new strategies," Strategic Management Journal, Wiley Blackwell, vol. 37(10), pages 2031-2049, October.
    15. Oliver Baumann, 2015. "Models of complex adaptive systems in strategy and organization research," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 14(2), pages 169-183, November.
    16. Friederike Wall, 2016. "Agent-based modeling in managerial science: an illustrative survey and study," Review of Managerial Science, Springer, vol. 10(1), pages 135-193, January.
    17. C. Gizem Korpeoglu & Ersin Körpeoğlu & Sıdıka Tunç, 2021. "Optimal Duration of Innovation Contests," Manufacturing & Service Operations Management, INFORMS, vol. 23(3), pages 657-675, May.
    18. Zeya Wang & Morvarid Rahmani & Karthik Ramachandran, 2024. "Advising Entrepreneurs: Optimal Recommendation of Alternatives," Manufacturing & Service Operations Management, INFORMS, vol. 26(6), pages 2015-2029, November.
    19. Madeline K. Kneeland & Melissa A. Schilling & Barak S. Aharonson, 2020. "Exploring Uncharted Territory: Knowledge Search Processes in the Origination of Outlier Innovation," Organization Science, INFORMS, vol. 31(3), pages 535-557, May.
    20. Oliver Baumann & Nils Stieglitz, 2011. "Motivating Organizational Search," DRUID Working Papers 11-08, DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1395-1420. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.