Pyramiding: Efficient search for rare subjects
The need to economically identify rare subjects within large, poorly mapped search spaces is a frequently encountered problem for social scientists and managers. It is notoriously difficult, for example, to identify "the best new CEO for our company," or the "best three lead users to participate in our product development project." Mass screening of entire populations or samples becomes steadily more expensive as the number of acceptable solutions within the search space becomes rarer. The search strategy of "pyramiding" is a potential solution to this problem under many conditions. Pyramiding is a search process based upon the idea that people with a strong interest in a topic or field tend to know people more expert than themselves. In this paper we report upon four experiments empirically exploring the efficiency of pyramiding searches relative to mass screening. We find that pyramiding on average identified the most expert individual in a group on a specific topic with only 28.4% of the group interviewed - a great efficiency gain relative to mass screening. Further, pyramiding identified one of the top 3 experts in a population after interviewing only 15.9% of the group on average. We discuss conditions under which the pyramiding search method is likely to be efficient relative to screening.
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
- Ray Reagans & Linda Argote & Daria Brooks, 2005. "Individual Experience and Experience Working Together: Predicting Learning Rates from Knowing Who Knows What and Knowing How to Work Together," Management Science, INFORMS, vol. 51(6), pages 869-881, June.
- Stephen P. Borgatti & Rob Cross, 2003. "A Relational View of Information Seeking and Learning in Social Networks," Management Science, INFORMS, vol. 49(4), pages 432-445, April.
- Gary L. Lilien & Pamela D. Morrison & Kathleen Searls & Mary Sonnack & Eric von Hippel, 2002. "Performance Assessment of the Lead User Idea-Generation Process for New Product Development," Management Science, INFORMS, vol. 48(8), pages 1042-1059, August.
- Thomke, Stefan & von Hippel, Eric & Franke, Roland, 1998. "Modes of experimentation: an innovation process--and competitive--variable," Research Policy, Elsevier, vol. 27(3), pages 315-332, July.
- Yuqing Ren & Kathleen M. Carley & Linda Argote, 2006. "The Contingent Effects of Transactive Memory: When Is It More Beneficial to Know What Others Know?," Management Science, INFORMS, vol. 52(5), pages 671-682, May.