Keeping Your options Open

In standard models of experimentation, the costs of project development consist of (a) the direct cost of running trials as well as (b)the implicit opportunity cost of leaving alternative projects idle. Another natural type of experimentation cost, the cost of holding on to the option of developing a currently inactive project, has not been studied. In a multi-armed bandit model of experimentation in which inactive projects have explicit maintenance costs and can be irreversibly discarded, I fully characterise optimal experimentation policies and show that the decision-maker's incentive to actively manage its options has important implication for the order of project development. In the model, an experimenter searches for a success among a number of projects by choosing both those to develop now and those to maintain for (potential) future development. In the absence of maintenance costs, optimal experimentation policies incentives to bring the option value of less promising projects forward, and under optimal experimentation policies, 'going -with-the-loser' can be optimal: projects that are less likely to succeed are sometimes developed rast.