Get me out of this hole: Identifying and avoiding inferior local optima in choice models

Choice modellers routinely acknowledge the risk of convergence to inferior local optima when using structures other than a simple linear-in-parameters logit model, but there is no consensus on how to address it. Most analysts seem to ignore the problem, while others try a set of different starting values or put their faith in what they believe to be more robust estimation approaches. This paper puts the question on a firmer empirical footing for latent class models, contrasting eight estimation strategies on a stated choice and a revealed preference dataset. These include multistart, global optimisation heuristics, the EM algorithm, and a proposed new profile likelihood algorithm that systematically analyses the parameter space around an initial estimate in search of better optima. Multiple well identified local optima are present in both case studies, with eight distinct solutions in the first and $23$ in the second, and no single approach recovers all of them. The solution that is easiest to find is not the one that fits best, and conventional starting values lead to a solution ranking thirteenth of $23$ in the second case study. We further show why these optima exist, tracing the barriers in log-likelihood between solutions to an interchange of substantive roles between classes. The consequences are material: willingness-to-pay measures differ by up to $60\%$ across solutions and elasticities by a factor of two, with the ordering of solutions by fit bearing little relation to their ordering by any such measure.