This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

An alternative method to the scrambled Halton sequence for removing correlation between standard Halton sequences in high dimensions

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Stephane Hess ()
John Polak ()
Abstract

Halton sequences were first introduced in the 1960s as an alternative to pseudo-random number sequences, with the aim of providing better coverage of the area of integration and negative correlation in the simulated probabilities between observations. This is needed in order to achieve variance reduction when using simulation to approximate an integral that does not have a closed-form expression. Such integrals arise in many areas of regional science, for example in the evaluation and estimation of certain types of discrete choice models. While the performance of standard Halton sequences is very good in low dimensions, problems with correlation have been observed between sequences generated from higher primes. This can cause serious problems in the estimation of models with high-dimensional integrals (e.g., models of aspects of spatial choice, such as route or location). Various methods have been proposed to deal with this; one of the most prominent solutions is the scrambled Halton sequence, which uses special predetermined permutations of the coefficients used in the construction of the standard sequence. In this paper, we conduct a detailed analysis of the ability of scrambled Halton sequences to remove the problematic correlation that exists between standard Halton sequences for high primes in the two-dimensional space. The analysis shows that although the scrambled sequences exhibit a lower degree of overall correlation than the standard sequences, for some choices of primes, correlation remains at an unacceptably high level. This paper then proposes an alternative method, based on the idea of using randomly shuffled versions of the one-dimensional standard Halton sequences in the construction of multi-dimensional sequences. We show that the new shuffled sequences produce a significantly higher reduction in correlation than the scrambled sequences, without loss of quality of coverage. Another substantial advantage of this new method is that it can, without any modifications, be used for any number of dimensions, while the use of the scrambled sequences requires the a-priori computation of a matrix of permutations, which for high dimensional problems could lead to significant runtime disadvantages. Repeated runs of the shuffling algorithm will also produce different sequences in different runs, which nevertheless maintain the same quality of one-dimensional coverage. This is not at all the case for the scrambled sequences. In view of the clear advantages in its ability to remove correlation, combined with its runtime and generalization advantages, this paper recommends that this new algorithm should be preferred to the scrambled Halton sequences when dealing with high correlation between standard Halton sequences.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www-sre.wu-wien.ac.at/ersa/ersaconfs/ersa03/cdrom/papers/406.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by European Regional Science Association in its series ERSA conference papers with number ersa03p406.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Aug 2003
Date of revision:
Handle: RePEc:wiw:wiwrsa:ersa03p406

Contact details of provider:
Postal: Augasse 2-6, 1090 Vienna, Austria
Web page: http://www.ersa.org

For technical questions regarding this item, or to correct its listing, contact: (Gunther Maier).

Related research
Keywords:

Other versions of this item:

This paper has been announced in the following NEP Reports: References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Kenneth Train, 2000. "Halton Sequences for Mixed Logit," Department of Economics, Working Paper Series 1035, Department of Economics, Institute for Business and Economic Research, UC Berkeley. [Downloadable!]
    Other versions:
  2. Kenneth Train, 2003. "Discrete Choice Methods with Simulation," Online economics textbooks, SUNY-Oswego, Department of Economics, number emetr2, March. [Downloadable!]
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Stephane Hess & John W. Polak, 2004. "An analysis of parking behaviour using discrete choice models calibrated on SP datasets," ERSA conference papers ersa04p60, European Regional Science Association. [Downloadable!]
  2. Lesley Chiou & Joan Walker, 2005. "Masking Identification of Discrete Choice Models under Simulation Methods," Occidental Economics Working Papers 5, Occidental College, Department of Economics, revised May 2006. [Downloadable!]
  3. Lorenzo Cappellari & Stephen P. Jenkins, 2006. "Calculation of Multivariate Normal Probabilities by Simulation, with Applications to Maximum Simulated Likelihood Estimation," IZA Discussion Papers 2112, Institute for the Study of Labor (IZA). [Downloadable!]
    Other versions:
  4. repec:ese:iserwp: is not listed on IDEAS
  5. Danny Campbell & W. George Hutchinson & Riccardo Scarpa, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Working Papers 2006.128, Fondazione Eni Enrico Mattei. [Downloadable!]
  6. Danny Campbell & W. George Hutchinson & Riccardo Scarpa, 2006. "Using Discrete Choice Experiments to Derive Individual-Specific WTP Estimates for Landscape Improvements under Agri-Environmental Schemes: Evidence from the Rural Environment Protection Scheme in Irel," Working Papers 2006.26, Fondazione Eni Enrico Mattei. [Downloadable!]
Statistics
Access and download statistics

Did you know? IDEAS also covers the most complete directory of Economics departments and institutes, EDIRC.

This page was last updated on 2009-11-13.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.