IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and non-standard asymptotics

  • Jean-Marie Dufour

The technique of Monte Carlo (MC) tests [Dwass (1957), Barnard (1963)] provides an attractive method of building exact tests from statistics whose finite sample distribution is intractable but can be simulated (provided it does not involve nuisance parameters). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing the method to statistics whose null distributions involve nuisance parameters (maximized MC tests, MMC). Simplified asymptotically justified versions of the MMC method are also proposed and it is shown that they provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics (e.g., unit root asymptotics). Parametric bootstrap tests may be interpreted as a simplified version of the MMC method (without the general validity properties of the latter). La technique des tests de Monte Carlo ((MC; Dwass (1957), Barnard (1963)) constitue une méthode attrayante qui permet de construire des tests exacts fondés sur des statistiques dont la distribution exacte est difficile à calculer par des méthodes analytiques mais peut être simulée, pourvu que cette distribution ne dépende pas de paramètres de nuisance. Nous généralisons cette méthode dans deux directions: premièrement, en considérant le cas où le test de Monte Carlo est construit à partir de réplications échangeables d'une variable aléatoire dont la distribution peut comporter des discontinuités; deuxièmement, en étendant la méthode à des statistiques dont la distribution dépend de paramètres de nuisance (tests de Monte Carlo maximisés, MMC). Nous proposons aussi des versions simplifiées de la procédure MMC, qui ne sont valides qu'asymptotiquement mais fournissent néanmoins une méthode simple qui permet d'améliorer les approximations asymptotiques usuelles, en particulier dans des cas non standards (e.g., l'asymptotique en présence de racines unitaires). Nous montrons aussi que les tests basés sur la technique du bootstrap paramétrique peut s'interpréter comme une version simplifiée de la procédure MMC. Cette dernière fournit toutefois des tests asymptotiquement valides sous des conditions beaucoup plus générales que le bootstrap paramétrique.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by CIRANO in its series CIRANO Working Papers with number 2005s-02.

in new window

Length: 43 pages
Date of creation: 01 Feb 2005
Date of revision:
Handle: RePEc:cir:cirwor:2005s-02
Contact details of provider: Postal: 1130 rue Sherbrooke Ouest, suite 1400, Montréal, Quéc, H3A 2M8
Phone: (514) 985-4000
Fax: (514) 985-4039
Web page:

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Dufour, J.-M., 1986. "Exact tests and confidence sets in linear regressions with autocorrelated errors," CORE Discussion Papers 1986037, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  2. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
  3. DUFOUR, Jean-Marie & FARHAT, Abdeljelil & GARDIOL, Lucien, 1998. "Simulation-Based Finite-Sample Normality Tests in Linear Regressions," Cahiers de recherche 9811, Universite de Montreal, Departement de sciences economiques.
  4. Jouneau-Sion, Frederic & Torres, Olivier, 2006. "MMC techniques for limited dependent variables models: Implementation by the branch-and-bound algorithm," Journal of Econometrics, Elsevier, vol. 133(2), pages 479-512, August.
  5. Campbell, B. & Dufour, J.M., 1994. "Excat Nonparametric Tests of Orthogonality and Random Walk in the Presence of a Drift Parameter," Cahiers de recherche 9407, Universite de Montreal, Departement de sciences economiques.
  6. DUFOUR, Jean-Marie & JOUINI, Tarek, 2005. "Finite-Sample Simulation-Based Inference in VAR Models with Applications to Order Selection and Causality Testing," Cahiers de recherche 2005-12, Universite de Montreal, Departement de sciences economiques.
  7. Tauchen, George E. & Gallant, A. Ronald, 1995. "Which Moments to Match," Working Papers 95-20, Duke University, Department of Economics.
  8. Atsushi Inoue & Lutz Kilian, 2000. "Bootstrapping Autoregressive Processes with Possible Unit Roots," Econometric Society World Congress 2000 Contributed Papers 0401, Econometric Society.
  9. Joel L. Horowitz, 1996. "Bootstrap Methods in Econometrics: Theory and Numerical Performance," Econometrics 9602009, EconWPA, revised 05 Mar 1996.
  10. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
  11. Dufour, J.-M., 1986. "Nonlinear hypotheses, inequality restrictions and non-nested hypotheses: Exact simultaneous tests in linear regressions," CORE Discussion Papers 1986016, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  12. repec:cup:etheor:v:12:y:1996:i:4:p:657-81 is not listed on IDEAS
  13. Lynda Khalaf & Jean-Marie Dufour, 2004. "Simulation-Based Finite-Sample Inference in Simultaneous Equations," Econometric Society 2004 North American Summer Meetings 239, Econometric Society.
  14. Alexander Benkwitz & Michael Neumann & Helmut Lutekpohl, 2000. "Problems related to confidence intervals for impulse responses of autoregressive processes," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 69-103.
  15. Dufour, Jean-Marie & Kiviet, Jan F., 1996. "Exact tests for structural change in first-order dynamic models," Journal of Econometrics, Elsevier, vol. 70(1), pages 39-68, January.
  16. Daniel McFadden, 1987. "A Method of Simulated Moments for Estimation of Discrete Response Models Without Numerical Integration," Working papers 464, Massachusetts Institute of Technology (MIT), Department of Economics.
  17. Maxwell B. Stinchcombe & Halbert White, 1992. "Some Measurability Results for Extrema of Random Functions Over Random Sets," Review of Economic Studies, Oxford University Press, vol. 59(3), pages 495-514.
  18. Dufour, J.M. & Kiviet, J.F., 1995. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Cahiers de recherche 9547, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
  19. Inoue, Atsushi & Kilian, Lutz, 2003. "The Continuity Of The Limit Distribution In The Parameter Of Interest Is Not Essential For The Validity Of The Bootstrap," Econometric Theory, Cambridge University Press, vol. 19(06), pages 944-961, December.
  20. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
  21. Dufour, Jean-Marie & Jasiak, Joann, 2001. "Finite Sample Limited Information Inference Methods for Structural Equations and Models with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 42(3), pages 815-43, August.
  22. Marc Hallin & Jean-Marie Dufour & Ivan Mizera, 1998. "Generalized run tests for heteroscedastic time series," ULB Institutional Repository 2013/2077, ULB -- Universite Libre de Bruxelles.
  23. Keane, Michael, 1993. "Simulation estimation for panel data models with limited dependent variables," MPRA Paper 53029, University Library of Munich, Germany.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2005s-02. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Webmaster)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.