IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2005s-02.html
   My bibliography  Save this paper

Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and non-standard asymptotics

Author

Listed:
  • Jean-Marie Dufour

Abstract

The technique of Monte Carlo (MC) tests [Dwass (1957), Barnard (1963)] provides an attractive method of building exact tests from statistics whose finite sample distribution is intractable but can be simulated (provided it does not involve nuisance parameters). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing the method to statistics whose null distributions involve nuisance parameters (maximized MC tests, MMC). Simplified asymptotically justified versions of the MMC method are also proposed and it is shown that they provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics (e.g., unit root asymptotics). Parametric bootstrap tests may be interpreted as a simplified version of the MMC method (without the general validity properties of the latter). La technique des tests de Monte Carlo ((MC; Dwass (1957), Barnard (1963)) constitue une méthode attrayante qui permet de construire des tests exacts fondés sur des statistiques dont la distribution exacte est difficile à calculer par des méthodes analytiques mais peut être simulée, pourvu que cette distribution ne dépende pas de paramètres de nuisance. Nous généralisons cette méthode dans deux directions: premièrement, en considérant le cas où le test de Monte Carlo est construit à partir de réplications échangeables d'une variable aléatoire dont la distribution peut comporter des discontinuités; deuxièmement, en étendant la méthode à des statistiques dont la distribution dépend de paramètres de nuisance (tests de Monte Carlo maximisés, MMC). Nous proposons aussi des versions simplifiées de la procédure MMC, qui ne sont valides qu'asymptotiquement mais fournissent néanmoins une méthode simple qui permet d'améliorer les approximations asymptotiques usuelles, en particulier dans des cas non standards (e.g., l'asymptotique en présence de racines unitaires). Nous montrons aussi que les tests basés sur la technique du bootstrap paramétrique peut s'interpréter comme une version simplifiée de la procédure MMC. Cette dernière fournit toutefois des tests asymptotiquement valides sous des conditions beaucoup plus générales que le bootstrap paramétrique.

Suggested Citation

  • Jean-Marie Dufour, 2005. "Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and non-standard asymptotics," CIRANO Working Papers 2005s-02, CIRANO.
    • Handle: RePEc:cir:cirwor:2005s-02
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2005s-02.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    2. Julian Besag & Peter J. Diggle, 1977. "Simple Monte Carlo Tests for Spatial Pattern," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 26(3), pages 327-333, November.
    3. DUFOUR, Jean-Marie & JOUINI, Tarek, 2005. "Finite-Sample Simulation-Based Inference in VAR Models with Applications to Order Selection and Causality Testing," Cahiers de recherche 2005-12, Universite de Montreal, Departement de sciences economiques.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    6. Inoue, Atsushi & Kilian, Lutz, 2003. "The Continuity Of The Limit Distribution In The Parameter Of Interest Is Not Essential For The Validity Of The Bootstrap," Econometric Theory, Cambridge University Press, vol. 19(6), pages 944-961, December.
    7. Dufour, Jean-Marie & Jasiak, Joann, 2001. "Finite Sample Limited Information Inference Methods for Structural Equations and Models with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 42(3), pages 815-843, August.
    8. Dufour, Jean-Marie, 1990. "Exact Tests and Confidence Sets in Linear Regressions with Autocorrelated Errors," Econometrica, Econometric Society, vol. 58(2), pages 475-494, March.
    9. Jouneau-Sion, Frederic & Torres, Olivier, 2006. "MMC techniques for limited dependent variables models: Implementation by the branch-and-bound algorithm," Journal of Econometrics, Elsevier, vol. 133(2), pages 479-512, August.
    10. Jean-Marie Dufour & Abdeljelil Farhat & Lucien Gardiol & Lynda Khalaf, 1998. "Simulation-based finite sample normality tests in linear regressions," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 154-173.
    11. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833, Enero-Abr.
    12. Dufour, Jean-Marie, 1989. "Nonlinear Hypotheses, Inequality Restrictions, and Non-nested Hypotheses: Exact Simultaneous Tests in Linear Regressions," Econometrica, Econometric Society, vol. 57(2), pages 335-355, March.
    13. Campbell, Bryan & Dufour, Jean-Marie, 1997. "Exact Nonparametric Tests of Orthogonality and Random Walk in the Presence of a Drift Parameter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(1), pages 151-173, February.
    14. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    15. Maxwell B. Stinchcombe & Halbert White, 1992. "Some Measurability Results for Extrema of Random Functions Over Random Sets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(3), pages 495-514.
    16. Atsushi Inoue & Lutz Kilian, 2002. "Bootstrapping Autoregressive Processes with Possible Unit Roots," Econometrica, Econometric Society, vol. 70(1), pages 377-391, January.
    17. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
    18. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819, Enero-Abr.
    19. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    20. Alexander Benkwitz & Michael Neumann & Helmut Lutekpohl, 2000. "Problems related to confidence intervals for impulse responses of autoregressive processes," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 69-103.
    21. Dufour, Jean-Marie & Kiviet, Jan F., 1996. "Exact tests for structural change in first-order dynamic models," Journal of Econometrics, Elsevier, vol. 70(1), pages 39-68, January.
    22. Keane, Michael, 1993. "Simulation estimation for panel data models with limited dependent variables," MPRA Paper 53029, University Library of Munich, Germany.
    23. repec:cup:etheor:v:12:y:1996:i:4:p:657-81 is not listed on IDEAS
    24. F. H. C. Marriott, 1979. "Barnard's Monte Carlo Tests: How Many Simulations?," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 28(1), pages 75-77, March.
    25. Joel L. Horowitz, 1996. "Bootstrap Methods in Econometrics: Theory and Numerical Performance," Econometrics 9602009, University Library of Munich, Germany, revised 05 Mar 1996.
    26. Marc Hallin & Jean-Marie Dufour & Ivan Mizera, 1998. "Generalized run tests for heteroscedastic time series," ULB Institutional Repository 2013/2077, ULB -- Universite Libre de Bruxelles.
    27. Lynda Khalaf & Jean-Marie Dufour, 2004. "Simulation-Based Finite-Sample Inference in Simultaneous Equations," Econometric Society 2004 North American Summer Meetings 239, Econometric Society.
    28. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826, Enero-Abr.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dufour, Jean-Marie & Torres, Olivier, 2000. "Markovian processes, two-sided autoregressions and finite-sample inference for stationary and nonstationary autoregressive processes," Journal of Econometrics, Elsevier, vol. 99(2), pages 255-289, December.
    2. Touhami Abdelkhalek & Jean-Marie Dufour, 1998. "Statistical Inference For Computable General Equilibrium Models, With Application To A Model Of The Moroccan Economy," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 520-534, November.
    3. Khalaf, Lynda & Urga, Giovanni, 2014. "Identification robust inference in cointegrating regressions," Journal of Econometrics, Elsevier, vol. 182(2), pages 385-396.
    4. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Exact tests for contemporaneous correlation of disturbances in seemingly unrelated regressions," Journal of Econometrics, Elsevier, vol. 106(1), pages 143-170, January.
    5. Marie-Claude Beaulieu & Jean-Marie Dufour & Lynda Khalaf, 2005. "Exact Multivariate Tests of Asset Pricing Models with Stable Asymmetric Distributions," Springer Books, in: Michèle Breton & Hatem Ben-Ameur (ed.), Numerical Methods in Finance, chapter 0, pages 173-191, Springer.
    6. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2014. "Exact confidence sets and goodness-of-fit methods for stable distributions," Journal of Econometrics, Elsevier, vol. 181(1), pages 3-14.
    7. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    8. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Simulation based finite and large sample tests in multivariate regressions," Journal of Econometrics, Elsevier, vol. 111(2), pages 303-322, December.
    9. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    10. DUFOUR, Jean-Marie & JOUINI, Tarek, 2005. "Finite-Sample Simulation-Based Inference in VAR Models with Applications to Order Selection and Causality Testing," Cahiers de recherche 2005-12, Universite de Montreal, Departement de sciences economiques.
    11. Fabio Busetti & Silvestro di Sanzo, 2011. "Bootstrap LR tests of stationarity, common trends and cointegration," Temi di discussione (Economic working papers) 799, Bank of Italy, Economic Research and International Relations Area.
    12. Jean-Marie Dufour & Pascale Valery, 2000. "Monte Carlo Test Applied to Models Estimated by Indirect Inference," Econometric Society World Congress 2000 Contributed Papers 1667, Econometric Society.
    13. Khalaf, Lynda & Kichian, Maral, 2005. "Exact tests of the stability of the Phillips curve: the Canadian case," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 445-460, April.
    14. Dufour, Jean-Marie & Jouini, Tarek, 2006. "Finite-sample simulation-based inference in VAR models with application to Granger causality testing," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 229-254.
    15. Dufour, J.M. & Farhat, A., 2001. "Exact Nonparametric Two-Sample Homogeneity Tests for Possibly Discrete Distributions," Cahiers de recherche 2001-23, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    16. Dufour, Jean-Marie & Khalaf, Lynda, 2001. "Finite-Sample Simulation-Based Tests in Seemingly Unrelated Regressions," Cahiers de recherche 0105, GREEN.
    17. Joachim Inkmann, 2000. "Finite Sample Properties of One-Step, Two-Step and Bootstrap Empirical Likelihood Approaches to Efficient GMM Estimation," Econometric Society World Congress 2000 Contributed Papers 0332, Econometric Society.
    18. repec:ebl:ecbull:v:30:y:2010:i:1:p:55-66 is not listed on IDEAS
    19. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    20. Yanna Wu & Subhash C. Ray, 2005. "Technical Efficiency and Stock Market Reaction to Horizontal Mergers," Working papers 2005-05, University of Connecticut, Department of Economics.
    21. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.

    More about this item

    Keywords

    Monte Carlo test; maximized monte Carlo test; finite sample test; exact test; nuisance parameter; bounds; bootstrap; parametric bootstrap; simulated annealing; asymptotics; nonstandard asymptotic distribution; test de Monte Carlo; test de Monte Carlo maximisé; test exact; test valide en échantillon fini; paramètre de nuisance; bornes; bootstrap; bootstrap paramétrique; recuit simulé; distribution asymptotique non standard;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2005s-02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.