IDEAS home Printed from https://ideas.repec.org/p/mtl/montde/2000-10.html
   My bibliography  Save this paper

Simulation-Based Finite and Large Sample Tests in Multivariate Regressions

Author

Listed:
  • DUFOUR, Jean-Marie
  • KHALAF, Lynda

Abstract

In the context of multivariate linear regression (MLR) models, it is well known that commonly employed asymptotic test criteria are seriously biased towards overrejection. In this paper, we propose a general method for constructing exact tests of possibly nonlinear hypotheses on the coefficients of MLR systems. For the case of uniform linear hypotheses, we present exact distributional invariance results concerning several standard test criteria. These include Wilks' likelihood ratio (LR) criterion as well as trace and maximum root criteria. The normality assumption is not necessary for most of the results to hold. Implications for inference are two-fold. First, invariance to nuisance parameters entails that the technique of Monte Carlo tests can be applied on all these statistics to obtain exact tests of uniform linear hypotheses. Second, the invariance property of the latter statistic is exploited to derive general nuisance-parameter-free bounds on the distribution of the LR statistic for arbitrary hypotheses. Even though it may be difficult to compute these bounds analytically, they can easily be simulated, hence yielding exact bounds Monte Carlo tests. Illustrative simulation experiments show that the bounds are sufficiently tight to provide conclusive results with a high probability. Our findings illustrate the value of the bounds as a tool to be used in conjunction with more traditional simulation-based test methods (e.g., the parametric bootstrap) which may be applied when the bounds are not conclusive.

Suggested Citation

  • DUFOUR, Jean-Marie & KHALAF, Lynda, 2000. "Simulation-Based Finite and Large Sample Tests in Multivariate Regressions," Cahiers de recherche 2000-10, Universite de Montreal, Departement de sciences economiques.
  • Handle: RePEc:mtl:montde:2000-10
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/1866/334
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    2. Laitinen, Kenneth, 1978. "Why is demand homogeneity so often rejected?," Economics Letters, Elsevier, vol. 1(3), pages 187-191.
    3. Stewart, Kenneth G., 1995. "The functional equivalence of the W, LR, and LM statistics," Economics Letters, Elsevier, vol. 49(2), pages 109-112, August.
    4. Stambaugh, Robert F., 1982. "On the exclusion of assets from tests of the two-parameter model : A sensitivity analysis," Journal of Financial Economics, Elsevier, vol. 10(3), pages 237-268, November.
    5. Michael A. Williams, 1986. "An Economic Application of Bootstrap Statistical Methods: Addyston Pipe Revisited," The American Economist, Sage Publications, vol. 30(2), pages 52-58, October.
    6. Berndt, Ernst R & Savin, N Eugene, 1977. "Conflict among Criteria for Testing Hypotheses in the Multivariate Linear Regression Model," Econometrica, Econometric Society, vol. 45(5), pages 1263-1277, July.
    7. Breusch, T S, 1979. "Conflict among Criteria for Testing Hypotheses: Extensions and Comments," Econometrica, Econometric Society, vol. 47(1), pages 203-207, January.
    8. Affleck-Graves, John & McDonald, Bill, 1990. "Multivariate Tests of Asset Pricing: The Comparative Power of Alternative Statistics," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 25(2), pages 163-185, June.
    9. Jayatissa, W A, 1977. "Tests of Equality between Sets of Coefficients in Two Linear Regressions when Disturbance Variances Are Unequal," Econometrica, Econometric Society, vol. 45(5), pages 1291-1292, July.
    10. Atkinson, Scott E. & Wilson, Paul W., 1992. "The Bias of Bootstrapped Versus Conventional Standard Errors in the General Linear and SUR Models," Econometric Theory, Cambridge University Press, vol. 8(2), pages 258-275, June.
    11. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    12. Cribari-Neto, Francisco & Zarkos, Spyros G, 1997. "Finite-Sample Adjustments for Homogeneity and Symmetry Tests in Systems of Demand Equations: A Monte Carlo Evaluation," Computational Economics, Springer;Society for Computational Economics, vol. 10(4), pages 337-351, November.
    13. DUFOUR, Jean-Marie & KHALAF, Lynda, 1998. "Simulation-Based Finite-and Large-sample Inference Methods in Multivariate Regressions and Seemingly Unrelated Regressions," Cahiers de recherche 9813, Universite de Montreal, Departement de sciences economiques.
    14. Bera, A. K. & Byron, R. P. & Jarque, C. M., 1981. "Further evidence on asymptotic tests for homogeneity and symmetry in large demand systems," Economics Letters, Elsevier, vol. 8(2), pages 101-105.
    15. Russell Davidson & James MacKinnon, 2000. "Bootstrap tests: how many bootstraps?," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 55-68.
    16. Meisner, James F., 1979. "The sad fate of the asymptotic Slutsky symmetry test for large systems," Economics Letters, Elsevier, vol. 2(3), pages 231-233.
    17. Taylor, Timothy G. & Shonkwiler, J. S. & Theil, Henri, 1986. "Monte Carlo and bootstrap testing of demand homogeneity," Economics Letters, Elsevier, vol. 20(1), pages 55-57.
    18. Jean-Marie Dufour & Abdeljelil Farhat & Lucien Gardiol & Lynda Khalaf, 1998. "Simulation-based finite sample normality tests in linear regressions," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 154-173.
    19. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    20. Davidson, Russell & MacKinnon, James G, 1999. "Bootstrap Testing in Nonlinear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(2), pages 487-508, May.
    21. Rothernberg, Thomas J, 1984. "Hypothesis Testing in Linear Models When the Error Covariance Matrix Is Nonscalar," Econometrica, Econometric Society, vol. 52(4), pages 827-842, July.
    22. Jobson, J. D. & Korkie, Bob, 1982. "Potential performance and tests of portfolio efficiency," Journal of Financial Economics, Elsevier, vol. 10(4), pages 433-466, December.
    23. Rilstone, Paul & Veall, Michael, 1996. "Using Bootstrapped Confidence Intervals for Improved Inferences with Seemingly Unrelated Regression Equations," Econometric Theory, Cambridge University Press, vol. 12(3), pages 569-580, August.
    24. Dufour, Jean-Marie & Kiviet, Jan F., 1996. "Exact tests for structural change in first-order dynamic models," Journal of Econometrics, Elsevier, vol. 70(1), pages 39-68, January.
    25. Dufour, Jean-Marie, 1989. "Nonlinear Hypotheses, Inequality Restrictions, and Non-nested Hypotheses: Exact Simultaneous Tests in Linear Regressions," Econometrica, Econometric Society, vol. 57(2), pages 335-355, March.
    26. Evans, G B A & Savin, N E, 1982. "Conflict among the Criteria Revisited: The W, LR and LM Tests," Econometrica, Econometric Society, vol. 50(3), pages 737-748, May.
    27. Amsler, Christine E. & Schmidt, Peter, 1985. "A Monte Carlo investigation of the accuracy of multivariate CAPM tests," Journal of Financial Economics, Elsevier, vol. 14(3), pages 359-375, September.
    28. Hashimoto, Noriko & Ohtani, Kazuhiro, 1990. "An exact test for linear restrictions in seemingly unrelated regressions with the same regressors," Economics Letters, Elsevier, vol. 32(3), pages 243-246, March.
    29. Breusch, Trevor S., 1980. "Useful invariance results for generalized regression models," Journal of Econometrics, Elsevier, vol. 13(3), pages 327-340, August.
    30. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    31. Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor & Francis Journals, vol. 16(3), pages 321-352.
    32. Theil, Henri & Shonkwiler, J. S. & Taylor, Timothy G., 1985. "A Monte Carlo test of Slutsky symmetry," Economics Letters, Elsevier, vol. 19(4), pages 331-332.
    33. Christian Gouriéroux & Alain Monfort & Eric Renault, 1993. "Tests sur le noyau, l'image et le rang de la matrice des coefficients d'un modéle linéaire multivarié," Annals of Economics and Statistics, GENES, issue 32, pages 81-111.
    34. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    35. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    36. Shanken, Jay, 1986. "Testing Portfolio Efficiency When the Zero-Beta Rate Is Unknown: A Note," Journal of Finance, American Finance Association, vol. 41(1), pages 269-276, March.
    37. Jean-Marie Dufour & Lynda Khalaf, 1999. "Simulation Based Finite- and Large-Sample Inference Methods in Simultaneous Equations," Computing in Economics and Finance 1999 824, Society for Computational Economics.
    38. Italianer, Alexander, 1985. "A small-sample correction for the likelihood ratio test," Economics Letters, Elsevier, vol. 19(4), pages 315-317.
    39. Eakin, B Kelly & McMillen, Daniel P & Buono, Mark J, 1990. "Constructing Confidence Intervals Using the Bootstrap: An Application to a Multi-Product Cost Function," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 339-344, May.
    40. Rayner, Robert K., 1990. "Bartlett's correction and the bootstrap in normal linear regression models," Economics Letters, Elsevier, vol. 33(3), pages 255-258, July.
    41. Attfield, C. L. F., 1995. "A Bartlett adjustment to the likelihood ratio test for a system of equations," Journal of Econometrics, Elsevier, vol. 66(1-2), pages 207-223.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dufour, Jean-Marie & Khalaf, Lynda, 2001. "Finite-Sample Simulation-Based Tests in Seemingly Unrelated Regressions," Cahiers de recherche 0105, GREEN.
    2. Kenneth Stewart, 1997. "Exact testing in multivariate regression," Econometric Reviews, Taylor & Francis Journals, vol. 16(3), pages 321-352.
    3. Marie-Claude BEAULIEU & Jean-Marie DUFOUR & Lynda KHALAF, 2002. "Testing Mean-Variance Efficiency In Capm With Possibly Non-Gaussian Errors : An Exact Simulation-Based Approach," Cahiers de recherche 17-2002, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    4. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Exact tests for contemporaneous correlation of disturbances in seemingly unrelated regressions," Journal of Econometrics, Elsevier, vol. 106(1), pages 143-170, January.
    5. Kesavan, Thulasiram, 1988. "Monte Carlo experiments of market demand theory," ISU General Staff Papers 198801010800009854, Iowa State University, Department of Economics.
    6. Jean‐Marie Dufour & Lynda Khalaf & Marie‐Claude Beaulieu, 2003. "Exact Skewness–Kurtosis Tests for Multivariate Normality and Goodness‐of‐Fit in Multivariate Regressions with Application to Asset Pricing Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 891-906, December.
    7. Marie-Claude Beaulieu & Jean-Marie Dufour & Lynda Khalaf, 2005. "Exact Multivariate Tests of Asset Pricing Models with Stable Asymmetric Distributions," Springer Books, in: Michèle Breton & Hatem Ben-Ameur (ed.), Numerical Methods in Finance, chapter 0, pages 173-191, Springer.
    8. Saroja Selvanathan, 1991. "Regional Consumption Patterns in Australia: A System‐Wide Analysis," The Economic Record, The Economic Society of Australia, vol. 67(4), pages 338-345, December.
    9. DUFOUR, Jean-Marie & KHALAF, Lynda & BEAULIEU, Marie-Claude, 2003. "Finite-Sample Diagnostics for Multivariate Regressions with Applications to Linear Asset Pricing Models," Cahiers de recherche 2003-08, Universite de Montreal, Departement de sciences economiques.
    10. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    11. Touhami Abdelkhalek & Jean-Marie Dufour, 1998. "Statistical Inference For Computable General Equilibrium Models, With Application To A Model Of The Moroccan Economy," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 520-534, November.
    12. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2014. "Exact confidence sets and goodness-of-fit methods for stable distributions," Journal of Econometrics, Elsevier, vol. 181(1), pages 3-14.
    13. Jean-Marie Dufour & Lynda Khalaf & Marie-Claude Beaulieu, 2010. "Multivariate residual-based finite-sample tests for serial dependence and ARCH effects with applications to asset pricing models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 263-285.
    14. Sermin Gungor & Richard Luger, 2016. "Multivariate Tests of Mean-Variance Efficiency and Spanning With a Large Number of Assets and Time-Varying Covariances," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 161-175, April.
    15. Jean-Marie Dufour & Pascale Valery, 2000. "Monte Carlo Test Applied to Models Estimated by Indirect Inference," Econometric Society World Congress 2000 Contributed Papers 1667, Econometric Society.
    16. Denis Bolduc & Lynda Khalaf & Clément Yélou, 2005. "Identification Robust Confidence Sets Methods for Inference on Parameter Ratios and their Application to Estimating Value-of-Time," Computing in Economics and Finance 2005 48, Society for Computational Economics.
    17. Jean-Thomas Bernard & Nadhem Idoudi & Lynda Khalaf & Clément Yélou, 2007. "Finite sample inference methods for dynamic energy demand models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1211-1226.
    18. Dufour, Jean-Marie & Torres, Olivier, 2000. "Markovian processes, two-sided autoregressions and finite-sample inference for stationary and nonstationary autoregressive processes," Journal of Econometrics, Elsevier, vol. 99(2), pages 255-289, December.
    19. Enrique Sentana, 2009. "The econometrics of mean-variance efficiency tests: a survey," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 65-101, November.
    20. S. Selvanathan, 1987. "Do OECD Consumers Obey Demand Theory?," Economics Discussion / Working Papers 87-04, The University of Western Australia, Department of Economics.

    More about this item

    Keywords

    multivariate linear regression; seemingly unrelated regressions; uniform linear hythesis; Monte Carlo test; bounds test; nonlinear hythesis; finite same test; exact test; bootstrap;
    All these keywords.

    JEL classification:

    • C20 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mtl:montde:2000-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sharon BREWER (email available below). General contact details of provider: https://edirc.repec.org/data/demtlca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.