IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v188y2022ics0047259x21001275.html
   My bibliography  Save this article

Matrix differential calculus with applications in the multivariate linear model and its diagnostics

Author

Listed:
  • Liu, Shuangzhe
  • Leiva, Víctor
  • Zhuang, Dan
  • Ma, Tiefeng
  • Figueroa-Zúñiga, Jorge I.

Abstract

Matrix differential calculus is a powerful mathematical tool in multivariate analysis and related areas such as econometrics, environmetrics, geostatistics, predictive modeling, psychometrics, and statistics in general. One of the key contributions to its development was the introduction of the differential approach, which has led to a significant number of applications. In this paper, we present a study of this approach to matrix differential calculus with some of its key results along with illustrative examples. We also present new applications of this approach in the multivariate linear model: namely in efficiency comparisons, sensitivity analysis, and local influence diagnostics.

Suggested Citation

  • Liu, Shuangzhe & Leiva, Víctor & Zhuang, Dan & Ma, Tiefeng & Figueroa-Zúñiga, Jorge I., 2022. "Matrix differential calculus with applications in the multivariate linear model and its diagnostics," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    • Handle: RePEc:eee:jmvana:v:188:y:2022:i:c:s0047259x21001275
    DOI: 10.1016/j.jmva.2021.104849
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X21001275
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2021.104849?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Shuangzhe & Ma, Tiefeng & Polasek, Wolfgang, 2014. "Spatial system estimators for panel models: A sensitivity and simulation study," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 101(C), pages 78-102.
    2. Magnus, J.R. & Neudecker, H., 1985. "Matrix differential calculus with applications to simple, Hadamard, and Kronecker products," Other publications TiSEM 1b2f1740-bfd1-4ea5-986c-9, Tilburg University, School of Economics and Management.
    3. Francisco J. A. Cysneiros & Víctor Leiva & Shuangzhe Liu & Carolina Marchant & Paulo Scalco, 2019. "A Cobb–Douglas type model with stochastic restrictions: formulation, local influence diagnostics and data analytics in economics," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 1693-1719, July.
    4. Fukang Zhu & Shuangzhe Liu & Lei Shi, 2016. "Local influence analysis for Poisson autoregression with an application to stock transaction data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 70(1), pages 4-25, February.
    5. Yonghui Liu & Ruochen Sang & Shuangzhe Liu, 2017. "Diagnostic analysis for a vector autoregressive model under Student-super-′s t-distributions," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 71(2), pages 86-114, May.
    6. Brinkhuis, Jan, 2015. "On the use of coordinate-free matrix calculus," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 377-381.
    7. S. Liu & T. Ma & A. SenGupta & K. Shimizu & M.-Z. Wang, 2017. "Influence Diagnostics in Possibly Asymmetric Circular-Linear Multivariate Regression Models," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 79(1), pages 76-93, May.
    8. von Rosen, Dietrich, 1989. "Maximum likelihood estimators in multivariate linear normal models," Journal of Multivariate Analysis, Elsevier, vol. 31(2), pages 187-200, November.
    9. H. Neudecker, 1967. "On matrix procedures for optimizing differentiable scalar functions of matrices," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 21(1), pages 101-107, March.
    10. Magnus, Jan R. & Neudecker, H., 1986. "Symmetry, 0-1 Matrices and Jacobians: A Review," Econometric Theory, Cambridge University Press, vol. 2(2), pages 157-190, August.
    11. Heinz Neudecker & Shuangzhe Liu, 2001. "Some statistical properties of Hadamard products of random matrices," Statistical Papers, Springer, vol. 42(4), pages 475-487, October.
    12. Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
    13. Kollo, T. & Neudecker, H., 1993. "Asymptotics of Eigenvalues and Unit-Length Eigenvectors of Sample Variance and Correlation Matrices," Journal of Multivariate Analysis, Elsevier, vol. 47(2), pages 283-300, November.
    14. Heinz Neudecker & Shuangzhe Liu, 2001. "Statistical properties of the Hadamard product of random vectors," Statistical Papers, Springer, vol. 42(4), pages 529-533, October.
    15. Víctor Leiva & Shuangzhe Liu & Lei Shi & Francisco José A. Cysneiros, 2016. "Diagnostics in elliptical regression models with stochastic restrictions applied to econometrics," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(4), pages 627-642, March.
    16. Magnus, Jan R., 1985. "On Differentiating Eigenvalues and Eigenvectors," Econometric Theory, Cambridge University Press, vol. 1(2), pages 179-191, August.
    17. Magnus, J.R. & Neudecker, H., 1980. "The elimination matrix : Some lemmas and applications," Other publications TiSEM 0e3315d3-846c-4bc5-928e-f, Tilburg University, School of Economics and Management.
    18. Turkington,Darrell A., 2013. "Generalized Vectorization, Cross-Products, and Matrix Calculus," Cambridge Books, Cambridge University Press, number 9781107032002.
    19. Khatri, C. G. & Rao, C. Radhakrishna, 1981. "Some extensions of the Kantorovich inequality and statistical applications," Journal of Multivariate Analysis, Elsevier, vol. 11(4), pages 498-505, December.
    20. Shuangzhe Liu & Chris Heyde, 2008. "On estimation in conditional heteroskedastic time series models under non-normal distributions," Statistical Papers, Springer, vol. 49(3), pages 455-469, July.
    21. Neudecker, H., 1980. "A comment on "minimization of functions of a positive simidefinite matrix A subject to AX = 0"," Journal of Multivariate Analysis, Elsevier, vol. 10(1), pages 135-139, March.
    22. Carolina Marchant & Víctor Leiva & Francisco José A. Cysneiros & Juan F. Vivanco, 2016. "Diagnostics in multivariate generalized Birnbaum-Saunders regression models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(15), pages 2829-2849, November.
    23. Caro-Lopera, Francisco J. & Leiva, Víctor & Balakrishnan, N., 2012. "Connection between the Hadamard and matrix products with an application to matrix-variate Birnbaum-Saunders distributions," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 126-139, February.
    24. Liu, Shuangzhe & Neudecker, Heinz, 2009. "On pseudo maximum likelihood estimation for multivariate time series models with conditional heteroskedasticity," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(8), pages 2556-2565.
    25. Yonghui Liu & Chaoxuan Mao & Víctor Leiva & Shuangzhe Liu & Waldemiro A. Silva Neto, 2022. "Asymmetric autoregressive models: statistical aspects and a financial application under COVID-19 pandemic," Journal of Applied Statistics, Taylor & Francis Journals, vol. 49(5), pages 1323-1347, April.
    26. Magnus, Jan R., 2010. "On the concept of matrix derivative," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 2200-2206, October.
    27. repec:wop:ubisop:0081 is not listed on IDEAS
    28. H. Neudecker, 1981. "On the matrix formulation of Kaiser's varimax criterion," Psychometrika, Springer;The Psychometric Society, vol. 46(3), pages 343-345, September.
    29. Magnus, J.R. & Neudecker, H., 1979. "The commutation matrix : Some properties and applications," Other publications TiSEM d0b1e779-7795-4676-ac98-1, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saulo, Helton & Vila, Roberto & Cordeiro, Shayane S. & Leiva, Víctor, 2023. "Bivariate symmetric Heckman models and their characterization," Journal of Multivariate Analysis, Elsevier, vol. 193(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. D.A. Turkington, 1997. "Some results in matrix calculus and an example of their application to econometrics," Economics Discussion / Working Papers 97-07, The University of Western Australia, Department of Economics.
    2. Eduardo Abi Jaber & Bruno Bouchard & Camille Illand & Eduardo Jaber, 2018. "Stochastic invariance of closed sets with non-Lipschitz coefficients," Working Papers hal-01349639, HAL.
    3. Eduardo Abi Jaber & Bruno Bouchard & Camille Illand & Eduardo Abi Jaber, 2018. "Stochastic invariance of closed sets with non-Lipschitz coefficients," Post-Print hal-01349639, HAL.
    4. Abi Jaber, Eduardo & Bouchard, Bruno & Illand, Camille, 2019. "Stochastic invariance of closed sets with non-Lipschitz coefficients," Stochastic Processes and their Applications, Elsevier, vol. 129(5), pages 1726-1748.
    5. Turkington, Darrell A., 1998. "Efficient estimation in the linear simultaneous equations model with vector autoregressive disturbances," Journal of Econometrics, Elsevier, vol. 85(1), pages 51-74, July.
    6. Yonghui Liu & Guohua Mao & Víctor Leiva & Shuangzhe Liu & Alejandra Tapia, 2020. "Diagnostic Analytics for an Autoregressive Model under the Skew-Normal Distribution," Mathematics, MDPI, vol. 8(5), pages 1-19, May.
    7. Alejandra Tapia & Victor Leiva & Maria del Pilar Diaz & Viviana Giampaoli, 2019. "Influence diagnostics in mixed effects logistic regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 920-942, September.
    8. Reinaldo B. Arellano-Valle & Adelchi Azzalini, 2022. "Some properties of the unified skew-normal distribution," Statistical Papers, Springer, vol. 63(2), pages 461-487, April.
    9. Ong, Victor M.-H. & Nott, David J. & Tran, Minh-Ngoc & Sisson, Scott A. & Drovandi, Christopher C., 2018. "Likelihood-free inference in high dimensions with synthetic likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 271-291.
    10. Dovonon, Prosper & Taamouti, Abderrahim & Williams, Julian, 2022. "Testing the eigenvalue structure of spot and integrated covariance," Journal of Econometrics, Elsevier, vol. 229(2), pages 363-395.
    11. Stephen Pollock, 2011. "On Kronecker Products, Tensor Products And Matrix Differential Calculus," Discussion Papers in Economics 11/34, Division of Economics, School of Business, University of Leicester, revised Jul 2011.
    12. Manuel Galea & Patricia Giménez, 2019. "Local influence diagnostics for the test of mean–variance efficiency and systematic risks in the capital asset pricing model," Statistical Papers, Springer, vol. 60(1), pages 293-312, February.
    13. Liu, Shuangzhe & Ma, Tiefeng & Polasek, Wolfgang, 2014. "Spatial system estimators for panel models: A sensitivity and simulation study," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 101(C), pages 78-102.
    14. Shanshan Hu & Yongxin Yuan, 2023. "Common Solutions to the Matrix Equations $$AX=B$$ A X = B and $$XC=D$$ X C = D on a Subspace," Journal of Optimization Theory and Applications, Springer, vol. 198(1), pages 372-386, July.
    15. Shuangzhe Liu & Chris Heyde & Wing-Keung Wong, 2011. "Moment matrices in conditional heteroskedastic models under elliptical distributions with applications in AR-ARCH models," Statistical Papers, Springer, vol. 52(3), pages 621-632, August.
    16. D. Stephen G. Pollock, 2021. "Multidimensional Arrays, Indices and Kronecker Products," Econometrics, MDPI, vol. 9(2), pages 1-15, April.
    17. Kentaro Hayashi & Yiu-Fai Yung, 1999. "Standard errors for the class of orthomax-rotated factor loadings: Some matrix results," Psychometrika, Springer;The Psychometric Society, vol. 64(4), pages 451-460, December.
    18. Christian Gische & Manuel C. Voelkle, 2022. "Beyond the Mean: A Flexible Framework for Studying Causal Effects Using Linear Models," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 868-901, September.
    19. Boik, Robert J., 1998. "A Local Parameterization of Orthogonal and Semi-Orthogonal Matrices with Applications," Journal of Multivariate Analysis, Elsevier, vol. 67(2), pages 244-276, November.
    20. Caswell, Hal & Shyu, Esther, 2012. "Sensitivity analysis of periodic matrix population models," Theoretical Population Biology, Elsevier, vol. 82(4), pages 329-339.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:188:y:2022:i:c:s0047259x21001275. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.