IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v8y2025i2p40-d1659287.html
   My bibliography  Save this article

An Analysis of Vectorised Automatic Differentiation for Statistical Applications

Author

Listed:
  • Chun Fung Kwok

    (St. Vincent’s Institute of Medical Research, Melbourne 3065, Australia)

  • Dan Zhu

    (Department of Econometrics and Business Statistics, Monash University, Melbourne 3800, Australia)

  • Liana Jacobi

    (Department of Economics, University of Melbourne, Melbourne 3010, Australia)

Abstract

Automatic differentiation (AD) is a general method for computing exact derivatives in complex sensitivity analyses and optimisation tasks, particularly when closed-form solutions are unavailable and traditional analytical or numerical methods fall short. This paper introduces a vectorised formulation of AD grounded in matrix calculus. It aligns naturally with the matrix-oriented style prevalent in statistics, supports convenient implementations, and takes advantage of sparse matrix representation and other high-level optimisation techniques that are not available in the scalar counterpart. Our formulation is well-suited to high-dimensional statistical applications, where finite differences (FD) scale poorly due to the need to repeat computations for each input dimension, resulting in significant overhead, and is advantageous in simulation-intensive settings—such as Markov Chain Monte Carlo (MCMC)-based inference—where FD requires repeated sampling and multiple function evaluations, while AD can compute exact derivatives in a single pass, substantially reducing computational cost. Numerical studies are presented to demonstrate the efficacy and speed of the proposed AD method compared with FD schemes.

Suggested Citation

  • Chun Fung Kwok & Dan Zhu & Liana Jacobi, 2025. "An Analysis of Vectorised Automatic Differentiation for Statistical Applications," Stats, MDPI, vol. 8(2), pages 1-27, May.
    • Handle: RePEc:gam:jstats:v:8:y:2025:i:2:p:40-:d:1659287
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/8/2/40/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/8/2/40/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geweke, John & Zhou, Guofu, 1996. "Measuring the Pricing Error of the Arbitrage Pricing Theory," The Review of Financial Studies, Society for Financial Studies, vol. 9(2), pages 557-587.
    2. Genevera I. Allen & Logan Grosenick & Jonathan Taylor, 2014. "A Generalized Least-Square Matrix Decomposition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 145-159, March.
    3. Brennan, Michael J. & Chordia, Tarun & Subrahmanyam, Avanidhar, 1998. "Alternative factor specifications, security characteristics, and the cross-section of expected stock returns," Journal of Financial Economics, Elsevier, vol. 49(3), pages 345-373, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cederburg, Scott & O’Doherty, Michael S., 2015. "Asset-pricing anomalies at the firm level," Journal of Econometrics, Elsevier, vol. 186(1), pages 113-128.
    2. Chu Zhang, 2009. "Testing the APT with the Maximum Sharpe Ratio of Extracted Factors," Management Science, INFORMS, vol. 55(7), pages 1255-1266, July.
    3. Mumtaz, Haroon & Theodoridis, Konstantinos, 2017. "Common and country specific economic uncertainty," Journal of International Economics, Elsevier, vol. 105(C), pages 205-216.
    4. Pastor, Lubos & Stambaugh, Robert F., 2003. "Liquidity Risk and Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 642-685, June.
    5. Eero Pätäri & Timo Leivo, 2017. "A Closer Look At Value Premium: Literature Review And Synthesis," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 79-168, February.
    6. Andres, Christian & Cumming, Douglas & Karabiber, Timur & Schweizer, Denis, 2014. "Do markets anticipate capital structure decisions? — Feedback effects in equity liquidity," Journal of Corporate Finance, Elsevier, vol. 27(C), pages 133-156.
    7. Srikanth Parthasarathy, 2010. "Price and Volume Effects Associated with Index Additions: Evidence from the Indian Stock Market," Asian Journal of Finance & Accounting, Macrothink Institute, vol. 2(2), pages 5580-5580, December.
    8. Sabbaghi, Omid & Sabbaghi, Navid, 2011. "Carbon Financial Instruments, thin trading, and volatility: Evidence from the Chicago Climate Exchange," The Quarterly Review of Economics and Finance, Elsevier, vol. 51(4), pages 399-407.
    9. Manapon Limkriangkrai & Robert B. Durand & Iain Watson, 2008. "Is liquidity the missing link?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 48(5), pages 829-845, December.
    10. Gregor Kastner & Sylvia Fruhwirth-Schnatter & Hedibert Freitas Lopes, 2016. "Efficient Bayesian Inference for Multivariate Factor Stochastic Volatility Models," Papers 1602.08154, arXiv.org, revised Jul 2017.
    11. Ciciretti, Rocco & Dalò, Ambrogio & Dam, Lammertjan, 2023. "The contributions of betas versus characteristics to the ESG premium," Journal of Empirical Finance, Elsevier, vol. 71(C), pages 104-124.
    12. Mu-Shun Wang & Shaio Yan Huang & An An Chiu, 2011. "Liquidity, Management Effort And Performance," Global Journal of Business Research, The Institute for Business and Finance Research, vol. 5(1), pages 1-14.
    13. Lijuan Zhang & Mark Wilson, 2018. "Does the accruals quality premium arise from information risk?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 58(2), pages 599-632, June.
    14. Hedibert Freitas Lopes, 2014. "A Tutorial on the Computation of Bayes Factors," Business and Economics Working Papers 200, Unidade de Negocios e Economia, Insper.
    15. Bauer, Rob & Cosemans, Mathijs & Eichholtz, Piet, 2009. "Option trading and individual investor performance," Journal of Banking & Finance, Elsevier, vol. 33(4), pages 731-746, April.
    16. Filippo Ferroni & Benjamin Klaus, 2015. "Euro Area business cycles in turbulent times: convergence or decoupling?," Applied Economics, Taylor & Francis Journals, vol. 47(34-35), pages 3791-3815, July.
    17. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    18. D. L. Wilcox & T. J. Gebbie, 2013. "On pricing kernels, information and risk," Papers 1310.4067, arXiv.org, revised Oct 2013.
    19. Thomas Paul & Thomas Walther & André Küster-Simic, 2022. "Empirical analysis of the illiquidity premia of German real estate securities," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 36(2), pages 203-260, June.
    20. Aßmann, Christian & Boysen-Hogrefe, Jens & Pape, Markus, 2012. "The directional identification problem in Bayesian factor analysis: An ex-post approach," Kiel Working Papers 1799, Kiel Institute for the World Economy (IfW Kiel).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:8:y:2025:i:2:p:40-:d:1659287. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.