IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v49y2022i1p116-142.html
   My bibliography  Save this article

Multivariate conditional transformation models

Author

Listed:
  • Nadja Klein
  • Torsten Hothorn
  • Luisa Barbanti
  • Thomas Kneib

Abstract

Regression models describing the joint distribution of multivariate responses conditional on covariate information have become an important aspect of contemporary regression analysis. However, a limitation of such models are the rather simplistic assumptions often made, for example, a constant dependence structure not varying with covariates or the restriction to linear dependence between the responses. We propose a general framework for multivariate conditional transformation models that overcomes these limitations and describes the entire distribution in a tractable and interpretable yet flexible way conditional on nonlinear effects of covariates. The framework can be embedded into likelihood‐based inference, including results on asymptotic normality, and allows the dependence structure to vary with covariates. In addition, it scales well‐beyond bivariate response situations, which were the main focus of most earlier investigations. We illustrate the benefits in a trivariate analysis of childhood undernutrition and demonstrate empirically that complex truly multivariate data‐generating processes can be inferred from observations.

Suggested Citation

  • Nadja Klein & Torsten Hothorn & Luisa Barbanti & Thomas Kneib, 2022. "Multivariate conditional transformation models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(1), pages 116-142, March.
  • Handle: RePEc:bla:scjsta:v:49:y:2022:i:1:p:116-142
    DOI: 10.1111/sjos.12501
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/sjos.12501
    Download Restriction: no

    File URL: https://libkey.io/10.1111/sjos.12501?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    2. S. McKay Curtis & Sujit K. Ghosh, 2011. "A variable selection approach to monotonic regression with Bernstein polynomials," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(5), pages 961-976, February.
    3. Guillaume Carlier & Victor Chernozhukov & Alfred Galichon, 2015. "Vector quantile regression: an optimal transport approach," CeMMAP working papers 58/15, Institute for Fiscal Studies.
    4. Y. Lin, 2003. "Discriminant analysis through a semiparametric model," Biometrika, Biometrika Trust, vol. 90(2), pages 379-392, June.
    5. Torsten Hothorn & Thomas Kneib & Peter Bühlmann, 2014. "Conditional transformation models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 3-27, January.
    6. Levi, Evgeny & Craiu, Radu V., 2018. "Bayesian inference for conditional copulas using Gaussian Process single index models," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 115-134.
    7. Nadja Klein & Thomas Kneib & Stephan Klasen & Stefan Lang, 2015. "Bayesian structured additive distributional regression for multivariate responses," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 64(4), pages 569-591, August.
    8. Torsten Hothorn & Lisa Möst & Peter Bühlmann, 2018. "Most Likely Transformations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 45(1), pages 110-134, March.
    9. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    10. Peter Xue‐Kun Song, 2000. "Multivariate Dispersion Models Generated From Gaussian Copula," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(2), pages 305-320, June.
    11. Stefan Lang & Samson B. Adebayo & Ludwig Fahrmeir & Winfried J. Steiner, 2003. "Bayesian Geoadditive Seemingly Unrelated Regression," Computational Statistics, Springer, vol. 18(2), pages 263-292, July.
    12. repec:hal:spmain:info:hdl:2441/4c5431jp6o888pdrcs0fuirl40 is not listed on IDEAS
    13. Elif F. Acar & Radu V. Craiu & Fang Yao, 2011. "Dependence Calibration in Conditional Copulas: A Nonparametric Approach," Biometrics, The International Biometric Society, vol. 67(2), pages 445-453, June.
    14. Marc Hallin & Davy Paindaveine & Miroslav Siman, 2008. "Multivariate quantiles and multiple-output regression quantiles: from L1 optimization to halfspace depth," Working Papers ECARES 2008_042, ULB -- Universite Libre de Bruxelles.
    15. Vatter, Thibault & Chavez-Demoulin, Valérie, 2015. "Generalized additive models for conditional dependence structures," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 147-167.
    16. Holger Dette & Ria Van Hecke & Stanislav Volgushev, 2014. "Some Comments on Copula-Based Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1319-1324, September.
    17. Manuguerra Maurizio & Heller Gillian Z, 2010. "Ordinal Regression Models for Continuous Scales," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-20, April.
    18. Robert Serfling, 2002. "Quantile functions for multivariate analysis: approaches and applications," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 56(2), pages 214-232, May.
    19. R. A. Rigby & D. M. Stasinopoulos, 2005. "Generalized additive models for location, scale and shape," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(3), pages 507-554, June.
    20. Jianqing Fan & Lingzhou Xue & Hui Zou, 2016. "Multitask Quantile Regression Under the Transnormal Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1726-1735, October.
    21. Fahrmeir, Ludwig & Kneib, Thomas, 2011. "Bayesian Smoothing and Regression for Longitudinal, Spatial and Event History Data," OUP Catalogue, Oxford University Press, number 9780199533022.
    22. Marra, Giampiero & Radice, Rosalba, 2017. "Bivariate copula additive models for location, scale and shape," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 99-113.
    23. Carlier, Guillaume & Chernozhukov, Victor & Galichon, Alfred, 2017. "Vector quantile regression beyond the specified case," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 96-102.
    24. Noël Veraverbeke & Marek Omelka & Irène Gijbels, 2011. "Estimation of a Conditional Copula and Association Measures," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 38(4), pages 766-780, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nicolai Hans & Nadja Klein & Florian Faschingbauer & Michael Schneider & Andreas Mayr, 2023. "Boosting distributional copula regression," Biometrics, The International Biometric Society, vol. 79(3), pages 2298-2310, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kneib, Thomas & Silbersdorff, Alexander & Säfken, Benjamin, 2023. "Rage Against the Mean – A Review of Distributional Regression Approaches," Econometrics and Statistics, Elsevier, vol. 26(C), pages 99-123.
    2. Wiemann, Paul F.V. & Klein, Nadja & Kneib, Thomas, 2022. "Correcting for sample selection bias in Bayesian distributional regression models," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    3. Marra, Giampiero & Radice, Rosalba, 2017. "Bivariate copula additive models for location, scale and shape," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 99-113.
    4. Grazian, Clara & Dalla Valle, Luciana & Liseo, Brunero, 2022. "Approximate Bayesian conditional copulas," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    5. Maike Hohberg & Francesco Donat & Giampiero Marra & Thomas Kneib, 2021. "Beyond unidimensional poverty analysis using distributional copula models for mixed ordered‐continuous outcomes," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(5), pages 1365-1390, November.
    6. Balcilar, Mehmet & Ozdemir, Zeynel Abidin & Ozdemir, Huseyin & Wohar, Mark E., 2020. "Transmission of US and EU Economic Policy Uncertainty Shock to Asian Economies in Bad and Good Times," IZA Discussion Papers 13274, Institute of Labor Economics (IZA).
    7. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    8. Alexander Silbersdorff & Kai Sebastian Schneider, 2019. "Distributional Regression Techniques in Socioeconomic Research on the Inequality of Health with an Application on the Relationship between Mental Health and Income," IJERPH, MDPI, vol. 16(20), pages 1-28, October.
    9. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    10. Alexander März & Nadja Klein & Thomas Kneib & Oliver Musshoff, 2016. "Analysing farmland rental rates using Bayesian geoadditive quantile regression," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 43(4), pages 663-698.
    11. Daouia, Abdelaati & Paindaveine, Davy, 2019. "Multivariate Expectiles, Expectile Depth and Multiple-Output Expectile Regression," TSE Working Papers 19-1022, Toulouse School of Economics (TSE), revised Feb 2023.
    12. Derumigny Alexis & Fermanian Jean-David, 2017. "About tests of the “simplifying” assumption for conditional copulas," Dependence Modeling, De Gruyter, vol. 5(1), pages 154-197, August.
    13. Yuanhua Feng & Wolfgang Karl Härdle, 2021. "Uni- and multivariate extensions of the sinh-arcsinh normal distribution applied to distributional regression," Working Papers CIE 142, Paderborn University, CIE Center for International Economics.
    14. Levi, Evgeny & Craiu, Radu V., 2018. "Bayesian inference for conditional copulas using Gaussian Process single index models," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 115-134.
    15. Nadja Klein & Thomas Kneib, 2020. "Directional bivariate quantiles: a robust approach based on the cumulative distribution function," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(2), pages 225-260, June.
    16. repec:hal:spmain:info:hdl:2441/3qnaslliat80pbqa8t90240unj is not listed on IDEAS
    17. Thomas Kneib & Nadja Klein & Stefan Lang & Nikolaus Umlauf, 2019. "Modular regression - a Lego system for building structured additive distributional regression models with tensor product interactions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(1), pages 1-39, March.
    18. repec:hal:spmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    19. Nicolai Hans & Nadja Klein & Florian Faschingbauer & Michael Schneider & Andreas Mayr, 2023. "Boosting distributional copula regression," Biometrics, The International Biometric Society, vol. 79(3), pages 2298-2310, September.
    20. Craiu, V. Radu & Sabeti, Avideh, 2012. "In mixed company: Bayesian inference for bivariate conditional copula models with discrete and continuous outcomes," Journal of Multivariate Analysis, Elsevier, vol. 110(C), pages 106-120.
    21. Daniel Hlubinka & Lukáš Kotík & Miroslav Šiman, 2022. "Multivariate quantiles with both overall and directional probability interpretation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(4), pages 1586-1604, December.
    22. Jaeun Choi & A. James O'Malley, 2017. "Estimating the causal effect of treatment in observational studies with survival time end points and unmeasured confounding," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(1), pages 159-185, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:49:y:2022:i:1:p:116-142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.