IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v29y2014i3p529-546.html
   My bibliography  Save this article

Sensitivity analysis for inference with partially identifiable covariance matrices

Author

Listed:
  • Max G’Sell
  • Shai Shen-Orr
  • Robert Tibshirani

Abstract

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is only partially identifiable, and point estimation requires that identifying assumptions be made. These assumptions can introduce an unknown and potentially large bias into the inference. This paper presents a method based on semidefinite programming for automatically quantifying this potential bias by computing the range of possible equal-likelihood inferred values for convex functions of the covariance matrix. We focus on the bias of missing value imputation via conditional expectation and show that our method can give an accurate assessment of the true error in cases where estimates based on sampling uncertainty alone are overly optimistic. Copyright Springer-Verlag Berlin Heidelberg 2014

Suggested Citation

  • Max G’Sell & Shai Shen-Orr & Robert Tibshirani, 2014. "Sensitivity analysis for inference with partially identifiable covariance matrices," Computational Statistics, Springer, vol. 29(3), pages 529-546, June.
  • Handle: RePEc:spr:compst:v:29:y:2014:i:3:p:529-546
    DOI: 10.1007/s00180-013-0451-4
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00180-013-0451-4
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s00180-013-0451-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rubin, Donald B, 1986. "Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 87-94, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nickolay Trendafilov & Martin Kleinsteuber & Hui Zou, 2014. "Sparse matrices in data analysis," Computational Statistics, Springer, vol. 29(3), pages 403-405, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joost Ginkel & Pieter Kroonenberg, 2014. "Using Generalized Procrustes Analysis for Multiple Imputation in Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 31(2), pages 242-269, July.
    2. Norah Alyabs & Sy Han Chiou, 2022. "The Missing Indicator Approach for Accelerated Failure Time Model with Covariates Subject to Limits of Detection," Stats, MDPI, vol. 5(2), pages 1-13, May.
    3. Michael S. Rendall & Bonnie Ghosh-Dastidar & Margaret M. Weden & Zafar Nazarov, 2011. "Multiple Imputation for Combined-Survey Estimation With Incomplete Regressors In One But Not Both Surveys," Working Papers WR-887-1, RAND Corporation.
    4. Joost R. Ginkel, 2020. "Standardized Regression Coefficients and Newly Proposed Estimators for $${R}^{{2}}$$R2 in Multiply Imputed Data," Psychometrika, Springer;The Psychometric Society, vol. 85(1), pages 185-205, March.
    5. Arif Mamun & Ankita Patnaik & Michael Levere & Gina Livermore & Todd Honeycutt & Jacqueline Kauff & Karen Katz & AnnaMaria McCutcheon & Joseph Mastrianni & Brittney Gionfriddo, "undated". "Promoting Readiness of Minors in Supplemental Security Income (PROMISE): Technical Appendix to the Interim Services and Impact Report," Mathematica Policy Research Reports 24c37444a21d4046abb21395a, Mathematica Policy Research.
    6. Hao Dong & Daniel L. Millimet, 2020. "Propensity Score Weighting with Mismeasured Covariates: An Application to Two Financial Literacy Interventions," JRFM, MDPI, vol. 13(11), pages 1-24, November.
    7. Anil Alpman, 2015. "Implementing Rubin's Alternative Multiple Imputation Method for Statistical Matching in Stata," Post-Print hal-01159191, HAL.
    8. Lamarche, Pierre, 2017. "Estimating consumption in the HFCS: Experimental results on the first wave of the HFCS," Statistics Paper Series 22, European Central Bank.
    9. Keane, Michael & Stavrunova, Olena, 2016. "Adverse selection, moral hazard and the demand for Medigap insurance," Journal of Econometrics, Elsevier, vol. 190(1), pages 62-78.
    10. Gina Yannitell Reinhardt, 2009. "Matching Donors and Nonprofits," Journal of Theoretical Politics, , vol. 21(3), pages 283-309, July.
    11. Westermeier, Christian & Grabka, Markus M., 2016. "Longitudinal Wealth Data and Multiple Imputation: An Evaluation Study," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10(3), pages 237-252.
    12. Marcello D’Orazio, 2015. "Integration and imputation of survey data in R: the StatMatch package," Romanian Statistical Review, Romanian Statistical Review, vol. 63(2), pages 57-68, June.
    13. Arif Mamun & David Wittenburg & Noelle Denny-Brown & Michael Levere & David Mann & Rebecca Coughlin & Sarah Croake & Heather Gordon & Denise Hoffman & Rachel Holzwart & Rosalind Keith & Brittany McGil, "undated". "Promoting Opportunity Demonstration: Interim Evaluation Report," Mathematica Policy Research Reports caa99d38a8b14f968ea3438e5, Mathematica Policy Research.
    14. Chiara Elena Dalla & Menon Martina & Perali Federico, 2019. "An Integrated Database to Measure Living Standards," Journal of Official Statistics, Sciendo, vol. 35(3), pages 531-576, September.
    15. François Gardes, 2019. "The Estimation of Price Elasticities and the Value of Time in a Domestic Production Framework: an Application using French Micro-Data," Post-Print hal-01478052, HAL.
    16. François Gardes, 2019. "The Estimation of Price Elasticities and the Value of Time in a Domestic Production Framework: an Application using French Micro-Data," PSE-Ecole d'économie de Paris (Postprint) hal-01478052, HAL.
    17. Brownstone, David & Golob, Thomas F., 1992. "The effectiveness of ridesharing incentives: Discrete-choice models of commuting in Southern California," Regional Science and Urban Economics, Elsevier, vol. 22(1), pages 5-24, March.
    18. Baltussen, Guido & Swinkels, Laurens & Van Vliet, Pim, 2021. "Global factor premiums," Journal of Financial Economics, Elsevier, vol. 142(3), pages 1128-1154.
    19. Sean Mc Auliffe & Georg U. Thunecke & Georg Wamser, 2023. "The Tax-Elasticity of Tangible Fixed Assets: Evidence from Novel Corporate Tax Data," CESifo Working Paper Series 10628, CESifo.
    20. Leonie C. Steckermeier & Jan Delhey, 2019. "Better for Everyone? Egalitarian Culture and Social Wellbeing in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(3), pages 1075-1108, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:29:y:2014:i:3:p:529-546. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.