This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Covariance-regularized regression and classification for high dimensional problems

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Daniela M. Witten
Robert Tibshirani
Abstract

We propose covariance-regularized regression, a family of methods for prediction in high dimensional settings that uses a shrunken estimate of the inverse covariance matrix of the features to achieve superior prediction. An estimate of the inverse covariance matrix is obtained by maximizing the log-likelihood of the data, under a multivariate normal model, subject to a penalty; it is then used to estimate coefficients for the regression of the response onto the features. We show that ridge regression, the lasso and the elastic net are special cases of covariance-regularized regression, and we demonstrate that certain previously unexplored forms of covariance-regularized regression can outperform existing methods in a range of situations. The covariance-regularized regression framework is extended to generalized linear models and linear discriminant analysis, and is used to analyse gene expression data sets with multiple class and survival outcomes. Copyright (c) 2009 Royal Statistical Society.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.blackwell-synergy.com/doi/abs/10.1111/j.1467-9868.2009.00699.x
File Format: text/html
File Function: link to full text
Download Restriction: Access to full text is restricted to subscribers.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Article provided by Royal Statistical Society in its journal Journal of the Royal Statistical Society: Series B (Statistical Methodology).

Volume (Year): 71 (2009)
Issue (Month): 3 ()
Pages: 615-636
Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Handle: RePEc:bla:jorssb:v:71:y:2009:i:3:p:615-636

Contact details of provider:
Web page: http://www.blackwellpublishing.com/journal.asp?ref=1369-7412

Order Information:
Web: http://www.blackwellpublishing.com/subs.asp?ref=1369-7412

For technical questions regarding this item, or to correct its listing, contact: (Christopher F. Baum).

Related research
Keywords:

Statistics
Access and download statistics

Did you know? You can import bibliographic info in various formats into you bibliographic tool, or just into your word processor. See under "publisher info" on each abstract page.

This page was last updated on 2009-12-19.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.