Recovering Model Structures from Large Low Rank and Sparse Covariance Matrix Estimation
Many popular statistical models, such as factor and random effects models, give arise a certain type of covariance structures that is a summation of low rank and sparse matrices. This paper introduces a penalized approximation framework to recover such model structures from large covariance matrix estimation. We propose an estimator based on minimizing a non-likelihood loss with separable non-smooth penalty functions. This estimator is shown to recover exactly the rank and sparsity patterns of these two components, and thus partially recovers the model structures. Convergence rates under various matrix norms are also presented. To compute this estimator, we further develop a first-order iterative algorithm to solve a convex optimization problem that contains separa- ble non-smooth functions, and the algorithm is shown to produce a solution within O(1/t^2) of the optimal, after any finite t iterations. Numerical performance is illustrated using simulated data and stock portfolio selection on S&P 100.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jos Berge & Henk Kiers, 1991. "A numerical approach to the approximate and the exact minimum rank of a covariance matrix," Psychometrika, Springer, vol. 56(2), pages 309-315, June.
- Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
- Chamberlain, Gary & Rothschild, Michael, 1982.
"Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets,"
3230355, Harvard University Department of Economics.
- Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-304, September.
- Gary Chamberlain & Michael Rothschild, 1982. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," NBER Working Papers 0996, National Bureau of Economic Research, Inc.
- Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
- Jianhua Z. Huang & Naiping Liu & Mohsen Pourahmadi & Linxu Liu, 2006. "Covariance matrix selection and estimation via penalised normal likelihood," Biometrika, Biometrika Trust, vol. 93(1), pages 85-98, March.
- Ledoit, Olivier & Wolf, Michael, 2003.
"Improved estimation of the covariance matrix of stock returns with an application to portfolio selection,"
Journal of Empirical Finance,
Elsevier, vol. 10(5), pages 603-621, December.
- Olivier Ledoit & Michael Wolf, 2001. "Improved estimation of the covariance matrix of stock returns with an application to portofolio selection," Economics Working Papers 586, Department of Economics and Business, Universitat Pompeu Fabra.
- Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
- Wei Biao Wu, 2003. "Nonparametric estimation of large covariance matrices of longitudinal data," Biometrika, Biometrika Trust, vol. 90(4), pages 831-844, December.
- Johnstone, Iain M. & Lu, Arthur Yu, 2009. "On Consistency and Sparsity for Principal Components Analysis in High Dimensions," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 682-693.
- Ross, Stephen A., 1976. "The arbitrage theory of capital asset pricing," Journal of Economic Theory, Elsevier, vol. 13(3), pages 341-360, December.
- Rothman, Adam J. & Levina, Elizaveta & Zhu, Ji, 2009. "Generalized Thresholding of Large Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 177-186.
- Fama, Eugene F & French, Kenneth R, 1992. " The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-65, June.
- Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
- Cai, Tony & Liu, Weidong, 2011. "Adaptive Thresholding for Sparse Covariance Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 672-684.
- Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, 09.
When requesting a correction, please mention this item's handle: RePEc:arx:papers:1111.1133. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (arXiv administrators)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.