IDEAS home Printed from https://ideas.repec.org/p/hal/cesptp/hal-00642732.html
   My bibliography  Save this paper

Consistent Noisy Independent Component Analysis

Author

Listed:
  • Stéphane Bonhomme

    (CEMFI - Centre de Estudios monetarios y financierios - Banco de España)

  • Jean-Marc Robin

    (CES - Centre d'économie de la Sorbonne - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique, PSE - Paris School of Economics - UP1 - Université Paris 1 Panthéon-Sorbonne - ENS-PSL - École normale supérieure - Paris - PSL - Université Paris Sciences et Lettres - EHESS - École des hautes études en sciences sociales - ENPC - École des Ponts ParisTech - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement)

Abstract

We study linear factor models under the assumptions that factors are mutually independent and independent of errors, and errors can be correlated to some extent. Under the factor non-Gaussianity, second-to-fourth-order moments are shown to yield full identification of the matrix of factor loadings. We develop a simple algorithm to estimate the matrix of factor loadings from these moments. We run Monte Carlo simulations and apply our methodology to data on cognitive test scores, and financial data on stock returns.

Suggested Citation

  • Stéphane Bonhomme & Jean-Marc Robin, 2009. "Consistent Noisy Independent Component Analysis," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00642732, HAL.
  • Handle: RePEc:hal:cesptp:hal-00642732
    DOI: 10.1016/j.jeconom.2008.12.019
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    2. Mencía, Javier & Sentana, Enrique, 2009. "Multivariate location-scale mixtures of normals and mean-variance-skewness portfolio allocation," Journal of Econometrics, Elsevier, vol. 153(2), pages 105-121, December.
    3. Henry Kaiser, 1958. "The varimax criterion for analytic rotation in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(3), pages 187-200, September.
    4. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    5. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    6. Stéphane Bonhomme & Jean-Marc Robin, 2010. "Generalized Non-Parametric Deconvolution with an Application to Earnings Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(2), pages 491-533.
    7. Stephen A. Ross, 2013. "The Arbitrage Theory of Capital Asset Pricing," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 1, pages 11-30, World Scientific Publishing Co. Pte. Ltd..
    8. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    9. Chudik, Alexander & Pesaran, M. Hashem, 2011. "Infinite-dimensional VARs and factor models," Journal of Econometrics, Elsevier, vol. 163(1), pages 4-22, July.
    10. Bonhomme, Stphane & Robin, Jean-Marc, 2009. "Consistent noisy independent component analysis," Journal of Econometrics, Elsevier, vol. 149(1), pages 12-25, April.
    11. Arthur Lewbel, 1997. "Constructing Instruments for Regressions with Measurement Error when no Additional Data are Available, with an Application to Patents and R&D," Econometrica, Econometric Society, vol. 65(5), pages 1201-1214, September.
    12. Erickson, Timothy & Whited, Toni M., 2002. "Two-Step Gmm Estimation Of The Errors-In-Variables Model Using High-Order Moments," Econometric Theory, Cambridge University Press, vol. 18(3), pages 776-799, June.
    13. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    14. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    15. Robin, Jean-Marc & Smith, Richard J., 2000. "Tests Of Rank," Econometric Theory, Cambridge University Press, vol. 16(2), pages 151-175, April.
    16. Mario Forni & Lucrezia Reichlin, 1998. "Let's Get Real: A Factor Analytical Approach to Disaggregated Business Cycle Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 453-473.
    17. Pal, Manoranjan, 1980. "Consistent moment estimators of regression coefficients in the presence of errors in variables," Journal of Econometrics, Elsevier, vol. 14(3), pages 349-364, December.
    18. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    19. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    20. Yingyao Hu & Arthur Lewbel & Susanne M. Schennach, 2007. "Nonparametric identification of the classical errors-in-variables model without side information," CeMMAP working papers CWP14/07, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    21. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    22. John M. Barron & Mark C. Berger & Dan A. Black, 2006. "Selective Counteroffers," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 385-410, July.
    23. Dagenais, Marcel G. & Dagenais, Denyse L., 1997. "Higher moment estimators for linear regression models with errors in the variables," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 193-221.
    24. Jean-Marc Robin & Richard Smith, 2000. "Tests of rank," Post-Print hal-03587662, HAL.
    25. Ab Mooijaart, 1985. "Factor analysis for non-normal variables," Psychometrika, Springer;The Psychometric Society, vol. 50(3), pages 323-342, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09j01si09a2 is not listed on IDEAS
    2. Ben-Moshe, Dan, 2018. "Identification Of Joint Distributions In Dependent Factor Models," Econometric Theory, Cambridge University Press, vol. 34(1), pages 134-165, February.
    3. Sarafidis, Vasilis & Yamagata, Takashi, 2010. "Instrumental Variable Estimation of Dynamic Linear Panel Data Models with Defactored Regressors under Cross-sectional Dependence," MPRA Paper 25182, University Library of Munich, Germany.
    4. Mohitosh Kejriwal & Xiaoxiao Li & Linh Nguyen & Evan Totty, 2024. "The efficacy of ability proxies for estimating the returns to schooling: A factor model‐based evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 3-21, January.
    5. Milda Norkuté & Vasilis Sarafidis & Takashi Yamagata, 2018. "Instrumental Variable Estimation of Dynamic Linear Panel Data Models with Defactored Regressors and a Multifactor Error Structure," ISER Discussion Paper 1019, Institute of Social and Economic Research, Osaka University.
    6. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    7. Norkutė, Milda & Sarafidis, Vasilis & Yamagata, Takashi & Cui, Guowei, 2021. "Instrumental variable estimation of dynamic linear panel data models with defactored regressors and a multifactor error structure," Journal of Econometrics, Elsevier, vol. 220(2), pages 416-446.
    8. Mohitosh Kejriwal & Xiaoxiao Li & Evan Totty, 2020. "Multidimensional skills and the returns to schooling: Evidence from an interactive fixed‐effects approach and a linked survey‐administrative data set," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 548-566, August.
    9. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    10. Georg Keilbar & Juan M. Rodriguez-Poo & Alexandra Soberon & Weining Wang, 2022. "A semiparametric approach for interactive fixed effects panel data models," Papers 2201.11482, arXiv.org, revised Mar 2023.
    11. Natalia Bailey & George Kapetanios & M. Hashem Pesaran, 2021. "Measurement of factor strength: Theory and practice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 587-613, August.
    12. Mohitosh Kejriwal & Xiaoxiao Li & Evan Totty, 2019. "Multidemsional Skills and Returns to Schooling: Evidence from an Interactive Fixed Effects Aproach and a Linked Survey-Administrative Dataset," Purdue University Economics Working Papers 1316, Purdue University, Department of Economics.
    13. repec:hal:pseose:halshs-00849071 is not listed on IDEAS
    14. Conti, Gabriella & Frühwirth-Schnatter, Sylvia & Heckman, James J. & Piatek, Rémi, 2014. "Bayesian exploratory factor analysis," Journal of Econometrics, Elsevier, vol. 183(1), pages 31-57.
    15. Coën, Alain & Hübner, Georges, 2009. "Risk and performance estimation in hedge funds revisited: Evidence from errors in variables," Journal of Empirical Finance, Elsevier, vol. 16(1), pages 112-125, January.
    16. Li, Kunpeng & Li, Qi & Lu, Lina, 2018. "Quasi maximum likelihood analysis of high dimensional constrained factor models," Journal of Econometrics, Elsevier, vol. 206(2), pages 574-612.
    17. Gregory Connor & Matthias Hagmann & Oliver Linton, 2007. "Efficient Estimation of a Semiparametric Characteristic- Based Factor Model of Security Returns," Swiss Finance Institute Research Paper Series 07-26, Swiss Finance Institute.
    18. Marcellino, Massimiliano & Kapetanios, George, 2006. "Impulse Response Functions from Structural Dynamic Factor Models: A Monte Carlo Evaluation," CEPR Discussion Papers 5621, C.E.P.R. Discussion Papers.
    19. Shakeeb Khan & Arnaud Maurel & Yichong Zhang, 2023. "Informational Content of Factor Structures in Simultaneous Binary Response Models," Advances in Econometrics, in: Essays in Honor of Joon Y. Park: Econometric Methodology in Empirical Applications, volume 45, pages 385-410, Emerald Group Publishing Limited.
    20. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    21. Stefano Giglio & Dacheng Xiu, 2017. "Inference on Risk Premia in the Presence of Omitted Factors," NBER Working Papers 23527, National Bureau of Economic Research, Inc.
    22. Jane Cooley Fruehwirth & Salvador Navarro & Yuya Takahashi, 2016. "How the Timing of Grade Retention Affects Outcomes: Identification and Estimation of Time-Varying Treatment Effects," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 979-1021.

    More about this item

    Keywords

    Independent Component Analysis; Factor Analysis; High-order moments; Noisy ICA;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:cesptp:hal-00642732. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.