Matrix Completion, Counterfactuals, and Factor Analysis of Missing Data
Author
Abstract
Suggested Citation
Download full text from publisher
Other versions of this item:
- Jushan Bai & Serena Ng, 2021. "Matrix Completion, Counterfactuals, and Factor Analysis of Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1746-1763, October.
References listed on IDEAS
- Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008.
"Nowcasting: The real-time informational content of macroeconomic data,"
Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
- Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Finance and Economics Discussion Series 2005-42, Board of Governors of the Federal Reserve System (U.S.).
- Domenico Giannone & Lucrezia Reichlin & David H Small, 2007. "Nowcasting GDP and Inflation: The Real-Time Informational Content of Macroeconomic Data Releases," Money Macro and Finance (MMF) Research Group Conference 2006 164, Money Macro and Finance Research Group.
- Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
- Laurent Gobillon & Thierry Magnac, 2016.
"Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls,"
The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
- Gobillon, Laurent & Magnac, Thierry, 2013. "Regional Policy Evaluation:Interactive Fixed Effects and Synthetic Controls," IDEI Working Papers 786, Institut d'Économie Industrielle (IDEI), Toulouse.
- Gobillon, Laurent & Magnac, Thierry, 2013. "Regional Policy Evaluation:Interactive Fixed Effects and Synthetic Controls," TSE Working Papers 13-419, Toulouse School of Economics (TSE).
- Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," PSE-Ecole d'économie de Paris (Postprint) halshs-01509743, HAL.
- Gobillon, Laurent & Magnac, Thierry, 2013. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," IZA Discussion Papers 7493, Institute of Labor Economics (IZA).
- Laurent Gobillon & Thierry Magnac, 2014. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Control," CESifo Working Paper Series 5077, CESifo.
- Laurent Gobillon & Thierry Magnac, 2013. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," PSE - Labex "OSE-Ouvrir la Science Economique" halshs-00849071, HAL.
- Laurent Gobillon & Thierry Magnac, 2013. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," Working Papers halshs-00849071, HAL.
- Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," Post-Print halshs-01509743, HAL.
- Laurent Gobillon & Thierry Magnac, 2013. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," PSE Working Papers halshs-00849071, HAL.
- Magnac, Thierry & Gobillon, Laurent, 2014. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," CEPR Discussion Papers 10253, C.E.P.R. Discussion Papers.
- Jushan Bai & Serena Ng, 2002.
"Determining the Number of Factors in Approximate Factor Models,"
Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
- Jushan Bai & Serena Ng, 2000. "Determining the Number of Factors in Approximate Factor Models," Econometric Society World Congress 2000 Contributed Papers 1504, Econometric Society.
- Jushan Bai & Serena Ng, 2000. "Determining the Number of Factors in Approximate Factor Models," Boston College Working Papers in Economics 440, Boston College Department of Economics.
- Horton, Nicholas J. & Kleinman, Ken P., 2007. "Much Ado About Nothing: A Comparison of Missing Data Methods and Software to Fit Incomplete Data Regression Models," The American Statistician, American Statistical Association, vol. 61, pages 79-90, February.
- Bai, Jushan & Ng, Serena, 2019. "Rank regularized estimation of approximate factor models," Journal of Econometrics, Elsevier, vol. 212(1), pages 78-96.
- J. B. Taylor & Harald Uhlig (ed.), 2016. "Handbook of Macroeconomics," Handbook of Macroeconomics, Elsevier, edition 1, volume 2, number 2.
- Jungbacker, B. & Koopman, S.J. & van der Wel, M., 2011.
"Maximum likelihood estimation for dynamic factor models with missing data,"
Journal of Economic Dynamics and Control, Elsevier, vol. 35(8), pages 1358-1368, August.
- B. Jungbacker & S.J. Koopman & M. van Der Wel, 2011. "Maximum likelihood estimation for dynamic factor models with missing data," Post-Print hal-00828980, HAL.
- R. H. Shumway & D. S. Stoffer, 1982. "An Approach To Time Series Smoothing And Forecasting Using The Em Algorithm," Journal of Time Series Analysis, Wiley Blackwell, vol. 3(4), pages 253-264, July.
- Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
- Marta Bańbura & Michele Modugno, 2014.
"Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
- Bańbura, Marta & Modugno, Michele, 2010. "Maximum likelihood estimation of factor models on data sets with arbitrary pattern of missing data," Working Paper Series 1189, European Central Bank.
- Carl Eckart & Gale Young, 1936. "The approximation of one matrix by another of lower rank," Psychometrika, Springer;The Psychometric Society, vol. 1(3), pages 211-218, September.
- Jin, Sainan & Miao, Ke & Su, Liangjun, 2021.
"On factor models with random missing: EM estimation, inference, and cross validation,"
Journal of Econometrics, Elsevier, vol. 222(1), pages 745-777.
- Su, Liangjun & Miao, Ke & Jin, Sainan, 2019. "On Factor Models with Random Missing: EM Estimation, Inference, and Cross Validation," Economics and Statistics Working Papers 4-2019, Singapore Management University, School of Economics.
- Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
- Jushan Bai, 2009. "Panel Data Models With Interactive Fixed Effects," Econometrica, Econometric Society, vol. 77(4), pages 1229-1279, July.
- Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
- Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
- Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005.
"Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases,"
Finance and Economics Discussion Series
2005-42, Board of Governors of the Federal Reserve System (U.S.).
- Giannone, Domenico & Reichlin, Lucrezia & Small, David H., 2006. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Working Paper Series 633, European Central Bank.
- Domenico Giannone & Lucrezia Reichlin & David H Small, 2007. "Nowcasting GDP and Inflation: The Real-Time Informational Content of Macroeconomic Data Releases," Money Macro and Finance (MMF) Research Group Conference 2006 164, Money Macro and Finance Research Group.
- Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
- Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
- James Honaker & Gary King, 2010. "What to Do about Missing Values in Time‐Series Cross‐Section Data," American Journal of Political Science, John Wiley & Sons, vol. 54(2), pages 561-581, April.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Michael W. McCracken & Serena Ng, 2021.
"FRED-QD: A Quarterly Database for Macroeconomic Research,"
Review, Federal Reserve Bank of St. Louis, vol. 103(1), pages 1-44, January.
- Michael W. McCracken & Serena Ng, 2020. "FRED-QD: A Quarterly Database for Macroeconomic Research," Working Papers 2020-005, Federal Reserve Bank of St. Louis.
- Michael McCracken & Serena Ng, 2020. "FRED-QD: A Quarterly Database for Macroeconomic Research," NBER Working Papers 26872, National Bureau of Economic Research, Inc.
- Cahan, Ercument & Bai, Jushan & Ng, Serena, 2023.
"Factor-based imputation of missing values and covariances in panel data of large dimensions,"
Journal of Econometrics, Elsevier, vol. 233(1), pages 113-131.
- Ercument Cahan & Jushan Bai & Serena Ng, 2021. "Factor-Based Imputation of Missing Values and Covariances in Panel Data of Large Dimensions," Papers 2103.03045, arXiv.org, revised Feb 2022.
- Guido Imbens & Nathan Kallus & Xiaojie Mao, 2021. "Controlling for Unmeasured Confounding in Panel Data Using Minimal Bridge Functions: From Two-Way Fixed Effects to Factor Models," Papers 2108.03849, arXiv.org.
- Xingyu Li & Yan Shen & Qiankun Zhou, 2022. "Confidence Intervals of Treatment Effects in Panel Data Models with Interactive Fixed Effects," Papers 2202.12078, arXiv.org.
- Callaway, Brantly & Karami, Sonia, 2023.
"Treatment effects in interactive fixed effects models with a small number of time periods,"
Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
- Brantly Callaway & Sonia Karami, 2020. "Treatment Effects in Interactive Fixed Effects Models with a Small Number of Time Periods," Papers 2006.15780, arXiv.org, revised Feb 2022.
- Zongwu Cai & Ying Fang & Ming Lin & Zixuan Wu, 2023. "A Quasi Synthetic Control Method for Nonlinear Models With High-Dimensional Covariates," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202305, University of Kansas, Department of Economics, revised Aug 2023.
- Jungjun Choi & Ming Yuan, 2023. "Matrix Completion When Missing Is Not at Random and Its Applications in Causal Panel Data Models," Papers 2308.02364, arXiv.org.
- Magnac, Thierry, 2023. "Capital humain et recherche d'emploi: un mariage heureux - Human Capital and Search Models: A Happy Match," TSE Working Papers 23-1489, Toulouse School of Economics (TSE).
- Alexandre Belloni & Mingli Chen & Oscar Hernan Madrid Padilla & Zixuan & Wang, 2019.
"High Dimensional Latent Panel Quantile Regression with an Application to Asset Pricing,"
Papers
1912.02151, arXiv.org, revised Aug 2022.
- Belloni, Alexandre & Chen, Mingli & Madrid Padilla, Oscar Hernan & Wang, Zixuan (Kevin), 2019. "High Dimensional Latent Panel Quantile Regression with an Application to Asset Pricing," The Warwick Economics Research Paper Series (TWERPS) 1230, University of Warwick, Department of Economics.
- Ruoxuan Xiong & Markus Pelger, 2019. "Large Dimensional Latent Factor Modeling with Missing Observations and Applications to Causal Inference," Papers 1910.08273, arXiv.org, revised Jan 2022.
- Juho Koistinen & Bernd Funovits, 2022. "Estimation of Impulse-Response Functions with Dynamic Factor Models: A New Parametrization," Papers 2202.00310, arXiv.org, revised Feb 2022.
- Alexandre Bonnet R. Costa & Pedro Cavalcanti G. Ferreira & Wagner Piazza Gaglianone & Osmani Teixeira C. Guillén & João Victor Issler & Artur Brasil Fialho Rodrigues, 2023. "Predicting Recessions in (almost) Real Time in a Big-data Setting," Working Papers Series 587, Central Bank of Brazil, Research Department.
- Yinchu Zhu, 2019. "How well can we learn large factor models without assuming strong factors?," Papers 1910.10382, arXiv.org, revised Nov 2019.
- Chan, Joshua C.C. & Poon, Aubrey & Zhu, Dan, 2023.
"High-dimensional conditionally Gaussian state space models with missing data,"
Journal of Econometrics, Elsevier, vol. 236(1).
- Joshua C. C. Chan & Aubrey Poon & Dan Zhu, 2023. "High-Dimensional Conditionally Gaussian State Space Models with Missing Data," Papers 2302.03172, arXiv.org.
- Xiong, Ruoxuan & Pelger, Markus, 2023. "Large dimensional latent factor modeling with missing observations and applications to causal inference," Journal of Econometrics, Elsevier, vol. 233(1), pages 271-301.
- Brantly Callaway, 2022. "Difference-in-Differences for Policy Evaluation," Papers 2203.15646, arXiv.org.
- Joaqui-Barandica, Orlando & Manotas-Duque, Diego F. & Uribe, Jorge M., 2022.
"Commonality, macroeconomic factors and banking profitability,"
The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
- Orlando Joaqui-Barandica & Diego F. Manotas-Duque & Jorge M. Uribe-Gil, 2021. ""Commonality, macroeconomic factors and banking profitability"," IREA Working Papers 202113, University of Barcelona, Research Institute of Applied Economics, revised Jun 2021.
- Albert Chiu & Xingchen Lan & Ziyi Liu & Yiqing Xu, 2023. "What To Do (and Not to Do) with Causal Panel Analysis under Parallel Trends: Lessons from A Large Reanalysis Study," Papers 2309.15983, arXiv.org.
- Jungjun Choi & Hyukjun Kwon & Yuan Liao, 2023. "Inference for Low-rank Completion without Sample Splitting with Application to Treatment Effect Estimation," Papers 2307.16370, arXiv.org.
- Serena Ng & Susannah Scanlan, 2023. "Constructing High Frequency Economic Indicators by Imputation," Papers 2303.01863, arXiv.org, revised Oct 2023.
- FATUM, Rasmus & YAMAMOTO, Yohei & CHEN, Binwei, 2023. "The Trend Effect of Foreign Exchange Intervention," Discussion paper series HIAS-E-132, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
- Alberto Abadie & Anish Agarwal & Raaz Dwivedi & Abhin Shah, 2024. "Doubly Robust Inference in Causal Latent Factor Models," Papers 2402.11652, arXiv.org, revised Apr 2024.
- Luis Costa & Vivek F. Farias & Patricio Foncea & Jingyuan (Donna) Gan & Ayush Garg & Ivo Rosa Montenegro & Kumarjit Pathak & Tianyi Peng & Dusan Popovic, 2023. "Generalized Synthetic Control for TestOps at ABI: Models, Algorithms, and Infrastructure," Interfaces, INFORMS, vol. 53(5), pages 336-349, September.
- Anish Agarwal & Keegan Harris & Justin Whitehouse & Zhiwei Steven Wu, 2023. "Adaptive Principal Component Regression with Applications to Panel Data," Papers 2307.01357, arXiv.org, revised Oct 2023.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Ruoxuan Xiong & Markus Pelger, 2019. "Large Dimensional Latent Factor Modeling with Missing Observations and Applications to Causal Inference," Papers 1910.08273, arXiv.org, revised Jan 2022.
- Cahan, Ercument & Bai, Jushan & Ng, Serena, 2023.
"Factor-based imputation of missing values and covariances in panel data of large dimensions,"
Journal of Econometrics, Elsevier, vol. 233(1), pages 113-131.
- Ercument Cahan & Jushan Bai & Serena Ng, 2021. "Factor-Based Imputation of Missing Values and Covariances in Panel Data of Large Dimensions," Papers 2103.03045, arXiv.org, revised Feb 2022.
- Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021.
"Factor extraction using Kalman filter and smoothing: This is not just another survey,"
International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
- Poncela Blanco, Maria Pilar & Ruiz Ortega, Esther & Miranda Gualdrón, Karen Alejandra, 2020. "Factor extraction using Kalman filter and smoothing: this is not just another survey," DES - Working Papers. Statistics and Econometrics. WS 30644, Universidad Carlos III de Madrid. Departamento de EstadÃstica.
- Matteo Barigozzi & Matteo Luciani, 2019. "Quasi Maximum Likelihood Estimation and Inference of Large Approximate Dynamic Factor Models via the EM algorithm," Papers 1910.03821, arXiv.org, revised Feb 2022.
- Xiong, Ruoxuan & Pelger, Markus, 2023. "Large dimensional latent factor modeling with missing observations and applications to causal inference," Journal of Econometrics, Elsevier, vol. 233(1), pages 271-301.
- Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
- Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
- Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," PSE Working Papers halshs-02262202, HAL.
- Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
- Kaufmann, Daniel & Scheufele, Rolf, 2017.
"Business tendency surveys and macroeconomic fluctuations,"
International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
- Daniel Kaufmann & Rolf Scheufele, 2015. "Business tendency surveys and macroeconomic fluctuations," KOF Working papers 15-378, KOF Swiss Economic Institute, ETH Zurich.
- Jin, Sainan & Miao, Ke & Su, Liangjun, 2021.
"On factor models with random missing: EM estimation, inference, and cross validation,"
Journal of Econometrics, Elsevier, vol. 222(1), pages 745-777.
- Su, Liangjun & Miao, Ke & Jin, Sainan, 2019. "On Factor Models with Random Missing: EM Estimation, Inference, and Cross Validation," Economics and Statistics Working Papers 4-2019, Singapore Management University, School of Economics.
- Pilar Poncela & Esther Ruiz, 2016.
"Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment,"
Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434,
Emerald Group Publishing Limited.
- Ruiz Ortega, Esther & Poncela, Pilar, 2015. "Small versus big-data factor extraction in Dynamic Factor Models: An empirical assessment," DES - Working Papers. Statistics and Econometrics. WS ws1502, Universidad Carlos III de Madrid. Departamento de EstadÃstica.
- Marcellino, Massimiliano & Sivec, Vasja, 2016.
"Monetary, fiscal and oil shocks: Evidence based on mixed frequency structural FAVARs,"
Journal of Econometrics, Elsevier, vol. 193(2), pages 335-348.
- Marcellino, Massimiliano & Sivec, Vasja, 2015. "Monetary, Fiscal and Oil Shocks: Evidence based on Mixed Frequency Structural FAVARs," CEPR Discussion Papers 10610, C.E.P.R. Discussion Papers.
- Monica Defend & Aleksey Min & Lorenzo Portelli & Franz Ramsauer & Francesco Sandrini & Rudi Zagst, 2021. "Quantifying Drivers of Forecasted Returns Using Approximate Dynamic Factor Models for Mixed-Frequency Panel Data," Forecasting, MDPI, vol. 3(1), pages 1-35, February.
- Matteo Barigozzi & Matteo Luciani, 2017. "Common Factors, Trends, and Cycles in Large Datasets," Finance and Economics Discussion Series 2017-111, Board of Governors of the Federal Reserve System (U.S.).
- Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
- Jonas Krampe & Luca Margaritella, 2021. "Factor Models with Sparse VAR Idiosyncratic Components," Papers 2112.07149, arXiv.org, revised May 2022.
- Hindrayanto, Irma & Koopman, Siem Jan & de Winter, Jasper, 2016. "Forecasting and nowcasting economic growth in the euro area using factor models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1284-1305.
- Alvarez, Rocio & Camacho, Maximo & Perez-Quiros, Gabriel, 2016. "Aggregate versus disaggregate information in dynamic factor models," International Journal of Forecasting, Elsevier, vol. 32(3), pages 680-694.
- Modugno, Michele & Soybilgen, Barış & Yazgan, Ege, 2016.
"Nowcasting Turkish GDP and news decomposition,"
International Journal of Forecasting, Elsevier, vol. 32(4), pages 1369-1384.
- Michele Modugno & Bariş Soybilgen & M. Ege Yazgan, 2016. "Nowcasting Turkish GDP and News Decomposition," Finance and Economics Discussion Series 2016-044, Board of Governors of the Federal Reserve System (U.S.).
More about this item
NEP fields
This paper has been announced in the following NEP Reports:- NEP-ECM-2019-10-21 (Econometrics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1910.06677. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.