The Costs of Simplicity: Why Multilevel Models May Benefit from Accounting for Cross-Cluster Differences in the Effects of Controls
Author
Abstract
Suggested Citation
DOI: 10.1177/0003122417717901
Download full text from publisher
References listed on IDEAS
- Guido W. Imbens & Michal Kolesár, 2016.
"Robust Standard Errors in Small Samples: Some Practical Advice,"
The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
- Guido W. Imbens & Michal Kolesar, 2012. "Robust Standard Errors in Small Samples: Some Practical Advice," NBER Working Papers 18478, National Bureau of Economic Research, Inc.
- Katja Möhring & Alexander Schmidt, 2012. "Multilevel tools," German Stata Users' Group Meetings 2012 06, Stata Users Group.
- James G. Mackinnon & Matthew D. Webb, 2017.
"Wild Bootstrap Inference for Wildly Different Cluster Sizes,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 32(2), pages 233-254, March.
- James G. MacKinnon & Matthew D. Webb, 2015. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Working Papers 1314, Queen's University, Department of Economics.
- MacKinnon, James G. & Webb, Matthew D., 2015. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Queen's Economics Department Working Papers 274639, Queen's University - Department of Economics.
- White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
- Joe, Harry, 2006. "Generating random correlation matrices based on partial correlations," Journal of Multivariate Analysis, Elsevier, vol. 97(10), pages 2177-2189, November.
- Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
- Daniel Stegmueller, 2013. "How Many Countries for Multilevel Modeling? A Comparison of Frequentist and Bayesian Approaches," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 748-761, July.
- repec:clg:wpaper:2013-17 is not listed on IDEAS
- Jeffrey M. Wooldridge, 2003. "Cluster-Sample Methods in Applied Econometrics," American Economic Review, American Economic Association, vol. 93(2), pages 133-138, May.
- Rick L. Williams, 2000. "A Note on Robust Variance Estimation for Cluster-Correlated Data," Biometrics, The International Biometric Society, vol. 56(2), pages 645-646, June.
- Elff, Martin & Heisig, Jan Paul & Schaeffer, Merlin & Shikano, Susumu, 2016. "No Need to Turn Bayesian in Multilevel Analysis with Few Clusters: How Frequentist Methods Provide Unbiased Estimates and Accurate Inference," SocArXiv z65s4, Center for Open Science.
- Lewis, Jeffrey B. & Linzer, Drew A., 2005. "Estimating Regression Models in Which the Dependent Variable Is Based on Estimates," Political Analysis, Cambridge University Press, vol. 13(4), pages 345-364.
- Moulton, Brent R., 1986. "Random group effects and the precision of regression estimates," Journal of Econometrics, Elsevier, vol. 32(3), pages 385-397, August.
- Moulton, Brent R, 1990. "An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 334-338, May.
- William Rogers, 1993. "Quantile regression standard errors," Stata Technical Bulletin, StataCorp LP, vol. 2(9).
- Kloek, T, 1981. "OLS Estimation in a Model Where a Microvariable Is Explained by Aggregates and Contemporaneous Disturbances Are Equicorrelated," Econometrica, Econometric Society, vol. 49(1), pages 205-207, January.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Giesecke, Johannes & Groß, Martin & Stuth, Stefan, 2020. "Occupational Closure and Wage Inequality: How Occupational Closure Effects Vary Between Workers [Wie berufliche Schließungseffekte zwischen Arbeitnehmergruppen variieren]," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 72(S1), pages 157-195.
- Heisig, Jan Paul & Schaeffer, Merlin, 2020. "The Educational System and the Ethnic Skills Gap among the Working-Age Population: An Analysis of 16 Western Immigration Countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 6, pages 1-1.
- Giesselmann, Marco & Schmidt-Catran, Alexander W., 2019. "Getting the Within Estimator of Cross-Level Interactions in Multilevel Models with Pooled Cross-Sections: Why Country Dummies (Sometimes) Do Not Do the Job," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 49(1), pages 190-219.
- Heisig, Jan Paul & Schaeffer, Merlin, 2019. "Why You Should Always Include a Random Slope for the Lower-Level Variable Involved in a Cross-Level Interaction," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 35(2), pages 258-279.
- Cassandra R. Chambers & Wayne E. Baker, 2020. "Robust Systems of Cooperation in the Presence of Rankings: How Displaying Prosocial Contributions Can Offset the Disruptive Effects of Performance Rankings," Organization Science, INFORMS, vol. 31(2), pages 287-307, March.
- Ehlert, Martin, 2020. "No Future, No Training? Explaining Cross-national Variation in the Effect of Job Tasks On Training Participation [Keine Zukunft, keine Weiterbildung? Zur Erklärung von Länderunterschieden im Effekt," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 72(S1), pages 483-510.
- Rense Nieuwenhuis, 2022. "Single Parents Competing in a Dual-Earner Society: Social Policy to Level the Playing Field," The ANNALS of the American Academy of Political and Social Science, , vol. 702(1), pages 114-128, July.
- Heisig, Jan Paul & Schaeffer, Merlin, 2018. "Why You Should Always Include a Random Slope for the Lower-Level Variable Involved in a Cross-Level Interaction," SocArXiv bwqtd, Center for Open Science.
- Peter Dirksmeier & Leonie Tuitjer, 2023. "Do trust and renewable energy use enhance perceived climate change efficacy in Europe?," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(8), pages 8753-8776, August.
- Sophia Fauser & Michael Gebel, 2023. "Labour Market Dualism and the Heterogeneous Wage Gap for Temporary Employment. A Multilevel Study across 30 Countries," LIS Working papers 853, LIS Cross-National Data Center in Luxembourg.
- Filandri, Marianna & Struffolino, Emanuela, 2018. "Lavoratori o lavoratrici povere? Disuguaglianze di genere nel mercato del lavoro in Europa," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, issue 117, pages 67-85.
- Konrad Turek & Kène Henkens, 2020. "How Skill Requirements Affect the Likelihood of Recruitment of Older Workers in Poland: The Indirect Role of Age Stereotypes," Work, Employment & Society, British Sociological Association, vol. 34(4), pages 550-570, August.
- Jutz, Regina, 2020. "Health inequalities in Eastern Europe. Does the role of the welfare regime differ from Western Europe?," Social Science & Medicine, Elsevier, vol. 267(C).
- Heisig, Jan Paul & Gesthuizen, Maurice & Solga, Heike, 2019. "Lack of skills or formal qualifications? New evidence on cross-country differences in the labor market disadvantage of less-educated adults," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 83, pages 1-20.
- Josef Kuo-Hsun Ma & Todd E. Vachon & Simon Cheng, 2019. "National Income, Political Freedom, and Investments in R&D and Education: A Comparative Analysis of the Second Digital Divide Among 15-Year-Old Students," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(1), pages 133-166, July.
- Wiedner, Jonas & Schaeffer, Merlin & Carol, Sarah, 2022. "Ethno-religious neighbourhood infrastructures and the life satisfaction of immigrants and their descendants in Germany," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 59(14), pages 2985-3004.
- Jolidon, Vladimir, 2022. "Gender inequality and mammography screening: Does living with a partner improve women's mammography uptake?," Social Science & Medicine, Elsevier, vol. 298(C).
- Contini, Dalit & Cugnata, Federica, 2020. "Does Early Tracking Affect Learning Inequalities? Revisiting Difference-in-difference Modeling Strategies with International Assessments," Department of Economics and Statistics Cognetti de Martiis. Working Papers 202018, University of Turin.
- Rense Nieuwenhuis, 2022. "Single Parents Competing in a Dual-Earner Society: Leveling the Playing Field," LIS Working papers 825, LIS Cross-National Data Center in Luxembourg.
- Contini, Dalit & Cugnata, Federica, 2018. "How do institutions affect learning inequalities? Revisiting difference-in-difference models with international assessments," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201817, University of Turin.
- Aleksey Oshchepkov & Anna Shirokanova, 2020. "Multilevel Modeling For Economists: Why, When And How," HSE Working papers WP BRP 233/EC/2020, National Research University Higher School of Economics.
- Sonja Scheuring, 2020. "The Effect of Fixed-Term Employment on Well-Being: Disentangling the Micro-Mechanisms and the Moderating Role of Social Cohesion," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(1), pages 91-115, November.
- Marine Coupaud, 2023. "Organizational change and psychosomatic symptoms: Exploring pathways through working conditions and assessing the moderating role of social support among European workers," Economic and Industrial Democracy, Department of Economic History, Uppsala University, Sweden, vol. 44(2), pages 322-350, May.
- Mill, Wladislaw & Morgan, John, 2022.
"Competition between friends and foes,"
European Economic Review, Elsevier, vol. 147(C).
- Wladislaw Mill & John Morgan, 2020. "Competition Between Friends and Foes," CRC TR 224 Discussion Paper Series crctr224_2020_242, University of Bonn and University of Mannheim, Germany.
- Salazar, Leire & Cebolla-Boado, Héctor & Radl, Jonas, 2020. "Educational expectations in the great recession: has the impact of family background become stronger?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 18(2), pages 465-491.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Aleksey Oshchepkov & Anna Shirokanova, 2020. "Multilevel Modeling For Economists: Why, When And How," HSE Working papers WP BRP 233/EC/2020, National Research University Higher School of Economics.
- A. Colin Cameron & Douglas L. Miller, 2010.
"Robust Inference with Clustered Data,"
Working Papers
106, University of California, Davis, Department of Economics.
- Colin Cameron, 2011. "Robust inference with clustered data," Mexican Stata Users' Group Meetings 2011 07, Stata Users Group.
- A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 107, University of California, Davis, Department of Economics.
- Hansen, Bruce E. & Lee, Seojeong, 2019.
"Asymptotic theory for clustered samples,"
Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
- Bruce E. Hansen & Seojeong Jay Lee, 2017. "Asymptotic Theory for Clustered Samples," Discussion Papers 2017-18, School of Economics, The University of New South Wales.
- Bruce E. Hansen & Seojeong Lee, 2019. "Asymptotic Theory for Clustered Samples," Papers 1902.01497, arXiv.org.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008.
"Bootstrap-Based Improvements for Inference with Clustered Errors,"
The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
- Jonah B. Gelbach & Doug Miller & A. Colin Cameron, 2006. "Bootstrap-Based Improvements for Inference with Clustered Errors," Working Papers 128, University of California, Davis, Department of Economics.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
- A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
- Cameron, A. Colin & Gelbach, Jonah B. & Miller, Douglas L., 2011.
"Robust Inference With Multiway Clustering,"
Journal of Business & Economic Statistics, American Statistical Association, vol. 29(2), pages 238-249.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2011. "Robust Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(2), pages 238-249, April.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2006. "Robust Inference with Multi-way Clustering," NBER Technical Working Papers 0327, National Bureau of Economic Research, Inc.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008.
"Bootstrap-Based Improvements for Inference with Clustered Errors,"
The Review of Economics and Statistics,
MIT Press, vol. 90(3), pages 414-427, August.
- Jonah B. Gelbach & Doug Miller & A. Colin Cameron, 2006. "Bootstrap-Based Improvements for Inference with Clustered Errors," Working Papers 621, University of California, Davis, Department of Economics.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
- A. Colin Cameron & Douglas L. Miller, 2010.
"Robust Inference with Clustered Data,"
Working Papers
318, University of California, Davis, Department of Economics.
- Colin Cameron, 2011. "Robust inference with clustered data," Mexican Stata Users' Group Meetings 2011 07, Stata Users Group.
- A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 316, University of California, Davis, Department of Economics.
- Rok Spruk, 2019.
"The rise and fall of Argentina,"
Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 28(1), pages 1-40, December.
- Spruk, Rok, 2018. "The Rise and Fall of Argentina," Working Papers 07520, George Mason University, Mercatus Center.
- James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
- Rok Spruk & Mitja Kovac, 2018. "Inefficient Growth," Review of Economics and Institutions, Università di Perugia, vol. 9(2).
- Fluvià, Modest & Rigall-I-Torrent, Ricard & Espinet, Josep Maria & Garriga, Anna & Saló, Albert, 2011. "Precios implícitos de los atributos de los productos turísticos: ¿Qué esconde el efecto de la localización?/Implicit Prices of the Attributes of Tourism Products: What is Hidden Behind Location?," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 29, pages 781-802, Diciembre.
- Klishchuk Bogdan & Zelenyuk Valentin, 2012. "Impact of Services LIberalization on Firm Level Productivity in Eastern Europe and Central Asia," EERC Working Paper Series 12/03e, EERC Research Network, Russia and CIS.
- Jonah B. Gelbach & Doug Miller, 2009. "Robust Inference with Multi-way Clustering," Working Papers 226, University of California, Davis, Department of Economics.
- Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023.
"When Should You Adjust Standard Errors for Clustering?,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
- Alberto Abadie & Susan Athey & Guido Imbens & Jeffrey Wooldridge, 2017. "When Should You Adjust Standard Errors for Clustering?," Papers 1710.02926, arXiv.org, revised Sep 2022.
- Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey Wooldridge, 2017. "When Should You Adjust Standard Errors for Clustering?," NBER Working Papers 24003, National Bureau of Economic Research, Inc.
- Abadie, Alberto & Athey, Susan & Imbens, Guido W. & Wooldridge, Jeffrey, 2017. "When Should You Adjust Standard Errors for Clustering?," Research Papers repec:ecl:stabus:3596, Stanford University, Graduate School of Business.
- Vikström, Johan, 2009. "Cluster sample inference using sensitivity analysis: the case with few groups," Working Paper Series 2009:15, IFAU - Institute for Evaluation of Labour Market and Education Policy.
- James G. MacKinnon & Matthew D. Webb, 2017.
"Wild Bootstrap Inference for Wildly Different Cluster Sizes,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 233-254, March.
- James G. MacKinnon & Matthew D. Webb, 2015. "Wild Bootstrap Inference For Wildly Different Cluster Sizes," Working Paper 1314, Economics Department, Queen's University.
- Mitja Kovac & Salvini Datta & Rok Spruk, 2021. "Pharmaceutical Product Liability, Litigation Regimes, and the Propensity to Patent: An Empirical Firm-Level Investigation," SAGE Open, , vol. 11(2), pages 21582440211, April.
- Martin Halla & Friedrich Schneider & Alexander Wagner, 2013.
"Satisfaction with democracy and collective action problems: the case of the environment,"
Public Choice, Springer, vol. 155(1), pages 109-137, April.
- Martin Halla & Friedrich Schneider & Alexander Wagner, 2008. "Satisfaction with Democracy and Collective Action Problems: The Case of the Environment," Economics working papers 2008-08, Department of Economics, Johannes Kepler University Linz, Austria.
- Halla, Martin & Schneider, Friedrich & Wagner, Alexander F., 2008. "Satisfaction with Democracy and Collective Action Problems: The Case of the Environment," IZA Discussion Papers 3613, Institute of Labor Economics (IZA).
- Miroslav Verbič & Rok Spruk, 2019. "Political economy of pension reforms: an empirical investigation," European Journal of Law and Economics, Springer, vol. 47(2), pages 171-232, April.
More about this item
Keywords
multilevel modeling; comparative research; cluster-robust standard errors; hierarchical data; context effects;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:182102. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.