Evaluating Specification Tests in the Context of Value-Added Estimation
We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between random and fixed effects and a test for feedback (sometimes called a "falsification test"). We discuss theoretical properties of the tests to serve as background. An extensive simulation study provides important further insight to the VAM setting. Unfortunately, while both the Hausman and feedback tests have good power for detecting the kinds of nonrandom assignment that can invalidate VAM estimates, they also reject in situations where estimated VAMs perform very well. Consequently, the tests must be used with caution when student tracking is used to form classrooms.
|Date of creation:||Feb 2014|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: +49 228 3894 223
Fax: +49 228 3894 180
Web page: http://www.iza.org
|Order Information:|| Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Cory Koedel & Julian Betts, 2009.
"Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique,"
0902, Department of Economics, University of Missouri.
- Cory Koedel & Julian R. Betts, 2011. "Does Student Sorting Invalidate Value-Added Models of Teacher Effectiveness? An Extended Analysis of the Rothstein Critique," Education Finance and Policy, MIT Press, vol. 6(1), pages 18-42, January.
- Guarino, Cassandra & Reckase, Mark D. & Wooldridge, Jeffrey M., 2012. "Can Value-Added Measures of Teacher Performance Be Trusted?," IZA Discussion Papers 6602, Institute for the Study of Labor (IZA).
- Jesse Rothstein, 2010.
"Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement,"
The Quarterly Journal of Economics,
MIT Press, vol. 125(1), pages 175-214, February.
- Jesse Rothstein, 2008. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," NBER Working Papers 14442, National Bureau of Economic Research, Inc.
- Josh Kinsler, 2012. "Assessing Rothstein's critique of teacher value‐added models," Quantitative Economics, Econometric Society, vol. 3(2), pages 333-362, 07.
- Arellano, Manuel & Bond, Stephen, 1991.
"Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations,"
Review of Economic Studies,
Wiley Blackwell, vol. 58(2), pages 277-97, April.
- Tom Doan, . "RATS program to replicate Arellano-Bond 1991 dynamic panel," Statistical Software Components RTZ00169, Boston College Department of Economics.
- Wooldridge, Jeffrey M., 1990. "A Unified Approach to Robust, Regression-Based Specification Tests," Econometric Theory, Cambridge University Press, vol. 6(01), pages 17-43, March.
- Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages F3-F33, February.
When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp7974. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)
If references are entirely missing, you can add them using this form.