Foundational Issues in Statistical Modeling: Statistical Model Specification and Validation
Statistical model specification and validation raise crucial foundational problems whose pertinent resolution holds the key to learning from data by securing the reliability of frequentist inference. The paper questions the judiciousness of several current practices, including the theory-driven approach, and the Akaike-type model selection procedures, arguing that they often lead to unreliable inferences. This is primarily due to the fact that goodness-of-fit/prediction measures and other substantive and pragmatic criteria are of questionable value when the estimated model is statistically misspecified. Foisting one's favorite model on the data often yields estimated models which are both statistically and substantively misspecified, but one has no way to delineate between the two sources of error and apportion blame. The paper argues that the error statistical approach can address this Duhemian ambiguity by distinguishing between statistical and substantive premises and viewing empirical modeling in a piecemeal way with a view to delineate the various issues more effectively. It is also argued that Hendry's general to specific procedures does a much better job in model selection than the theory-driven and the Akaike-type procedures primary because of its error statistical underpinnings.
Volume (Year): 2 (2011)
Issue (Month): 47 (October)
|Contact details of provider:|| Postal: Sonnemannstraße 9-11, 60314 Frankfurt am Main|
Phone: 069 154008-0
Web page: http://www.frankfurt-school-verlag.de/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Castle Jennifer L. & Doornik Jurgen A & Hendry David F., 2011.
"Evaluating Automatic Model Selection,"
Journal of Time Series Econometrics,
De Gruyter, vol. 3(1), pages 1-33, February.
- Jennifer Castle & David Hendry & Jurgen A. Doornik, 2010. "Evaluating Automatic Model Selection," Economics Series Working Papers 474, University of Oxford, Department of Economics.
- Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164. Full references (including those not matched with items on IDEAS)