Foundational Issues in Statistical Modeling: Statistical Model Specification and Validation
AbstractStatistical model specification and validation raise crucial foundational problems whose pertinent resolution holds the key to learning from data by securing the reliability of frequentist inference. The paper questions the judiciousness of several current practices, including the theory-driven approach, and the Akaike-type model selection procedures, arguing that they often lead to unreliable inferences. This is primarily due to the fact that goodness-of-fit/prediction measures and other substantive and pragmatic criteria are of questionable value when the estimated model is statistically misspecified. Foisting one's favorite model on the data often yields estimated models which are both statistically and substantively misspecified, but one has no way to delineate between the two sources of error and apportion blame. The paper argues that the error statistical approach can address this Duhemian ambiguity by distinguishing between statistical and substantive premises and viewing empirical modeling in a piecemeal way with a view to delineate the various issues more effectively. It is also argued that Hendry's general to specific procedures does a much better job in model selection than the theory-driven and the Akaike-type procedures primary because of its error statistical underpinnings.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Frankfurt School Verlag, Frankfurt School of Finance & Management in its journal Rationality, Markets and Morals.
Volume (Year): 2 (2011)
Issue (Month): 47 (October)
error statistics; model validation; model selection; statistical adequacy; substantive adequacy; statistical information; reliability of inference; pre-eminence of theory; general to specific;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jennifer Castle & David Hendry & Jurgen A. Doornik, 2010.
"Evaluating Automatic Model Selection,"
Economics Series Working Papers
474, University of Oxford, Department of Economics.
- Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164.
- Gunnar Bårdsen & Luca Fanelli, 2013. "Frequentist evaluation of small DSGE models," Working Paper Series 14113, Department of Economics, Norwegian University of Science and Technology.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Friederike Pförtner).
If references are entirely missing, you can add them using this form.