Foundational Issues in Statistical Modeling: Statistical Model Specification and Validation
AbstractStatistical model specification and validation raise crucial foundational problems whose pertinent resolution holds the key to learning from data by securing the reliability of frequentist inference. The paper questions the judiciousness of several current practices, including the theory-driven approach, and the Akaike-type model selection procedures, arguing that they often lead to unreliable inferences. This is primarily due to the fact that goodness-of-fit/prediction measures and other substantive and pragmatic criteria are of questionable value when the estimated model is statistically misspecified. Foisting one's favorite model on the data often yields estimated models which are both statistically and substantively misspecified, but one has no way to delineate between the two sources of error and apportion blame. The paper argues that the error statistical approach can address this Duhemian ambiguity by distinguishing between statistical and substantive premises and viewing empirical modeling in a piecemeal way with a view to delineate the various issues more effectively. It is also argued that Hendry's general to specific procedures does a much better job in model selection than the theory-driven and the Akaike-type procedures primary because of its error statistical underpinnings.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Frankfurt School Verlag, Frankfurt School of Finance & Management in its journal Rationality, Markets and Morals.
Volume (Year): 2 (2011)
Issue (Month): 47 (October)
error statistics; model validation; model selection; statistical adequacy; substantive adequacy; statistical information; reliability of inference; pre-eminence of theory; general to specific;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164, September.
- Jennifer Castle & David Hendry & Jurgen A. Doornik, 2010.
"Evaluating Automatic Model Selection,"
Economics Series Working Papers
474, University of Oxford, Department of Economics.
- Gunnar Bårdsen & Luca Fanelli, 2013. "Frequentist evaluation of small DSGE models," Working Paper Series 14113, Department of Economics, Norwegian University of Science and Technology.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Friederike Pförtner).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.