On the Use of Holdout Samples for Model Selection
Researchers often hold out data from the estimation of econometric models to use for external validation. However, the use of holdout samples is suboptimal from a Bayesian perspective, which prescribes using the entire sample to form posterior model weights. This paper examines a possible rationale for the use of holdout samples: data-inspired modifications of structural models are likely to lead to an exaggeration of model fit. The use of holdout samples can, in principle, set an incentive for the modeler not to exaggerate model fit.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 102 (2012)
Issue (Month): 3 (May)
|Contact details of provider:|| Web page: https://www.aeaweb.org/aer/|
More information through EDIRC
|Order Information:||Web: https://www.aeaweb.org/subscribe.html|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Frank Smets & Raf Wouters, 2003.
"An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area,"
Journal of the European Economic Association,
MIT Press, vol. 1(5), pages 1123-1175, 09.
- Frank Smets & Raf Wouters, 2002. "An estimated dynamic stochastic general equilibrium model of the euro area," Working Paper Research 35, National Bank of Belgium.
- Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670. Full references (including those not matched with items on IDEAS)