A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)
A new method, called relevant transformation of the inputs network approach (RETINA) is proposed as a tool for model building and selection. It is designed to improve on some of the shortcomings of neural networks. RETINA has the flexibility of neural network models, the concavity of the likelihood in the weights of the usual linear models, and the ability to identify a parsimonious set of attributes that are likely to be relevant for predicting out of sample outcomes. It achieves flexibility by considering transformations of the original inputs; it splits the sample into three disjoint subsamples, sorts the candidate regressors by a saliency feature, chooses the models in subsample 1, uses subsample 2 for parameter estimation, and uses subsample 3 for cross-validation. It is modular, can be used as a data exploratory tool, and is computationally feasible in personal computers. In tests on simulated data, it achieves high rates of successes when the sample size or the R2 are large enough. As our experiments show, it is superior to alternative procedures such as the non-negative garrote and backward stepwise regression.
|Date of creation:||14 Mar 2003|
|Publication status:||Published in Oxford Bulletin of Economics and Statistics, December 2003 - Vol. 65 Issue s1 Page 681-906 doi:10.1046/j.0305-9049.2003.00096.x|
|Contact details of provider:|| Postal: Viale G.B. Morgagni, 59 - I-50134 Firenze - Italy|
Phone: +39 055 2751500
Fax: +39 055 2751525
Web page: http://www.disia.unifi.it/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kevin D. Hoover & Stephen J. Perez, 1999.
"Data mining reconsidered: encompassing and the general-to-specific approach to specification search,"
Royal Economic Society, vol. 2(2), pages 167-191.
- Kevin D. Hoover & Stephen J. Perez, "undated". "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Department of Economics 97-27, California Davis - Department of Economics.
- Kevin Hoover & Stephen J. Perez, 2003. "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Working Papers 9727, University of California, Davis, Department of Economics.
- Francis X. Diebold & Robert S. Mariano, 1994.
"Comparing Predictive Accuracy,"
NBER Technical Working Papers
0169, National Bureau of Economic Research, Inc.
- Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-263, July.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
- Raffaella Giacomini & Halbert White, 2003.
"Tests of Conditional Predictive Ability,"
- Raffaella Giacomini & Halbert White, 2003. "Tests of conditional predictive ability," Boston College Working Papers in Economics 572, Boston College Department of Economics.
- Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
- Hans-Martin Krolzig & David Hendry, 1999.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Computing in Economics and Finance 1999
314, Society for Computational Economics.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Econometric Society World Congress 2000 Contributed Papers 0411, Econometric Society.
- David Hendry & Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Economics Series Working Papers 3, University of Oxford, Department of Economics.
- Granger, Clive W. J. & King, Maxwell L. & White, Halbert, 1995. "Comments on testing economic theories and the use of model selection criteria," Journal of Econometrics, Elsevier, vol. 67(1), pages 173-187, May.
- Clive Granger & Allan Timmermann, 1999. "Data mining with local model specification uncertainty: a discussion of Hoover and Perez," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 220-225.
- Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
When requesting a correction, please mention this item's handle: RePEc:fir:econom:wp2003_04. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Francesco Calvori)
If references are entirely missing, you can add them using this form.