A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)
A new method, called relevant transformation of the inputs network approach (RETINA) is proposed as a tool for model building and selection. It is designed to improve on some of the shortcomings of neural networks. RETINA has the flexibility of neural network models, the concavity of the likelihood in the weights of the usual linear models, and the ability to identify a parsimonious set of attributes that are likely to be relevant for predicting out of sample outcomes. It achieves flexibility by considering transformations of the original inputs; it splits the sample into three disjoint subsamples, sorts the candidate regressors by a saliency feature, chooses the models in subsample 1, uses subsample 2 for parameter estimation, and uses subsample 3 for cross-validation. It is modular, can be used as a data exploratory tool, and is computationally feasible in personal computers. In tests on simulated data, it achieves high rates of successes when the sample size or the R2 are large enough. As our experiments show, it is superior to alternative procedures such as the non-negative garrote and backward stepwise regression.
|Date of creation:||14 Mar 2003|
|Date of revision:|
|Publication status:||Published in Oxford Bulletin of Economics and Statistics, December 2003 - Vol. 65 Issue s1 Page 681-906 doi:10.1046/j.0305-9049.2003.00096.x|
|Contact details of provider:|| Postal: |
Phone: +39 055 2751500
Fax: +39 055 4223560
Web page: http://www.disia.unifi.it/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Clive Granger & Allan Timmermann, 1999. "Data mining with local model specification uncertainty: a discussion of Hoover and Perez," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 220-225.
- Raffaella Giacomini & Halbert White, 2003.
"Tests of conditional predictive ability,"
Boston College Working Papers in Economics
572, Boston College Department of Economics.
- Giacomini, Raffaella & White, Halbert, 2003. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series qt5jk0j5jh, Department of Economics, UC San Diego.
- Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA.
- David Hendry & Hans-Martin Krolzig, 2000.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Economics Series Working Papers
3, University of Oxford, Department of Economics.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- Hans-Martin Krolzig, 2000. "Computer Automation of General-to-Specific Model Selection Procedures," Econometric Society World Congress 2000 Contributed Papers 0411, Econometric Society.
- Hans-Martin Krolzig & David Hendry, 1999. "Computer Automation of General-to-Specific Model Selection Procedures," Computing in Economics and Finance 1999 314, Society for Computational Economics.
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
- Granger, Clive W. J. & King, Maxwell L. & White, Halbert, 1995. "Comments on testing economic theories and the use of model selection criteria," Journal of Econometrics, Elsevier, vol. 67(1), pages 173-187, May.
- Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
- Kevin D. Hoover & Stephen J. Perez, .
"Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search,"
Department of Economics
97-27, California Davis - Department of Economics.
- Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
- Kevin Hoover & Stephen J. Perez, 2003. "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Working Papers 9727, University of California, Davis, Department of Economics.
- Francis X. Diebold & Robert S. Mariano, 1994.
"Comparing Predictive Accuracy,"
NBER Technical Working Papers
0169, National Bureau of Economic Research, Inc.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
- Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
When requesting a correction, please mention this item's handle: RePEc:fir:econom:wp2003_04. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Francesco Calvori)
If references are entirely missing, you can add them using this form.