A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)
Abstract
A new method, called relevant transformation of the inputs network approach (RETINA) is proposed as a tool for model building and selection. It is designed to improve on some of the shortcomings of neural networks. RETINA has the flexibility of neural network models, the concavity of the likelihood in the weights of the usual linear models, and the ability to identify a parsimonious set of attributes that are likely to be relevant for predicting out of sample outcomes. It achieves flexibility by considering transformations of the original inputs; it splits the sample into three disjoint subsamples, sorts the candidate regressors by a saliency feature, chooses the models in subsample 1, uses subsample 2 for parameter estimation, and uses subsample 3 for cross-validation. It is modular, can be used as a data exploratory tool, and is computationally feasible in personal computers. In tests on simulated data, it achieves high rates of successes when the sample size or the R2 are large enough. As our experiments show, it is superior to alternative procedures such as the non-negative garrote and backward stepwise regression.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Universita' degli Studi di Firenze, Dipartimento di Statistica "G. Parenti" in its series Econometrics Working Papers Archive with number wp2003_04.Length: 38 pages
Date of creation: 14 Mar 2003
Date of revision:
Handle: RePEc:fir:econom:wp2003_04
Contact details of provider:
Postal: Viale G.B. Morgagni, 59 - I-50134 Firenze - Italy
Phone: +39 055 4237211
Fax: +39 055 4223560
Web page: http://www.ds.unifi.it/
More information through EDIRC
Related research
Keywords: Model selection; cross-validation; flexible modelling; information criteria; forecasting.;Other versions of this item:
- Teodosio Perez-Amaral & Giampiero M. Gallo & Halbert White, 2003. "A Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 821-838, December.
- Teodosio Perez-Amaral & Giampiero M. Gallo & Halbert White, 2003. "Flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)," Documentos del Instituto Complutense de Análisis Económico 0309, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales.
- Halbert L. White & Giampiero M. Gallo & Teodosio Pérez Amaral, 2002. "A flexible Tool for Model Building: the Relevant Transformation of the Inputs Network Approach (RETINA)," Documentos del Instituto Complutense de Análisis Económico 0201, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales.
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Clive Granger & Allan Timmermann, 1999. "Data mining with local model specification uncertainty: a discussion of Hoover and Perez," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 220-225.
- Kevin D. Hoover & Stephen J. Perez, 1999.
"Data mining reconsidered: encompassing and the general-to-specific approach to specification search,"
Econometrics Journal,
Royal Economic Society, vol. 2(2), pages 167-191.
- Kevin Hoover & Stephen J. Perez, 2003. "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Working Papers 9727, University of California, Davis, Department of Economics.
- Kevin D. Hoover & Stephen J. Perez, . "Data Mining Reconsidered: Encompassing And The General-To-Specific Approach To Specification Search," Department of Economics 97-27, California Davis - Department of Economics.
- Giacomini, Raffaella & White, Halbert, 2003.
"Tests of Conditional Predictive Ability,"
University of California at San Diego, Economics Working Paper Series
qt5jk0j5jh, Department of Economics, UC San Diego.
- Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
- Raffaella Giacomini & Halbert White, 2003. "Tests of Conditional Predictive Ability," Econometrics 0308001, EconWPA.
- Raffaella Giacomini & Halbert White, 2003. "Tests of conditional predictive ability," Boston College Working Papers in Economics 572, Boston College Department of Economics.
- Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
- David Hendry & Hans-Martin Krolzig, 2000.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Economics Series Working Papers
3, University of Oxford, Department of Economics.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- Hans-Martin Krolzig & David Hendry, 1999. "Computer Automation of General-to-Specific Model Selection Procedures," Computing in Economics and Finance 1999 314, Society for Computational Economics.
- Kenneth D. West, 1994.
"Asymptotic Inference About Predictive Ability,"
Macroeconomics
9410002, EconWPA.
- West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September.
- Granger, Clive W. J. & King, Maxwell L. & White, Halbert, 1995. "Comments on testing economic theories and the use of model selection criteria," Journal of Econometrics, Elsevier, vol. 67(1), pages 173-187, May.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Lutz Kilian & Atsushi Inoue, 2003.
"On the selection of forecasting models,"
Working Paper Series
214, European Central Bank.
- Inoue, Atsushi & Kilian, Lutz, 2006. "On the selection of forecasting models," Journal of Econometrics, Elsevier, vol. 130(2), pages 273-306, February.
- Inoue, Atsushi & Kilian, Lutz, 2003. "On the Selection of Forecasting Models," CEPR Discussion Papers 3809, C.E.P.R. Discussion Papers.
- Hans-Martin Krolzig, 2000.
"Computer Automation of General-to-Specific Model Selection Procedures,"
Econometric Society World Congress 2000 Contributed Papers
0411, Econometric Society.
- Krolzig, Hans-Martin & Hendry, David F., 2001. "Computer automation of general-to-specific model selection procedures," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 831-866, June.
- Hans-Martin Krolzig & David Hendry, 1999. "Computer Automation of General-to-Specific Model Selection Procedures," Computing in Economics and Finance 1999 314, Society for Computational Economics.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Ivan Savin & Peter Winker, 2010.
"Heuristic Optimization Methods for Dynamic Panel Data Model Selection. Application on the Russian Innovative Performance,"
Working Papers
027, COMISEF.
- Ivan Savin & Peter Winker, 2012. "Heuristic Optimization Methods for Dynamic Panel Data Model Selection: Application on the Russian Innovative Performance," Computational Economics, Society for Computational Economics, vol. 39(4), pages 337-363, April.
- David Hendry & Hans-Martin Krolzig, 2004.
"We Ran One Regression,"
Economics Series Working Papers
2004-W17, University of Oxford, Department of Economics.
- David F. Hendry & Hans-Martin Krolzig, 2004. "We Ran One Regression," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(5), pages 799-810, December.
- David F. Hendry & Hans-Martin Krolzig, 2004. "We Ran One Regression," Economics Papers 2004-W17, Economics Group, Nuffield College, University of Oxford.
- Gernot Doppelhofer & Melvyn Weeks, 2007.
"Jointness of Growth Determinants,"
CESifo Working Paper Series
1978, CESifo Group Munich.
- Doppelhofer, G. & Weeks, M., 2005. "Jointness of Growth Determinants," Cambridge Working Papers in Economics 0542, Faculty of Economics, University of Cambridge.
- Ivan Savin, 2010. "A comparative study of the Lasso-type and heuristic model selection methods," Working Papers 042, COMISEF.
- Darné, O. & Brunhes-Lesage, V., 2007.
"L’Indicateur Synthétique Mensuel d’Activité (ISMA) : une révision,"
Working papers
171, Banque de France.
- Darné, O. & Brunhes-Lesage, V., 2007. "L’indicateur synthétique mensuel d’activité (ISMA) : une révision," Bulletin de la Banque de France, Banque de France, issue 162, pages 21-36.
- Eduardo Acosta-González & Fernando Fernández-Rodríguez, 2007. "Model selection via genetic algorithms illustrated with cross-country growth data," Empirical Economics, Springer, vol. 33(2), pages 313-337, September.
- Massimiliano Marinucci & Teodosio Pérez-Amaral, 2005.
"Econometric modeling of business Telecommunications demand using Retina and Finite Mixtues,"
Documentos del Instituto Complutense de Análisis Económico
0501, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales.
- Massimiliano Marinucci & Teodosio Pérez-Amaral, 2005. "Econometric Modeling of Business Telecommunications Demand using RETINA and Finite Mixtures," Econometrics 0505003, EconWPA, revised 14 May 2005.
- Jennifer L. Castle & David F. Hendry, 2007. "A Low-Dimension Collinearity-Robust Test for Non-linearity," Economics Series Working Papers 326, University of Oxford, Department of Economics.
- Anders Bredahl Kock & Timo Teräsvirta, 2011. "Forecasting performance of three automated modelling techniques during the economic crisis 2007-2009," CREATES Research Papers 2011-28, School of Economics and Management, University of Aarhus.
- Ivan Savin & Peter Winker, 2012. "Lasso-type and Heuristic Strategies in Model Selection and Forecasting," Jena Economic Research Papers 2012-055, Friedrich-Schiller-University Jena, Max-Planck-Institute of Economics.
- Jennifer Castle & David Hendry, 2010. "Automatic Selection for Non-linear Models," Economics Series Working Papers 473, University of Oxford, Department of Economics.
- Gernot Doppelhofer & Xavier Sala I Martin & Melvyn Weeks, 2005. "Jointness of Determinants of Economics Growth," Money Macro and Finance (MMF) Research Group Conference 2005 54, Money Macro and Finance Research Group.
- Barhoumi, K. & Brunhes-Lesage, V. & Darné, O. & Ferrara, L. & Pluyaud, B. & Rouvreau, B., 2008. "Monthly forecasting of French GDP: A revised version of the OPTIM model," Working papers 222, Banque de France.
- Anders Bredahl Kock & Timo Teräsvirta, 2011. "Forecasting Macroeconomic Variables using Neural Network Models and Three Automated Model Selection Techniques," CREATES Research Papers 2011-27, School of Economics and Management, University of Aarhus.
- Marcin Blazejowski & Pawel Kufel & Tadeusz Kufel, 2009. "Automatic Procedure of Building Congruent Dynamic Model in Gretl," EHUCHAPS, Universidad del País Vasco - Facultad de Ciencias Económicas y Empresariales.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:fir:econom:wp2003_04For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Margherita Velucchi).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

