IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb373/199926.html
   My bibliography  Save this paper

A simple variable selection technique for nonlinear models

Author

Listed:
  • Rech, Gianluigi
  • Teräsvirta, Timo
  • Tschernig, Rolf

Abstract

Applying nonparametric variable selection criteria in nonlinear regression models generally requires a substantial computational effort if the data set is large. In this paper we present a selection technique that is computationally much less demanding and performs well in comparison with methods currently available. It is based on a Taylor expansion of the nonlinear model around a given point in the sample space. Performing the selection only requires repeated least squares estimation of models that are linear in parameters. The main limitation of the method is that the number of variables among which to select cannot be very large if the sample is small and an adequate Taylor expansion is of high order. Large samples can be handled without problems.

Suggested Citation

  • Rech, Gianluigi & Teräsvirta, Timo & Tschernig, Rolf, 1999. "A simple variable selection technique for nonlinear models," SFB 373 Discussion Papers 1999,26, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
  • Handle: RePEc:zbw:sfb373:199926
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/61750/1/722251718.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Yao, Qiwei & Tong, Howell, 1994. "On subset selection in non-parametric stochastic regression," LSE Research Online Documents on Economics 6409, London School of Economics and Political Science, LSE Library.
    2. Hirotugu Akaike, 1969. "Fitting autoregressive models for prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 243-247, December.
    3. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Lag Selection for Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(4), pages 457-487, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcelo Cunha Medeiros & Álvaro Veiga & Carlos Eduardo Pedreira, 2000. "Modelling exchange rates: smooth transitions, neural networks, and linear models," Textos para discussão 432, Department of Economics PUC-Rio (Brazil).
    2. Marie Lebreton & Katia Melnik, 2009. "Voluntary Participation as a Determinant of Social Capital in France : Allowing for Parameter Heterogeneity," Working Papers halshs-00410530, HAL.
    3. Lebreton, Marie, 2005. "The NCSTAR model as an alternative to the GWR model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 355(1), pages 77-84.
    4. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    5. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    6. Péguin-Feissolle, Anne & Strikholm, Birgit & Teräsvirta, Timo, 2007. "Testing the Granger noncausality hypothesis in stationary nonlinear models of unknown functional form," SSE/EFI Working Paper Series in Economics and Finance 672, Stockholm School of Economics, revised 18 Jan 2012.
    7. Mayte Suarez -Farinas & Carlos E. Pedreira & Marcelo C. Medeiros, 2004. "Local Global Neural Networks: A New Approach for Nonlinear Time Series Modeling," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1092-1107, December.
    8. Murat Midilic, 2016. "Estimation Of Star-Garch Models With Iteratively Weighted Least Squares," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 16/918, Ghent University, Faculty of Economics and Business Administration.
    9. MArcelo C. Medeiros & Eduardo F.Mendes, 2012. "Estimating High-Dimensional Time Series Models," Textos para discussão 602, Department of Economics PUC-Rio (Brazil).
    10. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    11. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    12. Marcelo C. Medeiros & Alvaro Veiga, 2003. "Diagnostic Checking in a Flexible Nonlinear Time Series Model," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 461-482, July.
    13. Leila Ali & Marie Lebreton, 2013. "The Fall of Bretton Woods: Which Geography Matters?," Economics Bulletin, AccessEcon, vol. 33(2), pages 1396-1419.
    14. Eduardo Mendes & Alvaro Veiga & MArcelo Cunha Medeiros, 2007. "Estimation And Asymptotic Theory For A New Class Of Mixture Models," Textos para discussão 538, Department of Economics PUC-Rio (Brazil).
    15. Henrik Amilon, 2003. "A neural network versus Black-Scholes: a comparison of pricing and hedging performances," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(4), pages 317-335.
    16. Barrera, Carlos R., 2010. "Redes neuronales para predecir el tipo de cambio diario," Working Papers 2010-001, Banco Central de Reserva del Perú.
    17. Medeiros, Marcelo & Veiga, Alvaro, 2000. "A Flexible Coefficient Smooth Transition Time Series Model," SSE/EFI Working Paper Series in Economics and Finance 360, Stockholm School of Economics, revised 29 Apr 2004.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Estimation of Generalized Impulse Response Functions," Econometric Society World Congress 2000 Contributed Papers 1417, Econometric Society.
    2. Guo, Zheng-Feng & Shintani, Mototsugu, 2011. "Nonparametric lag selection for nonlinear additive autoregressive models," Economics Letters, Elsevier, vol. 111(2), pages 131-134, May.
    3. Lütkepohl,Helmut & Krätzig,Markus (ed.), 2004. "Applied Time Series Econometrics," Cambridge Books, Cambridge University Press, number 9780521547871.
    4. Rolf Tschernig & Lijian Yang, 2000. "Nonparametric Lag Selection for Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(4), pages 457-487, July.
    5. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    6. Zhou, Yunzhe & Shi, Chengchun & Li, Lexin & Yao, Qiwei, 2023. "Testing for the Markov property in time series via deep conditional generative learning," LSE Research Online Documents on Economics 119352, London School of Economics and Political Science, LSE Library.
    7. Miao Yang & Lan Xue & Lijian Yang, 2016. "Variable selection for additive model via cumulative ratios of empirical strengths total," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(3), pages 595-616, September.
    8. Campos, Eduardo Lima & Cysne, Rubens Penha, 2017. "A time-varying fiscal reaction function for Brazil," FGV EPGE Economics Working Papers (Ensaios Economicos da EPGE) 795, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil).
    9. Rodrigo Hakim das Neves, 2020. "Bitcoin pricing: impact of attractiveness variables," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-18, December.
    10. Asghar, Zahid & Abid, Irum, 2007. "Performance of lag length selection criteria in three different situations," MPRA Paper 40042, University Library of Munich, Germany.
    11. Kathryn M. Dominguez, 1991. "Do Exchange Auctions Work? An Examination of the Bolivian Experience," NBER Working Papers 3683, National Bureau of Economic Research, Inc.
    12. Bin Liu & Weifeng Chen & Bo Li & Xiuping Liu, 2022. "Neural Subspace Learning for Surface Defect Detection," Mathematics, MDPI, vol. 10(22), pages 1-16, November.
    13. Jacint Balaguer & Manuel Cantavella-Jorda, 2004. "Structural change in exports and economic growth: cointegration and causality analysis for Spain (1961-2000)," Applied Economics, Taylor & Francis Journals, vol. 36(5), pages 473-477.
    14. Muhammad Farooq Arby & Amjad Ali, 2017. "Threshold Inflation in Pakistan," SBP Research Bulletin, State Bank of Pakistan, Research Department, vol. 13, pages 1-19.
    15. Ramona Dumitriu & Razvan Stefanescu, 2015. "The Relationship Between Romanian Exports And Economic Growth After The Adhesion To European Union," Risk in Contemporary Economy, "Dunarea de Jos" University of Galati, Faculty of Economics and Business Administration, pages 17-26.
    16. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages C32-C61, 03.

    More about this item

    Keywords

    nonlinear regression; Autoregression; nonlinear time series; nonparametric variable selection; time series modelling;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb373:199926. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sfhubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.