This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

An Exploration of Regression-Based Data Mining Techniques Using Super Computation

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Antony Davies () (Department of Economics Duquesne University The Mercatus Center George Mason University)

Additional information is available for the following registered author(s):

Abstract

Regression analysis is intended to be used when the researcher seeks to test a given hypothesis against a data set. Unfortunately, in many applications it is either not possible to specify a hypothesis, typically because the research is in a very early stage, or it is not desirable to form a hypothesis, typically because the number of potential explanatory variables is very large. In these cases, researchers have resorted either to overt data mining techniques such as stepwise regression, or covert data mining techniques such as running variations on regression models prior to running the final model (also known as “data peeking”). While data mining side-steps the need to form a hypothesis, it is highly susceptible to generating spurious results. This paper draws on the known properties of OLS estimators in the presence of omitted and extraneous variable models to propose a procedure for data mining that attempts to distinguish between parameter estimates that are significant due to an underlying structural relationship and those that are significant due to random chance.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.gwu.edu/~forcpgm/2008-008.pdf
File Format: application/pdf
File Function: First version, 2008
Download Restriction: no

Publisher Info
Paper provided by The George Washinton University, Department of Economics, Research Program on Forecasting in its series Working Papers with number 2008-8.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 36 pages
Date of creation: Aug 2008
Date of revision:
Handle: RePEc:gwc:wpaper:2008-8

Contact details of provider:
Postal: Monroe Hall #340, 2115 G Street, NW, Washington, DC 20052
Phone: (202) 994-6150
Fax: (202) 994-6147
Email:
Web page: http://www.gwu.edu/~forcpgm
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Tara M. Sinclair).

Related research
Keywords: exhaustive; regression; all subsets; stepwise; data mining;

Find related papers by JEL classification:
C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - General
C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General
C63 - Mathematical and Quantitative Methods - - Mathematical Methods and Programming - - - Computational Techniques

This paper has been announced in the following NEP Reports:

Statistics
Access and download statistics

Did you know? Over 1000 institutions contribute their bibliographic data directly to this service.

This page was last updated on 2009-11-14.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.