IDEAS home Printed from https://ideas.repec.org/a/anr/reveco/v2y2010p75-104.html
   My bibliography  Save this article

Hypothesis Testing in Econometrics

Author

Listed:
  • Joseph P. Romano
  • Azeem M. Shaikh
  • Michael Wolf

    () (Departments of Economics and Statistics, Stanford University, Stanford, California 94305
    Department of Economics, University of Chicago, Chicago, Illinois 60637
    Institute for Empirical Research in Economics, University of Zürich, CH-8006 Zürich, Switzerland)

Abstract

This article reviews important concepts and methods that are useful for hypothesis testing. First, we discuss the Neyman-Pearson framework. Various approaches to optimality are presented, including finite-sample and large-sample optimality. Then, we summarize some of the most important methods, as well as resampling methodology, which is useful to set critical values. Finally, we consider the problem of multiple testing, which has witnessed a burgeoning literature in recent years. Along the way, we incorporate some examples that are current in the econometrics literature. While many problems with well-known successful solutions are included, we also address open problems that are not easily handled with current technology, stemming from such issues as lack of optimality or poor asymptotic approximations.

Suggested Citation

  • Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
  • Handle: RePEc:anr:reveco:v:2:y:2010:p:75-104
    as

    Download full text from publisher

    File URL: http://www.annualreviews.org/doi/abs/10.1146/annurev.economics.102308.124342
    Download Restriction: Full text downloads are only available to subscribers. Visit the abstract page for more information.

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Andrews, Donald W. K., 1998. "Hypothesis testing with a restricted parameter space," Journal of Econometrics, Elsevier, vol. 84(1), pages 155-199, May.
    2. Yoav Benjamini & Abba M. Krieger & Daniel Yekutieli, 2006. "Adaptive linear step-up procedures that control the false discovery rate," Biometrika, Biometrika Trust, vol. 93(3), pages 491-507, September.
    3. Andrews, Donald W.K. & Guggenberger, Patrik, 2009. "Validity Of Subsampling And “Plug-In Asymptotic” Inference For Parameters Defined By Moment Inequalities," Econometric Theory, Cambridge University Press, vol. 25(03), pages 669-709, June.
    4. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    5. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(02), pages 404-447, April.
    6. Joseph Romano & Azeem Shaikh & Michael Wolf, 2008. "Control of the false discovery rate under dependence using the bootstrap and subsampling," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(3), pages 417-442, November.
    7. van der Laan Mark J. & Dudoit Sandrine & Pollard Katherine S., 2004. "Augmentation Procedures for Control of the Generalized Family-Wise Error Rate and Tail Probabilities for the Proportion of False Positives," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 3(1), pages 1-27, June.
    8. Michael Jansson, 2008. "Semiparametric Power Envelopes for Tests of the Unit Root Hypothesis," Econometrica, Econometric Society, vol. 76(5), pages 1103-1142, September.
    9. Russell Davidson & Jean-Yves Duclos, 2013. "Testing for Restricted Stochastic Dominance," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 84-125, January.
    10. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
    11. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    12. Elliott, Graham, 1999. "Efficient Tests for a Unit Root When the Initial Observation Is Drawn from Its Unconditional Distribution," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 40(3), pages 767-783, August.
    13. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    14. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    15. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    16. James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Papers 1127, Queen's University, Department of Economics.
    17. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
    18. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "multiple testing," The New Palgrave Dictionary of Economics, Palgrave Macmillan.
    19. Marcelo J. Moreira, 2003. "A Conditional Likelihood Ratio Test for Structural Models," Econometrica, Econometric Society, vol. 71(4), pages 1027-1048, July.
    20. Perron, Pierre & Rodriguez, Gabriel, 2003. "GLS detrending, efficient unit root tests and structural change," Journal of Econometrics, Elsevier, vol. 115(1), pages 1-27, July.
    21. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    22. Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics,in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228 Elsevier.
    23. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205.
    24. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    25. Donald W. K. Andrews & Marcelo J. Moreira & James H. Stock, 2006. "Optimal Two-Sided Invariant Similar Tests for Instrumental Variables Regression," Econometrica, Econometric Society, vol. 74(3), pages 715-752, May.
    26. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    27. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    28. van der Laan Mark J. & Birkner Merrill D. & Hubbard Alan E., 2005. "Empirical Bayes and Resampling Based Multiple Testing Procedure Controlling Tail Probability of the Proportion of False Positives," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, October.
    29. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    30. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dette, Holger & Hoderlein, Stefan & Neumeyer, Natalie, 2016. "Testing multivariate economic restrictions using quantiles: The example of Slutsky negative semidefiniteness," Journal of Econometrics, Elsevier, vol. 191(1), pages 129-144.
    2. Daniel Borup & Martin Thyrsgaard, 1705. "Statistical tests for equal predictive ability across multiple forecasting methods," CREATES Research Papers 2017-19, Department of Economics and Business Economics, Aarhus University.
    3. Cummins, Mark & Garry, Oonagh & Kearney, Claire, 2014. "Price discovery analysis of green equity indices using robust asymmetric vector autoregression," International Review of Financial Analysis, Elsevier, vol. 35(C), pages 261-267.
    4. Joachim Freyberger & Joel L. Horowitz, 2013. "Identification and shape restrictions in nonparametric instrumental variables estimation," CeMMAP working papers CWP31/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Orla Doyle & Colm Harmon & James J. Heckman & Caitriona Logue & Seong Moon, 2013. "Measuring Investment in Human Capital Formation: An Experimental Analysis of Early Life Outcomes," NBER Working Papers 19316, National Bureau of Economic Research, Inc.
    6. Zhao, Junguang & Xu, Xingzhong, 2016. "A generalized likelihood ratio test for normal mean when p is greater than n," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 91-104.
    7. Meta Brown & John Grigsby & Wilbert van der Klaauw & Jaya Wen & Basit Zafar, 2016. "Financial Education and the Debt Behavior of the Young," Review of Financial Studies, Society for Financial Studies, vol. 29(9), pages 2490-2522.
    8. Krauss, Christopher, 2015. "Statistical arbitrage pairs trading strategies: Review and outlook," FAU Discussion Papers in Economics 09/2015, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    9. esposito, francesco paolo & cummins, mark, 2015. "Multiple hypothesis testing of market risk forecasting models," MPRA Paper 64986, University Library of Munich, Germany.
    10. Deeney, Peter & Cummins, Mark & Dowling, Michael & Bermingham, Adam, 2015. "Sentiment in oil markets," International Review of Financial Analysis, Elsevier, vol. 39(C), pages 179-185.
    11. Cummins, Mark, 2013. "EU ETS market interactions: The case for multiple hypothesis testing approaches," Applied Energy, Elsevier, vol. 111(C), pages 701-709.
    12. Ciampi, Francesco, 2015. "Corporate governance characteristics and default prediction modeling for small enterprises. An empirical analysis of Italian firms," Journal of Business Research, Elsevier, vol. 68(5), pages 1012-1025.
    13. Roland G. Fryer, Jr & Meghan Howard Noveck, 2017. "High-Dosage Tutoring and Reading Achievement: Evidence from New York City," NBER Working Papers 23792, National Bureau of Economic Research, Inc.
    14. Joachim Freyberger & Joel L. Horowitz, 2012. "Identification and shape restrictions in nonparametric instrumental variables estimation," CeMMAP working papers CWP15/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Kearney, Fearghal & Cummins, Mark & Murphy, Finbarr, 2014. "Outperformance in exchange-traded fund pricing deviations: Generalized control of data snooping bias," Journal of Financial Markets, Elsevier, vol. 19(C), pages 86-109.
    16. Shen, Yanfeng & Lin, Zhengyan & Zhu, Jun, 2011. "Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2221-2233, July.
    17. Dowling, Michael & Cummins, Mark & Lucey, Brian M., 2016. "Psychological barriers in oil futures markets," Energy Economics, Elsevier, vol. 53(C), pages 293-304.
    18. repec:eee:labeco:v:45:y:2017:i:c:p:40-58 is not listed on IDEAS
    19. Freyberger, Joachim & Horowitz, Joel L., 2015. "Identification and shape restrictions in nonparametric instrumental variables estimation," Journal of Econometrics, Elsevier, vol. 189(1), pages 41-53.
    20. repec:eee:intfin:v:49:y:2017:i:c:p:1-14 is not listed on IDEAS
    21. Cummins, Mark & Dowling, Michael & Lucey, Brian M., 2015. "Behavioral influences in non-ferrous metals prices," Resources Policy, Elsevier, vol. 45(C), pages 9-22.
    22. Mark Cummins & Brian M. Lucey & Michael M. Dowling, 2014. "Behavioral Influences in Non-Ferrous Metals Prices," The Institute for International Integration Studies Discussion Paper Series iiisdp459, IIIS.

    More about this item

    Keywords

    asymptotics; multiple testing; optimality; resampling;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:anr:reveco:v:2:y:2010:p:75-104. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (http://www.annualreviews.org). General contact details of provider: http://www.annualreviews.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.