Combination of "Combinations of P-values
AbstractWe investigate the impact of an uncertain number of false individual null hypotheses on commonly used p-value combination methods and ﬁnd that the performance of these methods varies substantially under such uncertainty. These variations yield conﬂicting results in meta-analysis, motivating the development of a new, reconciling test. We consequently develop a combination of "combinations of p-values" (CCP) test that maintains good power properties across such uncertainty. We base the CCP test on a simple union of rejections decision rule that exploits the similarity between any two p-value combination methods. Monte Carlo simulations show that our test controls size and closely tracks the power of the best individual methods.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by American University, Department of Economics in its series Working Papers with number 2012-11.
Date of creation: 2012
Date of revision:
Contact details of provider:
Web page: http://www.american.edu/cas/economics/
Combination methods; Hypothesis testing; p value; Union of rejections;
Find related papers by JEL classification:
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- repec:taf:jnlbes:v:30:y:2012:i:2:p:242-255 is not listed on IDEAS
- Loughin, Thomas M., 2004. "A systematic comparison of methods for combining p-values from independent tests," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 467-485, October.
- Wu, Jyh-Lin & Wu, Shaowen, 2001. "Is Purchasing Power Parity Overvalued?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 33(3), pages 804-12, August.
- Ana-Maria Dumitru & Giovanni Urga, 2011. "Identifying Jumps in Financial Assets: A Comparison Between Nonparametric Jump Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(2), pages 242-255, October.
- Choi, In, 2001. "Unit root tests for panel data," Journal of International Money and Finance, Elsevier, vol. 20(2), pages 249-272, April.
- Claude Lopez, 2004.
"Evidence of Purchasing Power Parity for the Floating Regime Period,"
University of Cincinnati, Economics Working Papers Series
2004-01, University of Cincinnati, Department of Economics, revised Mar 2006.
- Lopez, Claude, 2008. "Evidence of purchasing power parity for the floating regime period," Journal of International Money and Finance, Elsevier, vol. 27(1), pages 156-164, February.
- M. Hashem Pesaran, 2007.
"A simple panel unit root test in the presence of cross-section dependence,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 22(2), pages 265-312.
- Pesaran, M.H., 2003. "A Simple Panel Unit Root Test in the Presence of Cross Section Dependence," Cambridge Working Papers in Economics 0346, Faculty of Economics, University of Cambridge.
- Xuguang Sheng & Jingyun Yang, 2013.
"Truncated Product Methods for Panel Unit Root Tests,"
Oxford Bulletin of Economics and Statistics,
Department of Economics, University of Oxford, vol. 75(4), pages 624-636, 08.
- Xuguang Sheng & Jingyun Yang, 2013. "Truncated Product Methods for Panel Unit Root Tests," Working Papers 2013-004, The George Washington University, Department of Economics, Research Program on Forecasting.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Thomas Meal).
If references are entirely missing, you can add them using this form.