IDEAS home Printed from https://ideas.repec.org/p/amu/wpaper/2012-11.html
   My bibliography  Save this paper

Combination of "Combinations of P-values

Author

Listed:
  • Xuguang Sheng
  • Lan Cheng

Abstract

We investigate the impact of an uncertain number of false individual null hypotheses on commonly used p-value combination methods and find that the performance of these methods varies substantially under such uncertainty. These variations yield conflicting results in meta-analysis, motivating the development of a new, reconciling test. We consequently develop a combination of "combinations of p-values" (CCP) test that maintains good power properties across such uncertainty. We base the CCP test on a simple union of rejections decision rule that exploits the similarity between any two p-value combination methods. Monte Carlo simulations show that our test controls size and closely tracks the power of the best individual methods.

Suggested Citation

  • Xuguang Sheng & Lan Cheng, 2012. "Combination of "Combinations of P-values," Working Papers 2012-11, American University, Department of Economics.
  • Handle: RePEc:amu:wpaper:2012-11
    as

    Download full text from publisher

    File URL: https://drive.google.com/open?id=1heLzgknO8VHpNd_AZE3LNln-woGlQgKK
    File Function: First version, 2012
    Download Restriction: no

    References listed on IDEAS

    as
    1. Ana-Maria Dumitru & Giovanni Urga, 2011. "Identifying Jumps in Financial Assets: A Comparison Between Nonparametric Jump Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(2), pages 242-255, October.
    2. Harvey, David I. & Leybourne, Stephen J. & Taylor, A.M. Robert, 2009. "Unit Root Testing In Practice: Dealing With Uncertainty Over The Trend And Initial Condition," Econometric Theory, Cambridge University Press, vol. 25(03), pages 587-636, June.
    3. Xuguang Sheng & Jingyun Yang, 2013. "Truncated Product Methods for Panel Unit Root Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(4), pages 624-636, August.
    4. Choi, In, 2001. "Unit root tests for panel data," Journal of International Money and Finance, Elsevier, vol. 20(2), pages 249-272, April.
    5. David I. Harvey & Stephen J. Leybourne & A. M. Robert Taylor, 2011. "Testing for Unit Roots and the Impact of Quadratic Trends, with an Application to Relative Primary Commodity Prices," Econometric Reviews, Taylor & Francis Journals, vol. 30(5), pages 514-547, October.
    6. M. Hashem Pesaran, 2007. "A simple panel unit root test in the presence of cross-section dependence," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(2), pages 265-312.
    7. Lopez, Claude, 2008. "Evidence of purchasing power parity for the floating regime period," Journal of International Money and Finance, Elsevier, vol. 27(1), pages 156-164, February.
    8. repec:taf:jnlbes:v:30:y:2012:i:2:p:242-255 is not listed on IDEAS
    9. Loughin, Thomas M., 2004. "A systematic comparison of methods for combining p-values from independent tests," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 467-485, October.
    10. Wu, Jyh-Lin & Wu, Shaowen, 2001. "Is Purchasing Power Parity Overvalued?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 33(3), pages 804-812, August.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Combination methods; Hypothesis testing; p value; Union of rejections;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:amu:wpaper:2012-11. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Thomas Meal). General contact details of provider: http://www.american.edu/cas/economics/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.