IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11027.html
   My bibliography  Save this paper

Testing with Vectors of Statistics: Revisiting Combined Hypothesis Tests with an Application to Specification Testing

Author

Listed:
  • Lena S. Bjerkander
  • Jonas Dovern
  • Hans Manner

Abstract

We review tests of null hypotheses that consist of many subsidiary null hypotheses, including tests that have not received much attention in the econometrics literature. We study test performance in the context of specification testing for linear regressions based on a Monte Carlo study. Overall, parametric tests that use (transformed) P-values corresponding to all subsidiary null hypotheses outperform the well-known minimum P-value test and a recently proposed test that relies on the non-parametric estimation of the joint density of all subsidiary test statistics.

Suggested Citation

  • Lena S. Bjerkander & Jonas Dovern & Hans Manner, 2024. "Testing with Vectors of Statistics: Revisiting Combined Hypothesis Tests with an Application to Specification Testing," CESifo Working Paper Series 11027, CESifo.
    • Handle: RePEc:ces:ceswps:_11027
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11027.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    2. King, Maxwell L. & Zhang, Xibin & Akram, Muhammad, 2020. "Hypothesis testing based on a vector of statistics," Journal of Econometrics, Elsevier, vol. 219(2), pages 425-455.
    3. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    4. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, April.
    5. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    2. James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Paper 1127, Economics Department, Queen's University.
    3. Hideki Murakami & Yukari Matsuse & Koji Mukaigawa & Yushi Tsunoda, 2013. "Product lifecycle and choice of transportation modes: Japan' s evidence of import and export," Discussion Papers 2013-28, Kobe University, Graduate School of Business Administration.
    4. Ning, Ye & Zhang, Lingxiang, 2018. "Modeling dynamics of short-term international capital flows in China: A Markov regime switching approach," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 193-203.
    5. Nathaniel Geiger & Bryan McLaughlin & John Velez, 2021. "Not all boomers: temporal orientation explains inter- and intra-cultural variability in the link between age and climate engagement," Climatic Change, Springer, vol. 166(1), pages 1-20, May.
    6. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    7. Desbordes, Rodolphe, 2007. "The sensitivity of U.S. multinational enterprises to political and macroeconomic uncertainty: A sectoral analysis," International Business Review, Elsevier, vol. 16(6), pages 732-750, December.
    8. Zsuzsa Lábiscsák-Erdélyi & Ilona Veres-Balajti & Annamária Somhegyi & Karolina Kósa, 2022. "Self-Esteem Is Independent Factor and Moderator of School-Related Psychosocial Determinants of Life Satisfaction in Adolescents," IJERPH, MDPI, vol. 19(9), pages 1-14, May.
    9. Grzegorz Rybak & Edward Kozłowski & Krzysztof Król & Tomasz Rymarczyk & Agnieszka Sulimierska & Artur Dmowski & Piotr Bednarczuk, 2023. "Algorithms for Optimizing Energy Consumption for Fermentation Processes in Biogas Production," Energies, MDPI, vol. 16(24), pages 1-17, December.
    10. Corradi, Valentina & Swanson, Norman R., 2004. "A test for the distributional comparison of simulated and historical data," Economics Letters, Elsevier, vol. 85(2), pages 185-193, November.
    11. Xu, Bin & Lin, Boqiang, 2018. "Do we really understand the development of China's new energy industry?," Energy Economics, Elsevier, vol. 74(C), pages 733-745.
    12. Vance, Colin & Procher, Vivien, 2013. "Who Does the Shopping? German time-use evidence, 1996-2009," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 2357, pages 125-133.
    13. Ahmad, Babor & Rabbani, M. Golam & Shilpa, Nusrat Afrin & Haque, Mohammad Samiul & Rahman, M. Naimur, 2022. "Diversification Of Livelihoods And Its Impact On The Welfare Of Tribal Households In Dinajpur District Of Bangladesh," Bangladesh Journal of Agricultural Economics, Bangladesh Agricultural University, vol. 43(1), June.
    14. Skare, Marinko & Gavurova, Beata & Sinkovic, Dean, 2023. "Regional aspects of financial development and renewable energy: A cross-sectional study in 214 countries," Economic Analysis and Policy, Elsevier, vol. 78(C), pages 1142-1157.
    15. George Anastassopoulos, 2003. "MNE subsidiaries versus domestic enterprises: an analysis of their ownership and location-specific advantages," Applied Economics, Taylor & Francis Journals, vol. 35(13), pages 1505-1514.
    16. Colin C. Williams & Ioana Alexandra Horodnic, 2017. "Tackling Bogus Self-Employment: Some Lessons From Romania," Journal of Developmental Entrepreneurship (JDE), World Scientific Publishing Co. Pte. Ltd., vol. 22(02), pages 1-20, June.
    17. Sharma, Rajesh & Shahbaz, Muhammad & Sinha, Avik & Vo, Xuan Vinh, 2021. "Examining the temporal impact of stock market development on carbon intensity: Evidence from South Asian countries," MPRA Paper 108925, University Library of Munich, Germany, revised 2021.
    18. Shinsuke Asakawa, 2020. "Can Child Benefits Shape Parents' Attitudes toward Childrearing in Japan?: Effects of Child Benefit Policy Expansions," Discussion Papers in Economics and Business 19-04-Rev.2, Osaka University, Graduate School of Economics.
    19. Mona Chitnis, Roger Fouquet, and Steve Sorrell, 2020. "Rebound Effects for Household Energy Services in the UK," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 31-60.
    20. Marijke Verpoorten & Lode Berlage, 2004. "Genocide and land scarcity: Can Rwandan rural households manage?," CSAE Working Paper Series 2004-15, Centre for the Study of African Economies, University of Oxford.

    More about this item

    Keywords

    combined hypothesis; P-value; multiple hypothesis testing; Fisher test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.