IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11027.html
   My bibliography  Save this paper

Testing with Vectors of Statistics: Revisiting Combined Hypothesis Tests with an Application to Specification Testing

Author

Listed:
  • Lena S. Bjerkander
  • Jonas Dovern
  • Hans Manner

Abstract

We review tests of null hypotheses that consist of many subsidiary null hypotheses, including tests that have not received much attention in the econometrics literature. We study test performance in the context of specification testing for linear regressions based on a Monte Carlo study. Overall, parametric tests that use (transformed) P-values corresponding to all subsidiary null hypotheses outperform the well-known minimum P-value test and a recently proposed test that relies on the non-parametric estimation of the joint density of all subsidiary test statistics.

Suggested Citation

  • Lena S. Bjerkander & Jonas Dovern & Hans Manner, 2024. "Testing with Vectors of Statistics: Revisiting Combined Hypothesis Tests with an Application to Specification Testing," CESifo Working Paper Series 11027, CESifo.
    • Handle: RePEc:ces:ceswps:_11027
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11027.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    2. King, Maxwell L. & Zhang, Xibin & Akram, Muhammad, 2020. "Hypothesis testing based on a vector of statistics," Journal of Econometrics, Elsevier, vol. 219(2), pages 425-455.
    3. Breusch, T S & Pagan, A R, 1979. "A Simple Test for Heteroscedasticity and Random Coefficient Variation," Econometrica, Econometric Society, vol. 47(5), pages 1287-1294, September.
    4. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, April.
    5. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    2. James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Paper 1127, Economics Department, Queen's University.
    3. Mehzabin Tuli, Farzana & Mitra, Suman & Crews, Mariah B., 2021. "Factors influencing the usage of shared E-scooters in Chicago," Transportation Research Part A: Policy and Practice, Elsevier, vol. 154(C), pages 164-185.
    4. Hideki Murakami & Yukari Matsuse & Koji Mukaigawa & Yushi Tsunoda, 2013. "Product lifecycle and choice of transportation modes: Japan' s evidence of import and export," Discussion Papers 2013-28, Kobe University, Graduate School of Business Administration.
    5. Ivanova, Vesela & Puigvert Gutiérrez, Josep Maria, 2014. "Interest rate forecasts, state price densities and risk premium from Euribor options," Journal of Banking & Finance, Elsevier, vol. 48(C), pages 210-223.
    6. Michele Fratianni & Francesco Marchionne, 2011. "The Limits to Integration," Chapters, in: Miroslav N. Jovanović (ed.), International Handbook on the Economics of Integration, Volume I, chapter 9, Edward Elgar Publishing.
    7. Tadashi Kikuchi, 2014. "Vietnamese Inter – regional labor migration: system approach to the modeling 1989, 1999, 2009," EcoMod2014 6998, EcoMod.
    8. Ning, Ye & Zhang, Lingxiang, 2018. "Modeling dynamics of short-term international capital flows in China: A Markov regime switching approach," The North American Journal of Economics and Finance, Elsevier, vol. 44(C), pages 193-203.
    9. Jean-Paul Azam & Catherine Bonjean, 1995. "La formation du prix du riz : théorie et application au cas d'Antananarivo (Madagascar) ," Revue Économique, Programme National Persée, vol. 46(4), pages 1145-1166.
    10. Nathaniel Geiger & Bryan McLaughlin & John Velez, 2021. "Not all boomers: temporal orientation explains inter- and intra-cultural variability in the link between age and climate engagement," Climatic Change, Springer, vol. 166(1), pages 1-20, May.
    11. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    12. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
    13. Vittorio Nicolardi, 2009. "The effects of the new 1995 ESA methodologies of estimation on the structural analysis of Italian consumption," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(1), pages 125-149, March.
    14. Arthur Lewbel, 2012. "Using Heteroscedasticity to Identify and Estimate Mismeasured and Endogenous Regressor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 67-80.
    15. Raffaella Santolini, 2017. "Electoral Rules And Public Spending Composition: The Case Of Italian Regions," Contemporary Economic Policy, Western Economic Association International, vol. 35(3), pages 551-577, July.
    16. Desbordes, Rodolphe, 2007. "The sensitivity of U.S. multinational enterprises to political and macroeconomic uncertainty: A sectoral analysis," International Business Review, Elsevier, vol. 16(6), pages 732-750, December.
    17. Zsuzsa Lábiscsák-Erdélyi & Ilona Veres-Balajti & Annamária Somhegyi & Karolina Kósa, 2022. "Self-Esteem Is Independent Factor and Moderator of School-Related Psychosocial Determinants of Life Satisfaction in Adolescents," IJERPH, MDPI, vol. 19(9), pages 1-14, May.
    18. Anjum, Zeba & Burke, Paul J. & Gerlagh, Reyer & Stern, David I., "undated". "Modeling the Emissions-Income Relationship Using Long-Run Growth Rates," Working Papers 249422, Australian National University, Centre for Climate Economics & Policy.
    19. Grzegorz Rybak & Edward Kozłowski & Krzysztof Król & Tomasz Rymarczyk & Agnieszka Sulimierska & Artur Dmowski & Piotr Bednarczuk, 2023. "Algorithms for Optimizing Energy Consumption for Fermentation Processes in Biogas Production," Energies, MDPI, vol. 16(24), pages 1-17, December.
    20. Garcia-Hiernaux, Alfredo & Gonzalez-Perez, Maria T. & Guerrero, David E., 2023. "Eurozone prices: A tale of convergence and divergence," Economic Modelling, Elsevier, vol. 126(C).

    More about this item

    Keywords

    combined hypothesis; P-value; multiple hypothesis testing; Fisher test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.