IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2504.16696.html

Evaluating Meta-Regression Techniques: A Simulation Study on Heterogeneity in Location and Time

Author

Listed:
  • Ali Habibnia
  • Jonathan Gendron

Abstract

In this paper, we conduct a simulation study with subject-level data to evaluate conventional meta-regression approaches (study-level random, fixed, and mixed effects) against seven methodology specifications new to meta-regressions that control joint heterogeneity in location and time (including a new one that we introduce). We systematically vary heterogeneity levels to assess statistical power, estimator bias and model robustness for each methodology specification. This assessment focuses on three aspects: performance under joint heterogeneity in location and time, the effectiveness of our proposed settings incorporating location fixed effects and study-level fixed effects with a time trend, as well as guidelines for model selection. The results show that jointly modeling heterogeneity when heterogeneity is in both dimensions improves performance compared to modeling only one type of heterogeneity.

Suggested Citation

  • Ali Habibnia & Jonathan Gendron, 2025. "Evaluating Meta-Regression Techniques: A Simulation Study on Heterogeneity in Location and Time," Papers 2504.16696, arXiv.org, revised Jul 2025.
    • Handle: RePEc:arx:papers:2504.16696
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2504.16696
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Clark, Tom S. & Linzer, Drew A., 2015. "Should I Use Fixed or Random Effects?," Political Science Research and Methods, Cambridge University Press, vol. 3(2), pages 399-408, May.
    2. Clark, Tom S. & Linzer, Drew A., 2015. "Should I Use Fixed or Random Effects?," Political Science Research and Methods, Cambridge University Press, vol. 3(02), pages 399-408, May.
    3. Fei Guo & Shi He & Zhitao Lin, 2023. "Truths and Myths About the Finance-Growth Nexus in China: A Meta-Analysis," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 59(5), pages 1408-1425, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elizabeth Fussell & Sara R. Curran & Matthew D. Dunbar & Michael A. Babb & Luanne Thompson & Jacqueline Meijer-Irons, 2017. "Weather-Related Hazards and Population Change," The ANNALS of the American Academy of Political and Social Science, , vol. 669(1), pages 146-167, January.
    2. Odolinski, Kristofer & Smith, Andrew & Wheat, Phill & Nilsson, Jan-Eric & Dheilly, Clement, 2023. "Damage or no damage from traffic: Re-examining marginal cost pricing for rail signalling maintenance," Transport Policy, Elsevier, vol. 131(C), pages 13-21.
    3. Kolcava, Dennis & Nguyen, Quynh & Bernauer, Thomas, 2019. "Does trade liberalization lead to environmental burden shifting in the global economy?," Ecological Economics, Elsevier, vol. 163(C), pages 98-112.
    4. Odeck, James & Høyem, Harald, 2021. "The impact of competitive tendering on operational costs and market concentration in public transport: The Norwegian car ferry services," Research in Transportation Economics, Elsevier, vol. 90(C).
    5. Wu, Bingyu & Levinson, David M., 2024. "A multi-modal analysis of the effect of transport on population and productivity in China," Journal of Transport Geography, Elsevier, vol. 116(C).
    6. Anselm Komla Abotsi, 2018. "Influence of Governance Indicators on Illicit Financial Outflow from Developing Countries," Contemporary Economics, Vizja University, vol. 12(2), June.
    7. Yue, Jiahua & Zhou, Shangsi, 2018. "Democracy’s comparative advantage: Evidence from aggregated trade data, 1962–2010," World Development, Elsevier, vol. 111(C), pages 27-40.
    8. Tilov, Ivan & Weber, Sylvain, 2023. "Heterogeneity in price elasticity of vehicle kilometers traveled: Evidence from micro-level panel data," Energy Economics, Elsevier, vol. 127(PA).
    9. Yhlas SOVBETOV, 2019. "Phillips Curve Estimation During Tranquil and Recessionary Periods: Evidence From Panel Analysis," Istanbul Journal of Economics-Istanbul Iktisat Dergisi, Istanbul University, Faculty of Economics, vol. 69(1), pages 23-41, June.
    10. Jacques, Olivier & Noël, Alain, 2022. "The politics of public health investments," Social Science & Medicine, Elsevier, vol. 309(C).
    11. Peter M. Schwarz & Craig A. Depken II & Michael W. Herron & Benjamin J. Correlf, 2021. "ENERGY STAR Appliance Market Shares: Do They Respond to Electricity Prices, and Does It Matter?," The Energy Journal, , vol. 42(4), pages 253-266, July.
    12. Wang, Haining & Smyth, Russell & Cheng, Zhiming, 2017. "The economic returns to proficiency in English in China," China Economic Review, Elsevier, vol. 43(C), pages 91-104.
    13. Brian Blankenship, 2018. "When Do States Take the Bait? State Capacity and the Provocation Logic of Terrorism," Journal of Conflict Resolution, Peace Science Society (International), vol. 62(2), pages 381-409, February.
    14. Mydland, Ørjan & Kumbhakar, Subal C. & Lien, Gudbrand & Amundsveen, Roar & Kvile, Hilde Marit, 2020. "Economies of scope and scale in the Norwegian electricity industry," Economic Modelling, Elsevier, vol. 88(C), pages 39-46.
    15. Tuan, Truong Anh & Nam, Pham Khanh & Loan, Le Thanh, 2022. "The impact of health insurance on households’ financial choices: Evidence from Vietnam," Research in Economics, Elsevier, vol. 76(3), pages 264-276.
    16. Fenton Villar, Paul, 2020. "The Extractive Industries Transparency Initiative (EITI) and trust in politicians," Resources Policy, Elsevier, vol. 68(C).
    17. Bourdeau-Brien, Michael & Kryzanowski, Lawrence, 2019. "Municipal financing costs following disasters," Global Finance Journal, Elsevier, vol. 40(C), pages 48-64.
    18. Victor Asal & Justin Conrad & Nathan Toronto, 2017. "I Want You! The Determinants of Military Conscription," Journal of Conflict Resolution, Peace Science Society (International), vol. 61(7), pages 1456-1481, August.
    19. Karen Ruckman & Ian McCarthy, 2017. "Why do some patents get licensed while others do not?," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(4), pages 667-688.
    20. Mydland, Ørjan & Størdal, Ståle & Kumbhakar, Subal C. & Lien, Gudbrand, 2022. "Modeling markups and its determinants: The case of Norwegian industries and regions," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 252-262.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2504.16696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.